2026-03-29 22:00:09 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 22:00:09 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 22:00:09 [bca.uk] INFO: Starting spider bca.uk
2026-03-29 22:00:09 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 22:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 22:00:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2121
2026-03-29 22:00:09 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 22:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 22:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /SpiderData()?$filter=PartitionKey%20eq%20%27BCAUk%27%20and%20RowKey%20eq%20%27cookies%27 HTTP/1.1" 200 None
2026-03-29 22:00:09 [bca.uk] INFO: No cached cookies found, will perform fresh login
2026-03-29 22:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /SpiderData()?$filter=PartitionKey%20eq%20%27BCAUk%27%20and%20RowKey%20eq%20%27auth_token%27 HTTP/1.1" 200 None
2026-03-29 22:00:09 [bca.uk] INFO: Loaded cached Auth0 token from Azure Tables (length=1492)
2026-03-29 22:00:09 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 22:00:09 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 22:00:09 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 22:00:09 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 22:00:09 [scrapy.extensions.telnet] INFO: Telnet Password: 2e31b2d642a20a52
2026-03-29 22:00:09 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-29 22:00:09 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/bca.uk/task_51_2026-03-29T22_00_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-29 22:00:09 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 22:00:09 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 22:00:09 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 22:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 22:00:10 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 22:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:10 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 22:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 22:00:10 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 22:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 22:00:10 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 22:00:10 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 22:00:10 [scrapy.core.engine] INFO: Spider opened
2026-03-29 22:00:10 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 22:00:10 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-29 22:00:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-29 22:00:10 [scrapy-playwright] INFO: Starting download handler
2026-03-29 22:00:10 [scrapy-playwright] INFO: Starting download handler
2026-03-29 22:00:10 [scrapy-playwright] INFO: Launching 1 startup context(s)
2026-03-29 22:00:10 [scrapy-playwright] INFO: Launching browser chromium
2026-03-29 22:00:10 [scrapy-playwright] INFO: Launching 1 startup context(s)
2026-03-29 22:00:10 [scrapy-playwright] INFO: Launching browser chromium
2026-03-29 22:00:10 [scrapy-playwright] INFO: Browser chromium launched
2026-03-29 22:00:10 [scrapy-playwright] INFO: Browser chromium launched
2026-03-29 22:00:10 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-29 22:00:11 [scrapy-playwright] INFO: Startup context(s) launched
2026-03-29 22:00:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-29 22:00:11 [scrapy-playwright] INFO: Startup context(s) launched
2026-03-29 22:00:15 [bca.uk] INFO: No cached cookies available, starting login process with credentials
2026-03-29 22:00:15 [bca.uk] INFO: Zyte login attempt 1/3
2026-03-29 22:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/> (referer: None) ['zyte-api']
2026-03-29 22:00:53 [bca.uk] INFO: Action 0 (waitForTimeout): status=success, elapsed=5s
2026-03-29 22:00:53 [bca.uk] INFO: Action 1 (waitForSelector): status=success, elapsed=0.007s
2026-03-29 22:00:53 [bca.uk] INFO: Action 2 (evaluate): status=success, elapsed=0.002s
2026-03-29 22:00:53 [bca.uk] INFO: Action 3 (waitForTimeout): status=success, elapsed=1s
2026-03-29 22:00:53 [bca.uk] INFO: Action 4 (click): status=success, elapsed=2.4s
2026-03-29 22:00:53 [bca.uk] INFO: Action 5 (waitForSelector): status=success, elapsed=0.848s
2026-03-29 22:00:53 [bca.uk] INFO: Action 6 (waitForTimeout): status=success, elapsed=1s
2026-03-29 22:00:53 [bca.uk] INFO: Action 7 (click): status=success, elapsed=1.499s
2026-03-29 22:00:53 [bca.uk] INFO: Action 8 (type): status=success, elapsed=0.024s
2026-03-29 22:00:53 [bca.uk] INFO: Action 9 (waitForTimeout): status=success, elapsed=1.001s
2026-03-29 22:00:53 [bca.uk] INFO: Action 10 (click): status=success, elapsed=2.026s
2026-03-29 22:00:53 [bca.uk] INFO: Action 11 (type): status=success, elapsed=0.023s
2026-03-29 22:00:53 [bca.uk] INFO: Action 12 (waitForTimeout): status=success, elapsed=1s
2026-03-29 22:00:53 [bca.uk] INFO: Action 13 (click): status=success, elapsed=2.976s
2026-03-29 22:00:53 [bca.uk] INFO: Action 14 (waitForSelector): status=success, elapsed=3.129s
2026-03-29 22:00:53 [bca.uk] INFO: Action 15 (evaluate): status=success, elapsed=0.005s
2026-03-29 22:00:53 [bca.uk] INFO: Action 16 (waitForTimeout): status=success, elapsed=10s
2026-03-29 22:00:53 [bca.uk] INFO: Action 17 (evaluate): status=success, elapsed=0.001s
2026-03-29 22:00:53 [bca.uk] INFO: Page URL after login: https://www.bca.co.uk/
2026-03-29 22:00:53 [bca.uk] INFO: Successfully logged in via Zyte API session
2026-03-29 22:00:53 [bca.uk] INFO: Scrapy-formatted cookies: [{'name': 'AMCV_E5F2C8A15481C0E20A4C98BC%40AdobeOrg', 'value': '179643557%7CMCIDTS%7C20542%7CMCMID%7C76610459130310112984245421642973284881%7CMCAAMLH-1775426430%7C7%7CMCAAMB-1775426430%7C6G1ynYcLPuiQxYZrsz_pkqfLG9yMXBpb2zX5dvJdYQJzPXImdj0y%7CMCOPTOUT-1774828830s%7CNONE%7CMCSYNCSOP%7C411-20549%7CvVersion%7C5.5.0', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'sc_dslv', 'value': '1774821642151', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'gpv_pn', 'value': 'auctionview', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'auth0.VS7z7E8b9vqJ2LYaGXEbb1f5CP1SGRLD.is.authenticated', 'value': 'true', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'ASLBSA', 'value': '000323392f7a18bd2b0ff7209c28bb25c0f06dee33a9cf62b65238d7d6868fdf5ddf', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'AMCVS_E5F2C8A15481C0E20A4C98BC%40AdobeOrg', 'value': '1', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'sc_dslv_s', 'value': 'First%20Visit', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'JSESSIONID', 'value': 'BDA4CDD3AE459774FDD0016281F23470', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 's_sq', 'value': '%5B%5BB%5D%5D', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 's_cc', 'value': 'true', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'dtCookie', 'value': 'v_4_srv_4_sn_94849D88B7423C8698283AE3844AB508_perc_100000_ol_0_mul_1_app-3A5d68a08db18e8bbb_1_app-3Aea7c4b59f27d43eb_1', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'dtPC', 'value': '4$21640951_751h-vVRMUQDIFFKRSTSCHFHMTQPMFKBODFUNH-0e0', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'rxVisitor', 'value': '1774821617920OT8UQ2CT0FPF244DTHTN3RULV3DN90PN', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'csrf', 'value': 'A75tPo0nE4UMKYRCiQNLZ90lF2ACJt0N6ZMH4NHC-l2L_0nsySq22h9FM_e0VOZChWvt1wOvr8jg7ze89QO2lw:AAABnTucrAU:whVamDDTEqmNnkj5dhwvuQ', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'INGRESSCOOKIE', 'value': '201d4d7cdb35b651709a73d47c4eaea6|17148814d3d29f21517da122aae4be83', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'dest', 'value': 'https://www.bca.co.uk/', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'ASLBSACORS', 'value': '000323392f7a18bd2b0ff7209c28bb25c0f06dee33a9cf62b65238d7d6868fdf5ddf', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': '__cf_bm', 'value': 'EKd9vjset010bBxgOmSWE8z.bJXIadhQ3QdMXRPxN3o-1774821615.942378-1.0.1.1-oF_xLMq2kdtsGxt0Ca0qUhsNiA.5AsHpvJ1p03_YkZT2ejD0kkjnh0p1S_4cQ.8PTgM7NId2vKsVujDcxHcdeA_kAEzNL1uji.lGe1kThL6YMcgAzGiuI7EFWSXbaN0B6WtoEM4jchsEyU78VX2h8Q', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'rxvt', 'value': '1774823442038|1774821617921', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'OptanonAlertBoxClosed', 'value': '2026-03-29T22:00:25.416Z', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'OptanonConsent', 'value': 'isGpcEnabled=0&datestamp=Sun+Mar+29+2026+18%3A00%3A41+GMT-0400+(Eastern+Daylight+Time)&version=202510.1.0&browserGpcFlag=0&isIABGlobal=false&hosts=&consentId=d56829c0-16c6-4991-ab8f-0bd58772e838&interactionCount=1&isAnonUser=1&landingPath=NotLandingPage&groups=C0001%3A1%2CC0003%3A1%2CC0004%3A1%2CC0002%3A1&intType=1&geolocation=US%3BNV&AwaitingReconsent=false', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 's_getNewRepeat', 'value': '1774821642151-New', 'domain': '.bca.co.uk', 'path': '/'}, {'name': '_legacy_auth0.VS7z7E8b9vqJ2LYaGXEbb1f5CP1SGRLD.is.authenticated', 'value': 'true', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'dtSa', 'value': '-', 'domain': '.bca.co.uk', 'path': '/'}]
2026-03-29 22:00:53 [bca.uk] INFO: Extracted 24 cookies from Zyte login response
2026-03-29 22:00:53 [bca.uk] INFO: Merged 15 browser cookies, total: 24
2026-03-29 22:00:53 [bca.uk] INFO: Auth0 token capture: token=yes, error=client-created
2026-03-29 22:00:53 [bca.uk] INFO: Got Auth0 access token via dynamic SDK (length=1492)
2026-03-29 22:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='BCAUk',RowKey='auth_token') HTTP/1.1" 204 0
2026-03-29 22:00:53 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded
2026-03-29 22:00:53 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:00:53 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:00:53 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:00:53 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:00:56 [bca.uk] INFO: Total items found: 100
2026-03-29 22:00:56 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded
2026-03-29 22:00:56 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:00:56 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: P17%20LPT
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P17%2520LPT%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for P17%20LPT: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9 with identifier: P17%20LPT
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9
2026-03-29 22:00:56 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:00:56 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: ML23%20KNX
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML23%2520KNX%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for ML23%20KNX: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c96e7ad0-7cd4-5ea7-b41d-642972a2bf14 with identifier: ML23%20KNX
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c96e7ad0-7cd4-5ea7-b41d-642972a2bf14
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: PA19%20DCO
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PA19%2520DCO%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for PA19%20DCO: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da397772-3003-5876-84de-18e19f2e1e0e with identifier: PA19%20DCO
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item da397772-3003-5876-84de-18e19f2e1e0e
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: PJ72%20FOT
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ72%2520FOT%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for PJ72%20FOT: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a with identifier: PJ72%20FOT
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: RE20%20EVL
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE20%2520EVL%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for RE20%20EVL: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b145ed4d-e096-5329-b7ec-7396067fba60 with identifier: RE20%20EVL
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b145ed4d-e096-5329-b7ec-7396067fba60
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: SG69%20FWY
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG69%2520FWY%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for SG69%20FWY: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23673480-b7c5-5707-903a-2783d4797f75 with identifier: SG69%20FWY
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 23673480-b7c5-5707-903a-2783d4797f75
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: YM19%20VXX
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM19%2520VXX%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for YM19%20VXX: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 553a9526-308c-5e9f-97f5-1bce769f99d7 with identifier: YM19%20VXX
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 553a9526-308c-5e9f-97f5-1bce769f99d7
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: HS68%20PYY
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HS68%2520PYY%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for HS68%20PYY: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73 with identifier: HS68%20PYY
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: DE19%20AAK
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE19%2520AAK%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for DE19%20AAK: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff522792-d041-5ecb-b231-8bf72c190c1e with identifier: DE19%20AAK
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ff522792-d041-5ecb-b231-8bf72c190c1e
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: YH70%20YYW
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH70%2520YYW%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for YH70%20YYW: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01b57636-ffd9-585f-9b00-e6ae7dbcc329 with identifier: YH70%20YYW
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 01b57636-ffd9-585f-9b00-e6ae7dbcc329
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: DC19%20VSX
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC19%2520VSX%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for DC19%20VSX: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 732664ff-2041-53f2-83f7-e4a6aeaa1df2 with identifier: DC19%20VSX
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 732664ff-2041-53f2-83f7-e4a6aeaa1df2
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: LA70%20NPE
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA70%2520NPE%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for LA70%20NPE: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4838ed0-a1bc-555f-ae17-73d79e29d1ac with identifier: LA70%20NPE
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b4838ed0-a1bc-555f-ae17-73d79e29d1ac
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: YE18%20CHX
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE18%2520CHX%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for YE18%20CHX: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad with identifier: YE18%20CHX
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: MA16%20ETX
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA16%2520ETX%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for MA16%20ETX: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6398c60-fe63-5a45-a148-79cf4bf62bcf with identifier: MA16%20ETX
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d6398c60-fe63-5a45-a148-79cf4bf62bcf
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: MP65%20LKN
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP65%2520LKN%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for MP65%20LKN: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6062366a-77b0-5b3c-aa23-49414d769971 with identifier: MP65%20LKN
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6062366a-77b0-5b3c-aa23-49414d769971
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: PX16%20TWC
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX16%2520TWC%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for PX16%20TWC: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac1f6057-b0f6-50a4-86b8-79ddb8bcda18 with identifier: PX16%20TWC
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ac1f6057-b0f6-50a4-86b8-79ddb8bcda18
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: YO18%20AYK
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YO18%2520AYK%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for YO18%20AYK: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7392bcd-4395-5c1c-82dd-efb0c72988e0 with identifier: YO18%20AYK
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a7392bcd-4395-5c1c-82dd-efb0c72988e0
2026-03-29 22:00:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/P17LPT/42573216?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Cei94j6xTuVsYVAtMEIEaOIhWn8jpASCTY7XqjpVl64%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=P17%20LPT-GB>
2026-03-29 22:00:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE20EVL/42811999?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=QNaGwsE1HTKndyV7dS5jfLI1ozyFJBkYcrsiWmkuv8k%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RE20%20EVL-GB>
2026-03-29 22:00:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML23KNX/42812081?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Ysjf2AWU3A%2B%2BhkZ4EdoIgPpKhCyN1a54UPjPwLBr1pc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML23%20KNX-GB>
2026-03-29 22:00:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ72FOT/42812096?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=F1eqEFipUoySPGKOeLKkFyyLLItl9dJbMFy96XQcSRY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ72%20FOT-GB>
2026-03-29 22:00:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PA19DCO/42811984?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=5dad8F2568bHOl2s5RwggeSpVONMrl6yr8ByaoDJDOc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PA19%20DCO-GB>
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: ME19%20TFO
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ME19%2520TFO%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for ME19%20TFO: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53e8a45e-28a5-5ca8-b6f8-84adabb0f290 with identifier: ME19%20TFO
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 53e8a45e-28a5-5ca8-b6f8-84adabb0f290
2026-03-29 22:00:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG69FWY/42811982?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=iIU0ZFwxCrfo9iR2T7l%2BEKiHBXHpV%2FjhvFuNPQMcBwU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SG69%20FWY-GB>
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: PE64%20HPL
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE64%2520HPL%27 HTTP/1.1" 200 None
2026-03-29 22:00:56 [bca.uk] INFO: Scrape type for PE64%20HPL: 1
2026-03-29 22:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8381a489-d71d-5bac-8258-1ea17ff7795d with identifier: PE64%20HPL
2026-03-29 22:00:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8381a489-d71d-5bac-8258-1ea17ff7795d
2026-03-29 22:00:56 [bca.uk] INFO: Found listing with ID: PN54%20OAL
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN54%2520OAL%27 HTTP/1.1" 200 None
2026-03-29 22:00:57 [bca.uk] INFO: Scrape type for PN54%20OAL: 1
2026-03-29 22:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 640919bc-7e76-59be-ab2e-d1156d9a5725 with identifier: PN54%20OAL
2026-03-29 22:00:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 640919bc-7e76-59be-ab2e-d1156d9a5725
2026-03-29 22:00:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19VXX/42812304?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=YzGWBhkemG5tXMwAwvYpsWX0bEfwiTWFoG%2FIuzQzr2c%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM19%20VXX-GB>
2026-03-29 22:00:57 [bca.uk] INFO: Found listing with ID: PJ08%20SVR
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ08%2520SVR%27 HTTP/1.1" 200 None
2026-03-29 22:00:57 [bca.uk] INFO: Scrape type for PJ08%20SVR: 1
2026-03-29 22:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4de1def5-9fea-59aa-8472-dafc14cac3a1 with identifier: PJ08%20SVR
2026-03-29 22:00:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4de1def5-9fea-59aa-8472-dafc14cac3a1
2026-03-29 22:00:57 [bca.uk] INFO: Found listing with ID: NJ58%20SFX
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ58%2520SFX%27 HTTP/1.1" 200 None
2026-03-29 22:00:57 [bca.uk] INFO: Scrape type for NJ58%20SFX: 1
2026-03-29 22:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5063d79c-4147-5ce9-b414-8b0ccabfea0d with identifier: NJ58%20SFX
2026-03-29 22:00:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5063d79c-4147-5ce9-b414-8b0ccabfea0d
2026-03-29 22:00:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LA70NPE/42811995?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=1ymICcEKrtpKHFHLQTc1yKaMMeniIFUDVOMDF5neyAs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LA70%20NPE-GB>
2026-03-29 22:00:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE19AAK/42812078?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=MkdK1ykhsLQ%2B%2F2n1Irxn7evFumHYKKFZXmkQdpd8KgM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE19%20AAK-GB>
2026-03-29 22:00:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE18CHX/42812000?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=oyBRp8qHoowbCW9kieY0zUV46IZNjY3FwR8NKuxfaxo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YE18%20CHX-GB>
2026-03-29 22:00:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS68PYY/42812178?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=ilxdzGsr4IgRZDvqZmWhurm4pGkLnzxS3s4veY%2BdCjs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HS68%20PYY-GB>
2026-03-29 22:00:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19VSX/42812111?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=qlSeQUbf83xHqWfD9mYZ2SCAALVwdddlxYHgmUNU2tY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DC19%20VSX-GB>
2026-03-29 22:00:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70YYW/42571204?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=3YETERDVJsfcYf9zoGQQnS8MvGAFRjTT6qcrLaHjjZg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH70%20YYW-GB>
2026-03-29 22:00:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA16ETX/42812131?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=67cSoD7yDAcPlVUXb6MtFxB8b%2F%2B%2FHPzK%2FRcqJHz%2FIwo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA16%20ETX-GB>
2026-03-29 22:00:57 [bca.uk] INFO: Found listing with ID: MK58%20WVS
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK58%2520WVS%27 HTTP/1.1" 200 None
2026-03-29 22:00:57 [bca.uk] INFO: Scrape type for MK58%20WVS: 1
2026-03-29 22:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f445e0d5-837d-52c8-8f48-046533da8751 with identifier: MK58%20WVS
2026-03-29 22:00:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f445e0d5-837d-52c8-8f48-046533da8751
2026-03-29 22:00:57 [bca.uk] INFO: Found listing with ID: DE56%20AOD
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE56%2520AOD%27 HTTP/1.1" 200 None
2026-03-29 22:00:57 [bca.uk] INFO: Scrape type for DE56%20AOD: 1
2026-03-29 22:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5674dd98-879a-5bc0-92a6-049abdc5f932 with identifier: DE56%20AOD
2026-03-29 22:00:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5674dd98-879a-5bc0-92a6-049abdc5f932
2026-03-29 22:00:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP65LKN/42812099?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=YYiddic%2BqcqY2M0XPOfW0%2FrAPtac9opCHs6%2B5ikpuFw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MP65%20LKN-GB>
2026-03-29 22:00:57 [bca.uk] INFO: Found listing with ID: LM09%20CVU
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM09%2520CVU%27 HTTP/1.1" 200 None
2026-03-29 22:00:57 [bca.uk] INFO: Scrape type for LM09%20CVU: 1
2026-03-29 22:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad76e9a4-0e7d-56af-9a84-3fd65281fde6 with identifier: LM09%20CVU
2026-03-29 22:00:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ad76e9a4-0e7d-56af-9a84-3fd65281fde6
2026-03-29 22:00:57 [bca.uk] INFO: Found listing with ID: OE10%20FEO
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE10%2520FEO%27 HTTP/1.1" 200 None
2026-03-29 22:00:57 [bca.uk] INFO: Scrape type for OE10%20FEO: 2
2026-03-29 22:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66a2a13d-8eb1-5294-8f43-be215101e894 with identifier: OE10%20FEO
2026-03-29 22:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66a2a13d-8eb1-5294-8f43-be215101e894 with scrape type 2
2026-03-29 22:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66a2a13d-8eb1-5294-8f43-be215101e894 with scrape type 2
2026-03-29 22:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 66a2a13d-8eb1-5294-8f43-be215101e894, identifier: OE10%20FEO
2026-03-29 22:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 66a2a13d-8eb1-5294-8f43-be215101e894 with identifier: OE10%20FEO
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 22:00:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2026-03-29 22:00:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 66a2a13d-8eb1-5294-8f43-be215101e894 with identifier: OE10%20FEO
2026-03-29 22:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 66a2a13d-8eb1-5294-8f43-be215101e894 with identifier: OE10%20FEO to the API
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OE10%20FEO-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': '66a2a13d-8eb1-5294-8f43-be215101e894',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OE10 FEO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OE10%20FEO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HYUNDAI',
'model': 'I10',
'odometer': 104391,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'HYUNDAI I10 1.2 STYLE Hatchback',
'transmission': 'manual',
'trim': 'STYLE',
'vin': 'MALAN51CLAM612199',
'year': 2010}
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE10%2520FEO%27 HTTP/1.1" 200 None
2026-03-29 22:00:58 [bca.uk] INFO: Saving data for OE10%20FEO: {'auction_closing_time': 1775210400.0, 'created_time': 1774447818.383497, 'last_price_update_time': 1774821658.129472}
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OE10%2520FEO') HTTP/1.1" 204 0
2026-03-29 22:00:58 [bca.uk] INFO: Found listing with ID: WP66%20PGE
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP66%2520PGE%27 HTTP/1.1" 200 None
2026-03-29 22:00:58 [bca.uk] INFO: Scrape type for WP66%20PGE: 1
2026-03-29 22:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49025c6e-c82c-5ad9-a984-dc586f875105 with identifier: WP66%20PGE
2026-03-29 22:00:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 49025c6e-c82c-5ad9-a984-dc586f875105
2026-03-29 22:00:58 [bca.uk] INFO: Found listing with ID: WR60%20HNV
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR60%2520HNV%27 HTTP/1.1" 200 None
2026-03-29 22:00:58 [bca.uk] INFO: Scrape type for WR60%20HNV: 1
2026-03-29 22:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a63c92f-88a3-5364-8028-ccaa89112c46 with identifier: WR60%20HNV
2026-03-29 22:00:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1a63c92f-88a3-5364-8028-ccaa89112c46
2026-03-29 22:00:58 [bca.uk] INFO: Found listing with ID: AP12%20HDL
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP12%2520HDL%27 HTTP/1.1" 200 None
2026-03-29 22:00:58 [bca.uk] INFO: Scrape type for AP12%20HDL: 1
2026-03-29 22:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21e79e5d-2d1b-56fe-b8fb-2067f25370f7 with identifier: AP12%20HDL
2026-03-29 22:00:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 21e79e5d-2d1b-56fe-b8fb-2067f25370f7
2026-03-29 22:00:58 [bca.uk] INFO: Found listing with ID: LV08%20TVU
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV08%2520TVU%27 HTTP/1.1" 200 None
2026-03-29 22:00:58 [bca.uk] INFO: Scrape type for LV08%20TVU: 1
2026-03-29 22:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82 with identifier: LV08%20TVU
2026-03-29 22:00:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82
2026-03-29 22:00:58 [bca.uk] INFO: Found listing with ID: SV14%20TTZ
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV14%2520TTZ%27 HTTP/1.1" 200 None
2026-03-29 22:00:58 [bca.uk] INFO: Scrape type for SV14%20TTZ: 1
2026-03-29 22:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3909531a-470f-5688-8297-acd46a9f879d with identifier: SV14%20TTZ
2026-03-29 22:00:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3909531a-470f-5688-8297-acd46a9f879d
2026-03-29 22:00:58 [bca.uk] INFO: Found listing with ID: CP15%20SYH
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP15%2520SYH%27 HTTP/1.1" 200 None
2026-03-29 22:00:58 [bca.uk] INFO: Scrape type for CP15%20SYH: 1
2026-03-29 22:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7722f27f-140c-5241-909a-6e6aa692732b with identifier: CP15%20SYH
2026-03-29 22:00:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7722f27f-140c-5241-909a-6e6aa692732b
2026-03-29 22:00:58 [bca.uk] INFO: Found listing with ID: FV59%20NFX
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV59%2520NFX%27 HTTP/1.1" 200 None
2026-03-29 22:00:58 [bca.uk] INFO: Scrape type for FV59%20NFX: 1
2026-03-29 22:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75379e98-ec74-5bb8-a2ba-dee078101af0 with identifier: FV59%20NFX
2026-03-29 22:00:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 75379e98-ec74-5bb8-a2ba-dee078101af0
2026-03-29 22:00:58 [bca.uk] INFO: Found listing with ID: VK10%20OJY
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK10%2520OJY%27 HTTP/1.1" 200 None
2026-03-29 22:00:58 [bca.uk] INFO: Scrape type for VK10%20OJY: 2
2026-03-29 22:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e198d40-2ab9-5647-9a24-3c0294d7c73d with identifier: VK10%20OJY
2026-03-29 22:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e198d40-2ab9-5647-9a24-3c0294d7c73d with scrape type 2
2026-03-29 22:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e198d40-2ab9-5647-9a24-3c0294d7c73d with scrape type 2
2026-03-29 22:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0e198d40-2ab9-5647-9a24-3c0294d7c73d, identifier: VK10%20OJY
2026-03-29 22:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0e198d40-2ab9-5647-9a24-3c0294d7c73d with identifier: VK10%20OJY
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=grey HTTP/1.1" 200 None
2026-03-29 22:00:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2026-03-29 22:00:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0e198d40-2ab9-5647-9a24-3c0294d7c73d with identifier: VK10%20OJY
2026-03-29 22:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0e198d40-2ab9-5647-9a24-3c0294d7c73d with identifier: VK10%20OJY to the API
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 219,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK10%20OJY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0e198d40-2ab9-5647-9a24-3c0294d7c73d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK10 OJY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK10%20OJY&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'VOLVO',
'model': 'XC90',
'odometer': 152524,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VOLVO XC90 2.4 D5 185 SE Estate',
'transmission': 'manual',
'trim': 'D5 185 SE',
'vin': 'YV1CZ7144A1559442',
'year': 2010}
2026-03-29 22:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK10%2520OJY%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [bca.uk] INFO: Saving data for VK10%20OJY: {'auction_closing_time': 1775210400.0, 'created_time': 1774536302.728066, 'last_price_update_time': 1774821659.01011}
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK10%2520OJY') HTTP/1.1" 204 0
2026-03-29 22:00:59 [bca.uk] INFO: Found listing with ID: BP65%20JXL
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP65%2520JXL%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [bca.uk] INFO: Scrape type for BP65%20JXL: 1
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4 with identifier: BP65%20JXL
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4
2026-03-29 22:00:59 [bca.uk] INFO: Found listing with ID: LO08%20HUA
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO08%2520HUA%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [bca.uk] INFO: Scrape type for LO08%20HUA: 1
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9816a6af-47f8-5106-89d9-6d77d25fd0f4 with identifier: LO08%20HUA
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9816a6af-47f8-5106-89d9-6d77d25fd0f4
2026-03-29 22:00:59 [bca.uk] INFO: Found listing with ID: SL11%20KPY
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL11%2520KPY%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [bca.uk] INFO: Scrape type for SL11%20KPY: 1
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c with identifier: SL11%20KPY
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c
2026-03-29 22:00:59 [bca.uk] INFO: Found listing with ID: AK55%20EXG
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK55%2520EXG%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [bca.uk] INFO: Scrape type for AK55%20EXG: 1
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0991f76e-fa68-5257-8869-29bbc185bed6 with identifier: AK55%20EXG
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0991f76e-fa68-5257-8869-29bbc185bed6
2026-03-29 22:00:59 [bca.uk] INFO: Found listing with ID: KD15%20FPU
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KD15%2520FPU%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [bca.uk] INFO: Scrape type for KD15%20FPU: 1
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78 with identifier: KD15%20FPU
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78
2026-03-29 22:00:59 [bca.uk] INFO: Found listing with ID: MC14%20KAE
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC14%2520KAE%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [bca.uk] INFO: Scrape type for MC14%20KAE: 1
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97c5232d-22c9-5728-b6fd-84d8da4f8949 with identifier: MC14%20KAE
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 97c5232d-22c9-5728-b6fd-84d8da4f8949
2026-03-29 22:00:59 [bca.uk] INFO: Found listing with ID: MK58%20XVG
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK58%2520XVG%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [bca.uk] INFO: Scrape type for MK58%20XVG: 1
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdbe3643-d056-5481-b487-6a8e20861864 with identifier: MK58%20XVG
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cdbe3643-d056-5481-b487-6a8e20861864
2026-03-29 22:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PA19DCO/42811984?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=5dad8F2568bHOl2s5RwggeSpVONMrl6yr8ByaoDJDOc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG69FWY/42811982?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=iIU0ZFwxCrfo9iR2T7l%2BEKiHBXHpV%2FjhvFuNPQMcBwU%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ72FOT/42812096?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=F1eqEFipUoySPGKOeLKkFyyLLItl9dJbMFy96XQcSRY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:00:59 [bca.uk] INFO: Found listing with ID: MT12%20WNS
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT12%2520WNS%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [bca.uk] INFO: Scrape type for MT12%20WNS: 1
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e630b36-cd01-5007-b4b4-e80c316bb326 with identifier: MT12%20WNS
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4e630b36-cd01-5007-b4b4-e80c316bb326
2026-03-29 22:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML23KNX/42812081?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Ysjf2AWU3A%2B%2BhkZ4EdoIgPpKhCyN1a54UPjPwLBr1pc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19VXX/42812304?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=YzGWBhkemG5tXMwAwvYpsWX0bEfwiTWFoG%2FIuzQzr2c%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE20EVL/42811999?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=QNaGwsE1HTKndyV7dS5jfLI1ozyFJBkYcrsiWmkuv8k%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:00:59 [bca.uk] INFO: Found listing with ID: MV68%20URC
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV68%2520URC%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [bca.uk] INFO: Scrape type for MV68%20URC: 1
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c423af70-863f-544f-981f-966354022060 with identifier: MV68%20URC
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c423af70-863f-544f-981f-966354022060
2026-03-29 22:00:59 [bca.uk] INFO: Found listing with ID: PF17%20VPN
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF17%2520VPN%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [bca.uk] INFO: Scrape type for PF17%20VPN: 1
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5439021f-449a-5c9e-a193-64352e476208 with identifier: PF17%20VPN
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5439021f-449a-5c9e-a193-64352e476208
2026-03-29 22:00:59 [bca.uk] INFO: Found listing with ID: ST62%20SYF
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST62%2520SYF%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [bca.uk] INFO: Scrape type for ST62%20SYF: 1
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b294b559-83e7-5079-b89e-3524dea19cc0 with identifier: ST62%20SYF
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b294b559-83e7-5079-b89e-3524dea19cc0
2026-03-29 22:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/P17LPT/42573216?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Cei94j6xTuVsYVAtMEIEaOIhWn8jpASCTY7XqjpVl64%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA16ETX/42812131?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=67cSoD7yDAcPlVUXb6MtFxB8b%2F%2B%2FHPzK%2FRcqJHz%2FIwo%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:00:59 [bca.uk] INFO: Found listing with ID: VO58%20EBF
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO58%2520EBF%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [bca.uk] INFO: Scrape type for VO58%20EBF: 1
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 779863fc-56f0-5718-9334-675ca35049bb with identifier: VO58%20EBF
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 779863fc-56f0-5718-9334-675ca35049bb
2026-03-29 22:00:59 [bca.uk] INFO: Found listing with ID: YH67%20HFC
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH67%2520HFC%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [bca.uk] INFO: Scrape type for YH67%20HFC: 1
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6836e689-948e-59c9-ae88-0dac50e055fe with identifier: YH67%20HFC
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6836e689-948e-59c9-ae88-0dac50e055fe
2026-03-29 22:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19VSX/42812111?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=qlSeQUbf83xHqWfD9mYZ2SCAALVwdddlxYHgmUNU2tY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6211e8d0>
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_expert_report_file_283e2938-709c-45ae-b0a6-b224b8c23099.pdf HTTP/1.1" 201 0
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item da397772-3003-5876-84de-18e19f2e1e0e
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da397772-3003-5876-84de-18e19f2e1e0e, skipping ID generation
2026-03-29 22:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da397772-3003-5876-84de-18e19f2e1e0e
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPA19DCO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PA19DCO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62135690>
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_expert_report_file_b9b6678b-accd-4588-8b5f-1cb4b8884b54.pdf HTTP/1.1" 201 0
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 23673480-b7c5-5707-903a-2783d4797f75
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23673480-b7c5-5707-903a-2783d4797f75, skipping ID generation
2026-03-29 22:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23673480-b7c5-5707-903a-2783d4797f75
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSG69FWY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SG69FWY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:00:59 [bca.uk] INFO: Total items found: 100
2026-03-29 22:00:59 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded
2026-03-29 22:00:59 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:00:59 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6213bd50>
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_expert_report_file_96c95768-3369-41a9-92ed-3228db37f55c.pdf HTTP/1.1" 201 0
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a, skipping ID generation
2026-03-29 22:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPJ72FOT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PJ72FOT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE19AAK/42812078?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=MkdK1ykhsLQ%2B%2F2n1Irxn7evFumHYKKFZXmkQdpd8KgM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE18CHX/42812000?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=oyBRp8qHoowbCW9kieY0zUV46IZNjY3FwR8NKuxfaxo%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:00:59 [bca.uk] INFO: Found listing with ID: YT66%20YMF
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT66%2520YMF%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [bca.uk] INFO: Scrape type for YT66%20YMF: 1
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5cb9c1b-2fac-5aa0-89c7-e23c2249811e with identifier: YT66%20YMF
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a5cb9c1b-2fac-5aa0-89c7-e23c2249811e
2026-03-29 22:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS68PYY/42812178?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=ilxdzGsr4IgRZDvqZmWhurm4pGkLnzxS3s4veY%2BdCjs%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:00:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MC14KAE/42809755?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=DG6b3zLT1DRX51p27qxjR95H%2BdTJAJxRv%2B3BMmM%2BaS4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MC14%20KAE-GB>
2026-03-29 22:00:59 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:00:59 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409130%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409130 not downloaded yet
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406232%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406232 not downloaded yet
2026-03-29 22:00:59 [bca.uk] INFO: Found listing with ID: LT14%20HGA
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT14%2520HGA%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [bca.uk] INFO: Scrape type for LT14%20HGA: 1
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2 with identifier: LT14%20HGA
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414850%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414850 not downloaded yet
2026-03-29 22:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618ad990>
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_expert_report_file_269f69bf-3cf6-458d-aa49-322b7f69869d.pdf HTTP/1.1" 201 0
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c96e7ad0-7cd4-5ea7-b41d-642972a2bf14
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c96e7ad0-7cd4-5ea7-b41d-642972a2bf14, skipping ID generation
2026-03-29 22:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c96e7ad0-7cd4-5ea7-b41d-642972a2bf14
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DML23KNX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ML23KNX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6198cbd0>
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_expert_report_file_bcb86ac9-86d8-40f1-9d91-14d0a0b350de.pdf HTTP/1.1" 201 0
2026-03-29 22:00:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 553a9526-308c-5e9f-97f5-1bce769f99d7
2026-03-29 22:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 553a9526-308c-5e9f-97f5-1bce769f99d7, skipping ID generation
2026-03-29 22:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 553a9526-308c-5e9f-97f5-1bce769f99d7
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYM19VXX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YM19VXX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6198fe50>
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_expert_report_file_02b98ad6-d8ae-4021-b0bd-c690373febcb.pdf HTTP/1.1" 201 0
2026-03-29 22:01:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b145ed4d-e096-5329-b7ec-7396067fba60
2026-03-29 22:01:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b145ed4d-e096-5329-b7ec-7396067fba60, skipping ID generation
2026-03-29 22:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b145ed4d-e096-5329-b7ec-7396067fba60
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRE20EVL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RE20EVL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LA70NPE/42811995?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=1ymICcEKrtpKHFHLQTc1yKaMMeniIFUDVOMDF5neyAs%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:00 [bca.uk] INFO: Found listing with ID: LN62%20HLC
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN62%2520HLC%27 HTTP/1.1" 200 None
2026-03-29 22:01:00 [bca.uk] INFO: Scrape type for LN62%20HLC: 1
2026-03-29 22:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38dd9604-9daa-5b5e-902e-c598576d19d6 with identifier: LN62%20HLC
2026-03-29 22:01:00 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 38dd9604-9daa-5b5e-902e-c598576d19d6
2026-03-29 22:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70YYW/42571204?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=3YETERDVJsfcYf9zoGQQnS8MvGAFRjTT6qcrLaHjjZg%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KD15FPU/42809529?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=fvJF7ucpRX0E%2BAJp%2BX9CWPAyJRKbO%2FRJwWNOYDHIzAs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KD15%20FPU-GB>
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409147%27 HTTP/1.1" 200 None
2026-03-29 22:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409147 not downloaded yet
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406251%27 HTTP/1.1" 200 None
2026-03-29 22:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406251 not downloaded yet
2026-03-29 22:01:00 [bca.uk] INFO: Found listing with ID: CK20%20XRD
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK20%2520XRD%27 HTTP/1.1" 200 None
2026-03-29 22:01:00 [bca.uk] INFO: Scrape type for CK20%20XRD: 0
2026-03-29 22:01:00 [bca.uk] INFO: Found listing with ID: YB70%20ZRK
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB70%2520ZRK%27 HTTP/1.1" 200 None
2026-03-29 22:01:00 [bca.uk] INFO: Scrape type for YB70%20ZRK: 0
2026-03-29 22:01:00 [bca.uk] INFO: Found listing with ID: YS68%20HTY
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS68%2520HTY%27 HTTP/1.1" 200 None
2026-03-29 22:01:00 [bca.uk] INFO: Scrape type for YS68%20HTY: 2
2026-03-29 22:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bf53ab6-3095-5e72-b942-434680965d4a with identifier: YS68%20HTY
2026-03-29 22:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bf53ab6-3095-5e72-b942-434680965d4a with scrape type 2
2026-03-29 22:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bf53ab6-3095-5e72-b942-434680965d4a with scrape type 2
2026-03-29 22:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0bf53ab6-3095-5e72-b942-434680965d4a, identifier: YS68%20HTY
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414854%27 HTTP/1.1" 200 None
2026-03-29 22:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414854 not downloaded yet
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411734%27 HTTP/1.1" 200 None
2026-03-29 22:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411734 not downloaded yet
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427759%27 HTTP/1.1" 200 None
2026-03-29 22:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427759 not downloaded yet
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427724%27 HTTP/1.1" 200 None
2026-03-29 22:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427724 not downloaded yet
2026-03-29 22:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a9f250>
2026-03-29 22:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_expert_report_file_8852f554-97c9-481c-bf79-f9587ebdfb9a.pdf HTTP/1.1" 201 0
2026-03-29 22:01:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9
2026-03-29 22:01:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9, skipping ID generation
2026-03-29 22:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DP17LPT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=P17LPT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618b51d0>
2026-03-29 22:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_expert_report_file_1176e29c-014c-447e-a85a-86de31f466f6.pdf HTTP/1.1" 201 0
2026-03-29 22:01:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d6398c60-fe63-5a45-a148-79cf4bf62bcf
2026-03-29 22:01:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6398c60-fe63-5a45-a148-79cf4bf62bcf, skipping ID generation
2026-03-29 22:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6398c60-fe63-5a45-a148-79cf4bf62bcf
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMA16ETX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MA16ETX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63338a50>
2026-03-29 22:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_expert_report_file_be24767a-1357-4e70-8480-91ed11832b34.pdf HTTP/1.1" 201 0
2026-03-29 22:01:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 732664ff-2041-53f2-83f7-e4a6aeaa1df2
2026-03-29 22:01:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 732664ff-2041-53f2-83f7-e4a6aeaa1df2, skipping ID generation
2026-03-29 22:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 732664ff-2041-53f2-83f7-e4a6aeaa1df2
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDC19VSX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DC19VSX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP65LKN/42812099?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=YYiddic%2BqcqY2M0XPOfW0%2FrAPtac9opCHs6%2B5ikpuFw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:00 [bca.uk] INFO: Found listing with ID: NJ62%20YDS
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ62%2520YDS%27 HTTP/1.1" 200 None
2026-03-29 22:01:00 [bca.uk] INFO: Scrape type for NJ62%20YDS: 1
2026-03-29 22:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e23ce11-f3f0-5635-b5b9-03f2e6272954 with identifier: NJ62%20YDS
2026-03-29 22:01:00 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9e23ce11-f3f0-5635-b5b9-03f2e6272954
2026-03-29 22:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0bf53ab6-3095-5e72-b942-434680965d4a with identifier: YS68%20HTY
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FElectric HTTP/1.1" 200 None
2026-03-29 22:01:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0bf53ab6-3095-5e72-b942-434680965d4a with identifier: YS68%20HTY
2026-03-29 22:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0bf53ab6-3095-5e72-b942-434680965d4a with identifier: YS68%20HTY to the API
2026-03-29 22:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 28,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YS68%20HTY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '0bf53ab6-3095-5e72-b942-434680965d4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YS68 HTY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YS68%20HTY&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'TOYOTA',
'model': 'PRIUS PLUG-IN',
'odometer': 65843,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'TOYOTA PRIUS PLUG-IN 1.8 VVTI BUSINESS ED.PLUS Hatchback',
'transmission': 'automatic',
'trim': 'VVTI BUSINESS ED.PLUS',
'vin': 'JTDKA3FPX03099887',
'year': 2019}
2026-03-29 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS68%2520HTY%27 HTTP/1.1" 200 None
2026-03-29 22:01:01 [bca.uk] INFO: Saving data for YS68%20HTY: {'auction_closing_time': 1775037600.0, 'created_time': 1773823982.050537, 'last_price_update_time': 1774821661.749626}
2026-03-29 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YS68%2520HTY') HTTP/1.1" 204 0
2026-03-29 22:01:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58XVG/42790595?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=vcjXHy%2BXcxnL8fVcBSIy1zRUfNwdkYA77TQSDd3JyNw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MK58%20XVG-GB>
2026-03-29 22:01:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK55EXG/42758130?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=zNKuCsXwY5YBweBL8fGiYSmIg6c7hmRzF6E4Qyh0WVI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK55%20EXG-GB>
2026-03-29 22:01:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO08HUA/42769935?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=UrTho4OU5emtGOfXKZ0dWvPhmltT%2BxjdBAxxllTvFdc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO08%20HUA-GB>
2026-03-29 22:01:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL11KPY/42783241?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=Q5R98DxLk%2FIyOrHb6oSyVq%2Bq9sVfHG45AhfvPKzaek4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL11%20KPY-GB>
2026-03-29 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409166%27 HTTP/1.1" 200 None
2026-03-29 22:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409166 not downloaded yet
2026-03-29 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406275%27 HTTP/1.1" 200 None
2026-03-29 22:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406275 not downloaded yet
2026-03-29 22:01:01 [bca.uk] INFO: Found listing with ID: FM19%20VZC
2026-03-29 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM19%2520VZC%27 HTTP/1.1" 200 None
2026-03-29 22:01:01 [bca.uk] INFO: Scrape type for FM19%20VZC: 2
2026-03-29 22:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17043df0-9f44-5562-9461-fad9c12dc43e with identifier: FM19%20VZC
2026-03-29 22:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17043df0-9f44-5562-9461-fad9c12dc43e with scrape type 2
2026-03-29 22:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17043df0-9f44-5562-9461-fad9c12dc43e with scrape type 2
2026-03-29 22:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 17043df0-9f44-5562-9461-fad9c12dc43e, identifier: FM19%20VZC
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414858%27 HTTP/1.1" 200 None
2026-03-29 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414858 not downloaded yet
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411747%27 HTTP/1.1" 200 None
2026-03-29 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411747 not downloaded yet
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427780%27 HTTP/1.1" 200 None
2026-03-29 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427780 not downloaded yet
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427739%27 HTTP/1.1" 200 None
2026-03-29 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427739 not downloaded yet
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D686575330%27 HTTP/1.1" 200 None
2026-03-29 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575330 not downloaded yet
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430117%27 HTTP/1.1" 200 None
2026-03-29 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430117 not downloaded yet
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430166%27 HTTP/1.1" 200 None
2026-03-29 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430166 not downloaded yet
2026-03-29 22:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6187b3d0>
2026-03-29 22:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_expert_report_file_a4ceb7d9-6172-4bed-b67a-cd0e0a1ead5d.pdf HTTP/1.1" 201 0
2026-03-29 22:01:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ff522792-d041-5ecb-b231-8bf72c190c1e
2026-03-29 22:01:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff522792-d041-5ecb-b231-8bf72c190c1e, skipping ID generation
2026-03-29 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff522792-d041-5ecb-b231-8bf72c190c1e
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDE19AAK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DE19AAK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6176f590>
2026-03-29 22:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_expert_report_file_7ab81432-6abc-4856-a0ca-6bcca9f8c629.pdf HTTP/1.1" 201 0
2026-03-29 22:01:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad
2026-03-29 22:01:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad, skipping ID generation
2026-03-29 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYE18CHX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YE18CHX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61753550>
2026-03-29 22:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_expert_report_file_d526eea7-163c-4146-9527-257bf8b6476a.pdf HTTP/1.1" 201 0
2026-03-29 22:01:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73
2026-03-29 22:01:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73, skipping ID generation
2026-03-29 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHS68PYY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HS68PYY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF17VPN/42811060?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=YkLrcIHkwtrZsjUa2prubREuXQStMy8DMOWlaZjCM6o%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PF17%20VPN-GB>
2026-03-29 22:01:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12WNS/42810774?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=tTo%2B0xotySQc25NFgljm0ZLwDTnsvqG5v%2FSimEvL7PM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT12%20WNS-GB>
2026-03-29 22:01:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST62SYF/42809590?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=r1Z4o1RO41%2Frbsi6j2NujNSq2CIa1MRr3E0xDNV9JdE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ST62%20SYF-GB>
2026-03-29 22:01:02 [bca.uk] INFO: Found listing with ID: AE14%20PLV
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE14%2520PLV%27 HTTP/1.1" 200 None
2026-03-29 22:01:02 [bca.uk] INFO: Scrape type for AE14%20PLV: 1
2026-03-29 22:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1944c0b-6133-542d-8b41-67a9ddd47893 with identifier: AE14%20PLV
2026-03-29 22:01:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a1944c0b-6133-542d-8b41-67a9ddd47893
2026-03-29 22:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 17043df0-9f44-5562-9461-fad9c12dc43e with identifier: FM19%20VZC
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 22:01:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 17043df0-9f44-5562-9461-fad9c12dc43e with identifier: FM19%20VZC
2026-03-29 22:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 17043df0-9f44-5562-9461-fad9c12dc43e with identifier: FM19%20VZC to the API
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FM19%20VZC-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '17043df0-9f44-5562-9461-fad9c12dc43e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FM19 VZC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FM19%20VZC&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'VAUXHALL',
'model': 'COMBO CARGO L1',
'odometer': 99783,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL COMBO CARGO L1 1.6 TURBO D 75 2000 EDITION Van',
'transmission': 'manual',
'trim': 'TURBO D 75 2000 EDITION',
'vin': 'W0VEFBHWBKJ694954',
'year': 2019}
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM19%2520VZC%27 HTTP/1.1" 200 None
2026-03-29 22:01:02 [bca.uk] INFO: Saving data for FM19%20VZC: {'auction_closing_time': 1775037600.0, 'created_time': 1774524444.745031, 'last_price_update_time': 1774821662.887685}
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FM19%2520VZC') HTTP/1.1" 204 0
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409181%27 HTTP/1.1" 200 None
2026-03-29 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409181 not downloaded yet
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406290%27 HTTP/1.1" 200 None
2026-03-29 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406290 not downloaded yet
2026-03-29 22:01:02 [bca.uk] INFO: Found listing with ID: CT16%20ETR
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT16%2520ETR%27 HTTP/1.1" 200 None
2026-03-29 22:01:02 [bca.uk] INFO: Scrape type for CT16%20ETR: 2
2026-03-29 22:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b75d400d-adef-564b-9215-4ba638196927 with identifier: CT16%20ETR
2026-03-29 22:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75d400d-adef-564b-9215-4ba638196927 with scrape type 2
2026-03-29 22:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b75d400d-adef-564b-9215-4ba638196927 with scrape type 2
2026-03-29 22:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b75d400d-adef-564b-9215-4ba638196927, identifier: CT16%20ETR
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414866%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414866 not downloaded yet
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411759%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411759 not downloaded yet
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427830%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427830 not downloaded yet
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427752%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427752 not downloaded yet
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D686575336%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575336 not downloaded yet
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430132%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430132 not downloaded yet
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430191%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430191 not downloaded yet
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411499%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411499 not downloaded yet
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409168%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409168 not downloaded yet
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435116%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435116 not downloaded yet
2026-03-29 22:01:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO58EBF/42810110?sv=2020-08-04&st=2026-03-29T22%3A01%3A02Z&se=2026-03-29T22%3A26%3A02Z&sr=b&sp=r&sig=l1yGxyGiXjxmhLTIgBa00vRGvOItb%2B7FOLk9BOk0TjI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO58%20EBF-GB>
2026-03-29 22:01:03 [bca.uk] INFO: Found listing with ID: SW14%20DSO
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW14%2520DSO%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [bca.uk] INFO: Scrape type for SW14%20DSO: 1
2026-03-29 22:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca52f08c-d65c-5ece-bef3-1f4a7047ab80 with identifier: SW14%20DSO
2026-03-29 22:01:03 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ca52f08c-d65c-5ece-bef3-1f4a7047ab80
2026-03-29 22:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b75d400d-adef-564b-9215-4ba638196927 with identifier: CT16%20ETR
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 22:01:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b75d400d-adef-564b-9215-4ba638196927 with identifier: CT16%20ETR
2026-03-29 22:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b75d400d-adef-564b-9215-4ba638196927 with identifier: CT16%20ETR to the API
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 220,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CT16%20ETR-GB',
'category': 'LightCommercialVehicle',
'color': 'red',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b75d400d-adef-564b-9215-4ba638196927',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CT16 ETR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CT16%20ETR&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'ISUZU',
'model': 'D-MAX',
'odometer': 114244,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'ISUZU D-MAX 2.5 TD UTAH 4X4 CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'TD UTAH 4X4',
'vin': 'MPATFS86JFT027139',
'year': 2016}
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT16%2520ETR%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [bca.uk] INFO: Saving data for CT16%20ETR: {'auction_closing_time': 1774951200.0, 'created_time': 1774524467.386089, 'last_price_update_time': 1774821663.755047}
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CT16%2520ETR') HTTP/1.1" 204 0
2026-03-29 22:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61747690>
2026-03-29 22:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_expert_report_file_c240516f-c174-45de-99fc-6961dbacba76.pdf HTTP/1.1" 201 0
2026-03-29 22:01:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b4838ed0-a1bc-555f-ae17-73d79e29d1ac
2026-03-29 22:01:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4838ed0-a1bc-555f-ae17-73d79e29d1ac, skipping ID generation
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b4838ed0-a1bc-555f-ae17-73d79e29d1ac
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLA70NPE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LA70NPE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6164df10>
2026-03-29 22:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_expert_report_file_48cd3153-9e98-44f1-9703-1b33e7220ebd.pdf HTTP/1.1" 201 0
2026-03-29 22:01:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 01b57636-ffd9-585f-9b00-e6ae7dbcc329
2026-03-29 22:01:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01b57636-ffd9-585f-9b00-e6ae7dbcc329, skipping ID generation
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01b57636-ffd9-585f-9b00-e6ae7dbcc329
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYH70YYW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YH70YYW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61641190>
2026-03-29 22:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_expert_report_file_874d2876-8464-4d07-8173-7b18b02ee7a1.pdf HTTP/1.1" 201 0
2026-03-29 22:01:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6062366a-77b0-5b3c-aa23-49414d769971
2026-03-29 22:01:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6062366a-77b0-5b3c-aa23-49414d769971, skipping ID generation
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6062366a-77b0-5b3c-aa23-49414d769971
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMP65LKN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MP65LKN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409195%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409195 not downloaded yet
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406304%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406304 not downloaded yet
2026-03-29 22:01:03 [bca.uk] INFO: Found listing with ID: CV21%20YPU
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV21%2520YPU%27 HTTP/1.1" 200 None
2026-03-29 22:01:03 [bca.uk] INFO: Scrape type for CV21%20YPU: 2
2026-03-29 22:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db527559-dd2e-56fa-92aa-911428485960 with identifier: CV21%20YPU
2026-03-29 22:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db527559-dd2e-56fa-92aa-911428485960 with scrape type 2
2026-03-29 22:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db527559-dd2e-56fa-92aa-911428485960 with scrape type 2
2026-03-29 22:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: db527559-dd2e-56fa-92aa-911428485960, identifier: CV21%20YPU
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414881%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414881 not downloaded yet
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411767%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411767 not downloaded yet
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427841%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427841 not downloaded yet
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427767%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427767 not downloaded yet
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D686575349%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575349 not downloaded yet
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430144%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430144 not downloaded yet
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430204%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430204 not downloaded yet
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411520%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411520 not downloaded yet
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409184%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409184 not downloaded yet
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435123%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435123 not downloaded yet
2026-03-29 22:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MC14KAE/42809755?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=DG6b3zLT1DRX51p27qxjR95H%2BdTJAJxRv%2B3BMmM%2BaS4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:04 [bca.uk] INFO: Found listing with ID: SY15%20YVR
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY15%2520YVR%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [bca.uk] INFO: Scrape type for SY15%20YVR: 1
2026-03-29 22:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96224006-57cb-587c-9533-8a4dcc309913 with identifier: SY15%20YVR
2026-03-29 22:01:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 96224006-57cb-587c-9533-8a4dcc309913
2026-03-29 22:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: db527559-dd2e-56fa-92aa-911428485960 with identifier: CV21%20YPU
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 22:01:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: db527559-dd2e-56fa-92aa-911428485960 with identifier: CV21%20YPU
2026-03-29 22:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: db527559-dd2e-56fa-92aa-911428485960 with identifier: CV21%20YPU to the API
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 246,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CV21%20YPU-GB',
'category': 'LightCommercialVehicle',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'db527559-dd2e-56fa-92aa-911428485960',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CV21 YPU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CV21%20YPU&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'RANGER',
'odometer': 86755,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'FORD RANGER 2.0 EBL 213 WILDTRAK CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'EBL 213 WILDTRAK',
'vin': '6FPPXXMJ2PMU72156',
'year': 2021}
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV21%2520YPU%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [bca.uk] INFO: Saving data for CV21%20YPU: {'auction_closing_time': 1774951200.0, 'created_time': 1774524487.08403, 'last_price_update_time': 1774821664.842731}
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CV21%2520YPU') HTTP/1.1" 204 0
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406242%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406242 not downloaded yet
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699040098%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040098 not downloaded yet
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411735%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411735 not downloaded yet
2026-03-29 22:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KD15FPU/42809529?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=fvJF7ucpRX0E%2BAJp%2BX9CWPAyJRKbO%2FRJwWNOYDHIzAs%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409227%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409227 not downloaded yet
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406323%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406323 not downloaded yet
2026-03-29 22:01:04 [bca.uk] INFO: Found listing with ID: FH17%20FGP
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH17%2520FGP%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [bca.uk] INFO: Scrape type for FH17%20FGP: 0
2026-03-29 22:01:04 [bca.uk] INFO: Found listing with ID: RE62%20HYL
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE62%2520HYL%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [bca.uk] INFO: Scrape type for RE62%20HYL: 0
2026-03-29 22:01:04 [bca.uk] INFO: Found listing with ID: AK67%20JSZ
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK67%2520JSZ%27 HTTP/1.1" 200 None
2026-03-29 22:01:04 [bca.uk] INFO: Scrape type for AK67%20JSZ: 0
2026-03-29 22:01:04 [bca.uk] INFO: Found listing with ID: YK24%20OHR
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK24%2520OHR%27 HTTP/1.1" 200 None
2026-03-29 22:01:05 [bca.uk] INFO: Scrape type for YK24%20OHR: 2
2026-03-29 22:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0600b83c-1688-5955-8525-841af59d8030 with identifier: YK24%20OHR
2026-03-29 22:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0600b83c-1688-5955-8525-841af59d8030 with scrape type 2
2026-03-29 22:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0600b83c-1688-5955-8525-841af59d8030 with scrape type 2
2026-03-29 22:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0600b83c-1688-5955-8525-841af59d8030, identifier: YK24%20OHR
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414941%27 HTTP/1.1" 200 None
2026-03-29 22:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414941 not downloaded yet
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411777%27 HTTP/1.1" 200 None
2026-03-29 22:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411777 not downloaded yet
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427853%27 HTTP/1.1" 200 None
2026-03-29 22:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427853 not downloaded yet
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427776%27 HTTP/1.1" 200 None
2026-03-29 22:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427776 not downloaded yet
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D686575354%27 HTTP/1.1" 200 None
2026-03-29 22:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575354 not downloaded yet
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430155%27 HTTP/1.1" 200 None
2026-03-29 22:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430155 not downloaded yet
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430221%27 HTTP/1.1" 200 None
2026-03-29 22:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430221 not downloaded yet
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411531%27 HTTP/1.1" 200 None
2026-03-29 22:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411531 not downloaded yet
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409206%27 HTTP/1.1" 200 None
2026-03-29 22:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409206 not downloaded yet
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435131%27 HTTP/1.1" 200 None
2026-03-29 22:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435131 not downloaded yet
2026-03-29 22:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL11KPY/42783241?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=Q5R98DxLk%2FIyOrHb6oSyVq%2Bq9sVfHG45AhfvPKzaek4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:05 [bca.uk] INFO: Found listing with ID: FE16%20OPC
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE16%2520OPC%27 HTTP/1.1" 200 None
2026-03-29 22:01:05 [bca.uk] INFO: Scrape type for FE16%20OPC: 2
2026-03-29 22:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c55c11fc-bf14-52f7-ad58-3c64001b361d with identifier: FE16%20OPC
2026-03-29 22:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c55c11fc-bf14-52f7-ad58-3c64001b361d with scrape type 2
2026-03-29 22:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c55c11fc-bf14-52f7-ad58-3c64001b361d with scrape type 2
2026-03-29 22:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c55c11fc-bf14-52f7-ad58-3c64001b361d, identifier: FE16%20OPC
2026-03-29 22:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0600b83c-1688-5955-8525-841af59d8030 with identifier: YK24%20OHR
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2026-03-29 22:01:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0600b83c-1688-5955-8525-841af59d8030 with identifier: YK24%20OHR
2026-03-29 22:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0600b83c-1688-5955-8525-841af59d8030 with identifier: YK24%20OHR to the API
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK24%20OHR-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 6,
'engine': '0.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Electric',
'id': '0600b83c-1688-5955-8525-841af59d8030',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK24 OHR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK24%20OHR&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'RENAULT',
'model': 'KANGOO E-TECH',
'odometer': 4214,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'RENAULT KANGOO E-TECH 90KW 44KWH LL21 MAXI ADVANCE Van',
'transmission': 'automatic',
'trim': '90KW 44KWH LL21 MAXI ADVANCE',
'vin': 'VF1RFK00472222183',
'year': 2024}
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK24%2520OHR%27 HTTP/1.1" 200 None
2026-03-29 22:01:05 [bca.uk] INFO: Saving data for YK24%20OHR: {'auction_closing_time': 1775037600.0, 'created_time': 1774524487.667964, 'last_price_update_time': 1774821665.864489}
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK24%2520OHR') HTTP/1.1" 204 0
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406258%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406258 not downloaded yet
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699040111%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040111 not downloaded yet
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411748%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411748 not downloaded yet
2026-03-29 22:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c55c11fc-bf14-52f7-ad58-3c64001b361d with identifier: FE16%20OPC
2026-03-29 22:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c55c11fc-bf14-52f7-ad58-3c64001b361d with identifier: FE16%20OPC
2026-03-29 22:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c55c11fc-bf14-52f7-ad58-3c64001b361d with identifier: FE16%20OPC to the API
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE16%20OPC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c55c11fc-bf14-52f7-ad58-3c64001b361d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FE16 OPC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FE16%20OPC&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 88923,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD MONDEO 2.0 TDCI 150 TITANIUM P/S Estate',
'transmission': 'automatic',
'trim': 'TDCI 150 TITANIUM P/S',
'vin': 'WF0FXXWPCFGR67143',
'year': 2016}
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE16%2520OPC%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [bca.uk] INFO: Saving data for FE16%20OPC: {'auction_closing_time': 1775210400.0, 'created_time': 1774392157.309545, 'last_price_update_time': 1774821666.371692}
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FE16%2520OPC') HTTP/1.1" 204 0
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409249%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409249 not downloaded yet
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406346%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406346 not downloaded yet
2026-03-29 22:01:06 [bca.uk] INFO: Found listing with ID: VN14%20TPV
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN14%2520TPV%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [bca.uk] INFO: Scrape type for VN14%20TPV: 0
2026-03-29 22:01:06 [bca.uk] INFO: Found listing with ID: LB69%20GWN
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB69%2520GWN%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [bca.uk] INFO: Scrape type for LB69%20GWN: 2
2026-03-29 22:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6844228-024d-5d0e-85ca-2491e8f54a2b with identifier: LB69%20GWN
2026-03-29 22:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6844228-024d-5d0e-85ca-2491e8f54a2b with scrape type 2
2026-03-29 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6844228-024d-5d0e-85ca-2491e8f54a2b with scrape type 2
2026-03-29 22:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e6844228-024d-5d0e-85ca-2491e8f54a2b, identifier: LB69%20GWN
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414996%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414996 not downloaded yet
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411791%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411791 not downloaded yet
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427864%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427864 not downloaded yet
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427805%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427805 not downloaded yet
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D686575365%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575365 not downloaded yet
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430174%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430174 not downloaded yet
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430239%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430239 not downloaded yet
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411557%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411557 not downloaded yet
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409219%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409219 not downloaded yet
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435139%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435139 not downloaded yet
2026-03-29 22:01:06 [bca.uk] INFO: Found listing with ID: YE12%20RTO
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE12%2520RTO%27 HTTP/1.1" 200 None
2026-03-29 22:01:06 [bca.uk] INFO: Scrape type for YE12%20RTO: 1
2026-03-29 22:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 330dee78-6fed-57ea-9152-2e616c79bf32 with identifier: YE12%20RTO
2026-03-29 22:01:06 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 330dee78-6fed-57ea-9152-2e616c79bf32
2026-03-29 22:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e6844228-024d-5d0e-85ca-2491e8f54a2b with identifier: LB69%20GWN
2026-03-29 22:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e6844228-024d-5d0e-85ca-2491e8f54a2b with identifier: LB69%20GWN
2026-03-29 22:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e6844228-024d-5d0e-85ca-2491e8f54a2b with identifier: LB69%20GWN to the API
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LB69%20GWN-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 6,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e6844228-024d-5d0e-85ca-2491e8f54a2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LB69 GWN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LB69%20GWN&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'CITROEN',
'model': 'DISPATCH 1400',
'odometer': 132691,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'CITROEN DISPATCH 1400 2.0 BLUEHDI 120 M DRIVER PanelVan',
'transmission': 'manual',
'trim': 'BLUEHDI 120 M DRIVER',
'vin': 'VF7VFAHKKK7014888',
'year': 2019}
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB69%2520GWN%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [bca.uk] INFO: Saving data for LB69%20GWN: {'auction_closing_time': 1775037600.0, 'created_time': 1774523248.614725, 'last_price_update_time': 1774821667.110842}
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LB69%2520GWN') HTTP/1.1" 204 0
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406274%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406274 not downloaded yet
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699040129%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040129 not downloaded yet
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411760%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411760 not downloaded yet
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409268%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409268 not downloaded yet
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406369%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406369 not downloaded yet
2026-03-29 22:01:07 [bca.uk] INFO: Found listing with ID: LO64%20MHL
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO64%2520MHL%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [bca.uk] INFO: Scrape type for LO64%20MHL: 0
2026-03-29 22:01:07 [bca.uk] INFO: Found listing with ID: HY19%20EKZ
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY19%2520EKZ%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [bca.uk] INFO: Scrape type for HY19%20EKZ: 0
2026-03-29 22:01:07 [bca.uk] INFO: Found listing with ID: WJ68%20HJO
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ68%2520HJO%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [bca.uk] INFO: Scrape type for WJ68%20HJO: 0
2026-03-29 22:01:07 [bca.uk] INFO: Found listing with ID: YK68%20UPF
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK68%2520UPF%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [bca.uk] INFO: Scrape type for YK68%20UPF: 2
2026-03-29 22:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dff74f38-46c1-5bf1-86e9-d977399720b8 with identifier: YK68%20UPF
2026-03-29 22:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dff74f38-46c1-5bf1-86e9-d977399720b8 with scrape type 2
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dff74f38-46c1-5bf1-86e9-d977399720b8 with scrape type 2
2026-03-29 22:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dff74f38-46c1-5bf1-86e9-d977399720b8, identifier: YK68%20UPF
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699415028%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699415028 not downloaded yet
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411810%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411810 not downloaded yet
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427884%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427884 not downloaded yet
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427824%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427824 not downloaded yet
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D686575375%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575375 not downloaded yet
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430208%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430208 not downloaded yet
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430264%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430264 not downloaded yet
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411573%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411573 not downloaded yet
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409230%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409230 not downloaded yet
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435146%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435146 not downloaded yet
2026-03-29 22:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61653990>
2026-03-29 22:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_expert_report_file_51246dfb-8a48-4f36-86ee-27d54701a223.pdf HTTP/1.1" 201 0
2026-03-29 22:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 97c5232d-22c9-5728-b6fd-84d8da4f8949
2026-03-29 22:01:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97c5232d-22c9-5728-b6fd-84d8da4f8949, skipping ID generation
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97c5232d-22c9-5728-b6fd-84d8da4f8949
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMC14KAE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MC14KAE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61535190>
2026-03-29 22:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_expert_report_file_d65f98e9-a40d-49ec-86de-5fbb82779d92.pdf HTTP/1.1" 201 0
2026-03-29 22:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78
2026-03-29 22:01:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78, skipping ID generation
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKD15FPU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KD15FPU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61531350>
2026-03-29 22:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_expert_report_file_a4aee775-a19b-4a18-a2bb-66b37dfe6157.pdf HTTP/1.1" 201 0
2026-03-29 22:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c
2026-03-29 22:01:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c, skipping ID generation
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSL11KPY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SL11KPY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK55EXG/42758130?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=zNKuCsXwY5YBweBL8fGiYSmIg6c7hmRzF6E4Qyh0WVI%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414843/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PJ72FOT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:01:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406206/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SG69FWY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:01:07 [bca.uk] INFO: Found listing with ID: FHZ%201603
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FHZ%25201603%27 HTTP/1.1" 200 None
2026-03-29 22:01:07 [bca.uk] INFO: Scrape type for FHZ%201603: 1
2026-03-29 22:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a01409-506c-5e89-901d-52d468f35eff with identifier: FHZ%201603
2026-03-29 22:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 96a01409-506c-5e89-901d-52d468f35eff
2026-03-29 22:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dff74f38-46c1-5bf1-86e9-d977399720b8 with identifier: YK68%20UPF
2026-03-29 22:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dff74f38-46c1-5bf1-86e9-d977399720b8 with identifier: YK68%20UPF
2026-03-29 22:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dff74f38-46c1-5bf1-86e9-d977399720b8 with identifier: YK68%20UPF to the API
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 212,
'car_expert_report_source_url': None,
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'dff74f38-46c1-5bf1-86e9-d977399720b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK68 UPF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK68%20UPF&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VOLKSWAGEN',
'model': 'AMAROK A33',
'odometer': 98907,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN AMAROK A33 3.0 V6 TDI 204 BMT DARK LABEL 4M CrewCab '
'Pick-up',
'transmission': 'manual',
'trim': 'V6 TDI 204 BMT DARK LABEL 4M',
'vin': 'WV1ZZZ2HZJH031773',
'year': 2018}
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK68%2520UPF%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [bca.uk] INFO: Saving data for YK68%20UPF: {'auction_closing_time': 1774951200.0, 'created_time': 1774522980.170661, 'last_price_update_time': 1774821668.080502}
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK68%2520UPF') HTTP/1.1" 204 0
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406287%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406287 not downloaded yet
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699040160%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040160 not downloaded yet
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411770%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411770 not downloaded yet
2026-03-29 22:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO08HUA/42769935?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=UrTho4OU5emtGOfXKZ0dWvPhmltT%2BxjdBAxxllTvFdc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427749/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YM19VXX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:01:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427715/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RE20EVL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409286%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409286 not downloaded yet
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406392%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406392 not downloaded yet
2026-03-29 22:01:08 [bca.uk] INFO: Found listing with ID: WF71%20YSM
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF71%2520YSM%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [bca.uk] INFO: Scrape type for WF71%20YSM: 0
2026-03-29 22:01:08 [bca.uk] INFO: Found listing with ID: WF71%20YSN
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF71%2520YSN%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [bca.uk] INFO: Scrape type for WF71%20YSN: 0
2026-03-29 22:01:08 [bca.uk] INFO: Found listing with ID: WX71%20KJK
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX71%2520KJK%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [bca.uk] INFO: Scrape type for WX71%20KJK: 0
2026-03-29 22:01:08 [bca.uk] INFO: Found listing with ID: YP20%20UUE
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP20%2520UUE%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [bca.uk] INFO: Scrape type for YP20%20UUE: 2
2026-03-29 22:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c800bc03-6259-52fb-8d05-01982d5d5534 with identifier: YP20%20UUE
2026-03-29 22:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c800bc03-6259-52fb-8d05-01982d5d5534 with scrape type 2
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c800bc03-6259-52fb-8d05-01982d5d5534 with scrape type 2
2026-03-29 22:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c800bc03-6259-52fb-8d05-01982d5d5534, identifier: YP20%20UUE
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699415062%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699415062 not downloaded yet
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411824%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411824 not downloaded yet
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427899%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427899 not downloaded yet
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427838%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427838 not downloaded yet
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D686575390%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575390 not downloaded yet
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430241%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430241 not downloaded yet
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430292%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430292 not downloaded yet
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411597%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411597 not downloaded yet
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409251%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409251 not downloaded yet
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435156%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435156 not downloaded yet
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251954%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251954 not downloaded yet
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699239936%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699239936 not downloaded yet
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699212542%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212542 not downloaded yet
2026-03-29 22:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:01:08 [bca.uk] INFO: Found listing with ID: HV13%20MWG
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV13%2520MWG%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [bca.uk] INFO: Scrape type for HV13%20MWG: 1
2026-03-29 22:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9da815d0-0890-5d46-9004-81239b502fc3 with identifier: HV13%20MWG
2026-03-29 22:01:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9da815d0-0890-5d46-9004-81239b502fc3
2026-03-29 22:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c800bc03-6259-52fb-8d05-01982d5d5534 with identifier: YP20%20UUE
2026-03-29 22:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c800bc03-6259-52fb-8d05-01982d5d5534 with identifier: YP20%20UUE
2026-03-29 22:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c800bc03-6259-52fb-8d05-01982d5d5534 with identifier: YP20%20UUE to the API
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YP20%20UUE-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c800bc03-6259-52fb-8d05-01982d5d5534',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YP20 UUE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YP20%20UUE&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'TRANSIT CONNECT',
'odometer': 105527,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FORD TRANSIT CONNECT 1.5 EBL 120 200 L1 LTD.L/R Van',
'transmission': 'manual',
'trim': 'EBL 120 200 L1 LTD.L/R',
'vin': 'WF0RXXWPGRLA29731',
'year': 2020}
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP20%2520UUE%27 HTTP/1.1" 200 None
2026-03-29 22:01:08 [bca.uk] INFO: Saving data for YP20%20UUE: {'auction_closing_time': 1775037600.0, 'created_time': 1773834721.210723, 'last_price_update_time': 1774821668.983791}
2026-03-29 22:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YP20%2520UUE') HTTP/1.1" 204 0
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406305%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406305 not downloaded yet
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699040182%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040182 not downloaded yet
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411781%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411781 not downloaded yet
2026-03-29 22:01:09 [bca.uk] INFO: Found listing with ID: BK70%20EDJ
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK70%2520EDJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [bca.uk] INFO: Scrape type for BK70%20EDJ: 0
2026-03-29 22:01:09 [bca.uk] INFO: Found listing with ID: LV20%20WVL
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV20%2520WVL%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [bca.uk] INFO: Scrape type for LV20%20WVL: 2
2026-03-29 22:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd07521a-fc50-5b1c-ba95-df8272ee920f with identifier: LV20%20WVL
2026-03-29 22:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd07521a-fc50-5b1c-ba95-df8272ee920f with scrape type 2
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd07521a-fc50-5b1c-ba95-df8272ee920f with scrape type 2
2026-03-29 22:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fd07521a-fc50-5b1c-ba95-df8272ee920f, identifier: LV20%20WVL
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411837%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411837 not downloaded yet
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427908%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427908 not downloaded yet
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427855%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427855 not downloaded yet
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D686575406%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575406 not downloaded yet
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430267%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430267 not downloaded yet
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430314%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430314 not downloaded yet
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411617%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411617 not downloaded yet
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409267%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409267 not downloaded yet
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435165%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435165 not downloaded yet
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251964%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251964 not downloaded yet
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699239946%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699239946 not downloaded yet
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699212548%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212548 not downloaded yet
2026-03-29 22:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615fef90>
2026-03-29 22:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_expert_report_file_a50aae8b-8091-4c17-9a82-e25c6b7c3068.pdf HTTP/1.1" 201 0
2026-03-29 22:01:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0991f76e-fa68-5257-8869-29bbc185bed6
2026-03-29 22:01:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0991f76e-fa68-5257-8869-29bbc185bed6, skipping ID generation
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0991f76e-fa68-5257-8869-29bbc185bed6
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAK55EXG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AK55EXG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58XVG/42790595?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=vcjXHy%2BXcxnL8fVcBSIy1zRUfNwdkYA77TQSDd3JyNw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411726/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MP65LKN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:01:09 [bca.uk] INFO: Found listing with ID: OE10%20BXU
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE10%2520BXU%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [bca.uk] INFO: Scrape type for OE10%20BXU: 1
2026-03-29 22:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95589f3c-887c-5311-a841-cf63432d8df5 with identifier: OE10%20BXU
2026-03-29 22:01:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 95589f3c-887c-5311-a841-cf63432d8df5
2026-03-29 22:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fd07521a-fc50-5b1c-ba95-df8272ee920f with identifier: LV20%20WVL
2026-03-29 22:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fd07521a-fc50-5b1c-ba95-df8272ee920f with identifier: LV20%20WVL
2026-03-29 22:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fd07521a-fc50-5b1c-ba95-df8272ee920f with identifier: LV20%20WVL to the API
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 198,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV20%20WVL-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'fd07521a-fc50-5b1c-ba95-df8272ee920f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LV20 WVL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LV20%20WVL&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FORD',
'model': 'RANGER',
'odometer': 60116,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FORD RANGER 2.0 EBL 213 LIMITED 1 CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'EBL 213 LIMITED 1',
'vin': '6FPPXXMJ2PKD82061',
'year': 2020}
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV20%2520WVL%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [bca.uk] INFO: Saving data for LV20%20WVL: {'auction_closing_time': 1774951200.0, 'created_time': 1774620157.549794, 'last_price_update_time': 1774821669.924407}
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LV20%2520WVL') HTTP/1.1" 204 0
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406328%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406328 not downloaded yet
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699040206%27 HTTP/1.1" 200 None
2026-03-29 22:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040206 not downloaded yet
2026-03-29 22:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411792%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411792 not downloaded yet
2026-03-29 22:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF17VPN/42811060?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=YkLrcIHkwtrZsjUa2prubREuXQStMy8DMOWlaZjCM6o%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:10 [bca.uk] INFO: Found listing with ID: MM69%20NMJ
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM69%2520NMJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [bca.uk] INFO: Scrape type for MM69%20NMJ: 2
2026-03-29 22:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1afdbb2a-641b-5b8c-82e6-ddca4f9080a0 with identifier: MM69%20NMJ
2026-03-29 22:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1afdbb2a-641b-5b8c-82e6-ddca4f9080a0 with scrape type 2
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1afdbb2a-641b-5b8c-82e6-ddca4f9080a0 with scrape type 2
2026-03-29 22:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1afdbb2a-641b-5b8c-82e6-ddca4f9080a0, identifier: MM69%20NMJ
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D686575421%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575421 not downloaded yet
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430289%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430289 not downloaded yet
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430334%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430334 not downloaded yet
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411643%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411643 not downloaded yet
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409284%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409284 not downloaded yet
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435173%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435173 not downloaded yet
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251971%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251971 not downloaded yet
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699239960%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699239960 not downloaded yet
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699212555%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212555 not downloaded yet
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234535%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234535 not downloaded yet
2026-03-29 22:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620a8610>
2026-03-29 22:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_expert_report_file_cfe144ea-f8c4-4fa6-b1ee-ff242e22a134.pdf HTTP/1.1" 201 0
2026-03-29 22:01:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9816a6af-47f8-5106-89d9-6d77d25fd0f4
2026-03-29 22:01:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9816a6af-47f8-5106-89d9-6d77d25fd0f4, skipping ID generation
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9816a6af-47f8-5106-89d9-6d77d25fd0f4
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLO08HUA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LO08HUA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:10 [bca.uk] INFO: Total items found: 100
2026-03-29 22:01:10 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded
2026-03-29 22:01:10 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:01:10 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12WNS/42810774?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=tTo%2B0xotySQc25NFgljm0ZLwDTnsvqG5v%2FSimEvL7PM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST62SYF/42809590?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=r1Z4o1RO41%2Frbsi6j2NujNSq2CIa1MRr3E0xDNV9JdE%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:10 [scrapy.extensions.logstats] INFO: Crawled 28 pages (at 28 pages/min), scraped 12 items (at 12 items/min)
2026-03-29 22:01:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-29 22:01:10 [bca.uk] INFO: Found listing with ID: YS17%20ZLU
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS17%2520ZLU%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [bca.uk] INFO: Scrape type for YS17%20ZLU: 2
2026-03-29 22:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb844d27-f38e-5df3-b857-3df95805a0a0 with identifier: YS17%20ZLU
2026-03-29 22:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb844d27-f38e-5df3-b857-3df95805a0a0 with scrape type 2
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb844d27-f38e-5df3-b857-3df95805a0a0 with scrape type 2
2026-03-29 22:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bb844d27-f38e-5df3-b857-3df95805a0a0, identifier: YS17%20ZLU
2026-03-29 22:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1afdbb2a-641b-5b8c-82e6-ddca4f9080a0 with identifier: MM69%20NMJ
2026-03-29 22:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1afdbb2a-641b-5b8c-82e6-ddca4f9080a0 with identifier: MM69%20NMJ
2026-03-29 22:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1afdbb2a-641b-5b8c-82e6-ddca4f9080a0 with identifier: MM69%20NMJ to the API
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 183,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MM69%20NMJ-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1afdbb2a-641b-5b8c-82e6-ddca4f9080a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MM69 NMJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MM69%20NMJ&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'TOYOTA',
'model': 'HILUX',
'odometer': 40732,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'TOYOTA HILUX 2.4 D 150 INVINCIBLE 4WD CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'D 150 INVINCIBLE 4WD',
'vin': 'AHTBB3CD001765970',
'year': 2020}
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM69%2520NMJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [bca.uk] INFO: Saving data for MM69%20NMJ: {'auction_closing_time': 1774951200.0, 'created_time': 1774610665.174206, 'last_price_update_time': 1774821670.907197}
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MM69%2520NMJ') HTTP/1.1" 204 0
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406349%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406349 not downloaded yet
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699040234%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040234 not downloaded yet
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411803%27 HTTP/1.1" 200 None
2026-03-29 22:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411803 not downloaded yet
2026-03-29 22:01:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430146/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DC19VSX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bb844d27-f38e-5df3-b857-3df95805a0a0 with identifier: YS17%20ZLU
2026-03-29 22:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bb844d27-f38e-5df3-b857-3df95805a0a0 with identifier: YS17%20ZLU
2026-03-29 22:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bb844d27-f38e-5df3-b857-3df95805a0a0 with identifier: YS17%20ZLU to the API
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 167,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YS17%20ZLU-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'bb844d27-f38e-5df3-b857-3df95805a0a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YS17 ZLU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YS17%20ZLU&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'FORD',
'model': 'TRANSIT CUSTOM',
'odometer': 105764,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FORD TRANSIT CUSTOM 2.0 TDCI 130 270 SWB LIMITED L/R PanelVan',
'transmission': 'manual',
'trim': 'TDCI 130 270 SWB LIMITED L/R',
'vin': 'WF0YXXTTGYHP31950',
'year': 2017}
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS17%2520ZLU%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [bca.uk] INFO: Saving data for YS17%20ZLU: {'auction_closing_time': 1775037600.0, 'created_time': 1774391675.193137, 'last_price_update_time': 1774821671.367316}
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YS17%2520ZLU') HTTP/1.1" 204 0
2026-03-29 22:01:11 [bca.uk] INFO: Found listing with ID: PE70%20WXJ
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE70%2520WXJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [bca.uk] INFO: Scrape type for PE70%20WXJ: 0
2026-03-29 22:01:11 [bca.uk] INFO: Found listing with ID: RO23%20JHE
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO23%2520JHE%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [bca.uk] INFO: Scrape type for RO23%20JHE: 0
2026-03-29 22:01:11 [bca.uk] INFO: Found listing with ID: RO23%20JTU
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO23%2520JTU%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [bca.uk] INFO: Scrape type for RO23%20JTU: 0
2026-03-29 22:01:11 [bca.uk] INFO: Found listing with ID: YE18%20FEP
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE18%2520FEP%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [bca.uk] INFO: Scrape type for YE18%20FEP: 0
2026-03-29 22:01:11 [bca.uk] INFO: Found listing with ID: AE21%20KSX
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE21%2520KSX%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [bca.uk] INFO: Scrape type for AE21%20KSX: 1
2026-03-29 22:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c562d387-49fb-5052-a994-67add14e4b74 with identifier: AE21%20KSX
2026-03-29 22:01:11 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c562d387-49fb-5052-a994-67add14e4b74
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411666%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411666 not downloaded yet
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409299%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409299 not downloaded yet
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435181%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435181 not downloaded yet
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251980%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251980 not downloaded yet
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699239969%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699239969 not downloaded yet
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699212562%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212562 not downloaded yet
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234539%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234539 not downloaded yet
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699210986%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699210986 not downloaded yet
2026-03-29 22:01:11 [bca.uk] INFO: Found listing with ID: PO63%20YJM
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO63%2520YJM%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [bca.uk] INFO: Scrape type for PO63%20YJM: 0
2026-03-29 22:01:11 [bca.uk] INFO: Found listing with ID: YF12%20JGU
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF12%2520JGU%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [bca.uk] INFO: Scrape type for YF12%20JGU: 2
2026-03-29 22:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 050412ff-8b37-5d55-8c9b-0a34cf929c3d with identifier: YF12%20JGU
2026-03-29 22:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 050412ff-8b37-5d55-8c9b-0a34cf929c3d with scrape type 2
2026-03-29 22:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 050412ff-8b37-5d55-8c9b-0a34cf929c3d with scrape type 2
2026-03-29 22:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 050412ff-8b37-5d55-8c9b-0a34cf929c3d, identifier: YF12%20JGU
2026-03-29 22:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61532510>
2026-03-29 22:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_expert_report_file_01cdec0f-8155-43c8-9a70-c4832e325af2.pdf HTTP/1.1" 201 0
2026-03-29 22:01:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cdbe3643-d056-5481-b487-6a8e20861864
2026-03-29 22:01:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdbe3643-d056-5481-b487-6a8e20861864, skipping ID generation
2026-03-29 22:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cdbe3643-d056-5481-b487-6a8e20861864
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMK58XVG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MK58XVG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO58EBF/42810110?sv=2020-08-04&st=2026-03-29T22%3A01%3A02Z&se=2026-03-29T22%3A26%3A02Z&sr=b&sp=r&sig=l1yGxyGiXjxmhLTIgBa00vRGvOItb%2B7FOLk9BOk0TjI%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:11 [bca.uk] INFO: Found listing with ID: CN65%20OTA
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN65%2520OTA%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [bca.uk] INFO: Scrape type for CN65%20OTA: 1
2026-03-29 22:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5796b214-f7e8-5915-afb7-c30027610219 with identifier: CN65%20OTA
2026-03-29 22:01:11 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5796b214-f7e8-5915-afb7-c30027610219
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406374%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406374 not downloaded yet
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699040265%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040265 not downloaded yet
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411816%27 HTTP/1.1" 200 None
2026-03-29 22:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411816 not downloaded yet
2026-03-29 22:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 050412ff-8b37-5d55-8c9b-0a34cf929c3d with identifier: YF12%20JGU
2026-03-29 22:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 050412ff-8b37-5d55-8c9b-0a34cf929c3d with identifier: YF12%20JGU
2026-03-29 22:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 050412ff-8b37-5d55-8c9b-0a34cf929c3d with identifier: YF12%20JGU to the API
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF12%20JGU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '050412ff-8b37-5d55-8c9b-0a34cf929c3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF12 JGU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF12%20JGU&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'BMW',
'model': '320D',
'odometer': 141954,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 SPORT STEP Saloon',
'transmission': 'automatic',
'trim': 'SPORT STEP',
'vin': 'WBA3D32090J380575',
'year': 2012}
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF12%2520JGU%27 HTTP/1.1" 200 None
2026-03-29 22:01:12 [bca.uk] INFO: Saving data for YF12%20JGU: {'auction_closing_time': 1774951200.0, 'created_time': 1774535175.165684, 'last_price_update_time': 1774821672.294551}
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF12%2520JGU') HTTP/1.1" 204 0
2026-03-29 22:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618bad90>
2026-03-29 22:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_expert_report_file_9ef49736-5ed5-4b64-a3cc-e31138f187cb.pdf HTTP/1.1" 201 0
2026-03-29 22:01:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5439021f-449a-5c9e-a193-64352e476208
2026-03-29 22:01:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5439021f-449a-5c9e-a193-64352e476208, skipping ID generation
2026-03-29 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5439021f-449a-5c9e-a193-64352e476208
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPF17VPN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PF17VPN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:12 [bca.uk] INFO: Found listing with ID: DV21%20WPJ
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV21%2520WPJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:12 [bca.uk] INFO: Scrape type for DV21%20WPJ: 0
2026-03-29 22:01:12 [bca.uk] INFO: Found listing with ID: HT68%20HFO
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT68%2520HFO%27 HTTP/1.1" 200 None
2026-03-29 22:01:12 [bca.uk] INFO: Scrape type for HT68%20HFO: 0
2026-03-29 22:01:12 [bca.uk] INFO: Found listing with ID: YR67%20NZG
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR67%2520NZG%27 HTTP/1.1" 200 None
2026-03-29 22:01:12 [bca.uk] INFO: Scrape type for YR67%20NZG: 1
2026-03-29 22:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94abe6e9-81d6-5688-9976-35bc84a70d4a with identifier: YR67%20NZG
2026-03-29 22:01:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 94abe6e9-81d6-5688-9976-35bc84a70d4a
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251990%27 HTTP/1.1" 200 None
2026-03-29 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251990 not downloaded yet
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699239980%27 HTTP/1.1" 200 None
2026-03-29 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699239980 not downloaded yet
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699212569%27 HTTP/1.1" 200 None
2026-03-29 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212569 not downloaded yet
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234555%27 HTTP/1.1" 200 None
2026-03-29 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234555 not downloaded yet
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699210991%27 HTTP/1.1" 200 None
2026-03-29 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699210991 not downloaded yet
2026-03-29 22:01:12 [bca.uk] INFO: Found listing with ID: CX16%20CRU
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX16%2520CRU%27 HTTP/1.1" 200 None
2026-03-29 22:01:12 [bca.uk] INFO: Scrape type for CX16%20CRU: 2
2026-03-29 22:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7723c704-da67-5c00-8040-135773d457f9 with identifier: CX16%20CRU
2026-03-29 22:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7723c704-da67-5c00-8040-135773d457f9 with scrape type 2
2026-03-29 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7723c704-da67-5c00-8040-135773d457f9 with scrape type 2
2026-03-29 22:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7723c704-da67-5c00-8040-135773d457f9, identifier: CX16%20CRU
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699242897%27 HTTP/1.1" 200 None
2026-03-29 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242897 not downloaded yet
2026-03-29 22:01:12 [bca.uk] INFO: Found listing with ID: VU66%20XGP
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU66%2520XGP%27 HTTP/1.1" 200 None
2026-03-29 22:01:12 [bca.uk] INFO: Scrape type for VU66%20XGP: 2
2026-03-29 22:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4bc05ff-7ebb-5796-be43-4ba52745f0c0 with identifier: VU66%20XGP
2026-03-29 22:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4bc05ff-7ebb-5796-be43-4ba52745f0c0 with scrape type 2
2026-03-29 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4bc05ff-7ebb-5796-be43-4ba52745f0c0 with scrape type 2
2026-03-29 22:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a4bc05ff-7ebb-5796-be43-4ba52745f0c0, identifier: VU66%20XGP
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406390%27 HTTP/1.1" 200 None
2026-03-29 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406390 not downloaded yet
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699040295%27 HTTP/1.1" 200 None
2026-03-29 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040295 not downloaded yet
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411831%27 HTTP/1.1" 200 None
2026-03-29 22:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411831 not downloaded yet
2026-03-29 22:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7723c704-da67-5c00-8040-135773d457f9 with identifier: CX16%20CRU
2026-03-29 22:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7723c704-da67-5c00-8040-135773d457f9 with identifier: CX16%20CRU
2026-03-29 22:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7723c704-da67-5c00-8040-135773d457f9 with identifier: CX16%20CRU to the API
2026-03-29 22:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 106,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CX16%20CRU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7723c704-da67-5c00-8040-135773d457f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CX16 CRU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CX16%20CRU&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'MERCEDES-BENZ',
'model': 'B200 D',
'odometer': 28791,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ B200 D 2.1 AMG LINE PREMIUM DCT MPV',
'transmission': 'automatic',
'trim': 'AMG LINE PREMIUM DCT',
'vin': 'WDD2462082J390076',
'year': 2016}
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX16%2520CRU%27 HTTP/1.1" 200 None
2026-03-29 22:01:13 [bca.uk] INFO: Saving data for CX16%20CRU: {'auction_closing_time': 1774951200.0, 'created_time': 1774102203.182069, 'last_price_update_time': 1774821673.22824}
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CX16%2520CRU') HTTP/1.1" 204 0
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073149%27 HTTP/1.1" 200 None
2026-03-29 22:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073149 not downloaded yet
2026-03-29 22:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6176f490>
2026-03-29 22:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_expert_report_file_d3f089a6-8916-4291-8e92-9c3758449c69.pdf HTTP/1.1" 201 0
2026-03-29 22:01:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4e630b36-cd01-5007-b4b4-e80c316bb326
2026-03-29 22:01:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e630b36-cd01-5007-b4b4-e80c316bb326, skipping ID generation
2026-03-29 22:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e630b36-cd01-5007-b4b4-e80c316bb326
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMT12WNS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MT12WNS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6173cc10>
2026-03-29 22:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_expert_report_file_0f77e131-f25f-4787-8534-55427fca004f.pdf HTTP/1.1" 201 0
2026-03-29 22:01:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b294b559-83e7-5079-b89e-3524dea19cc0
2026-03-29 22:01:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b294b559-83e7-5079-b89e-3524dea19cc0, skipping ID generation
2026-03-29 22:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b294b559-83e7-5079-b89e-3524dea19cc0
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DST62SYF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ST62SYF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a4bc05ff-7ebb-5796-be43-4ba52745f0c0 with identifier: VU66%20XGP
2026-03-29 22:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a4bc05ff-7ebb-5796-be43-4ba52745f0c0 with identifier: VU66%20XGP
2026-03-29 22:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a4bc05ff-7ebb-5796-be43-4ba52745f0c0 with identifier: VU66%20XGP to the API
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 228,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VU66%20XGP-GB',
'category': 'LightCommercialVehicle',
'color': 'red',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a4bc05ff-7ebb-5796-be43-4ba52745f0c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VU66 XGP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VU66%20XGP&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'RANGER',
'odometer': 99131,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD RANGER 3.2 TDCI 200 LIMITED 2 4WD CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'TDCI 200 LIMITED 2 4WD',
'vin': '6FPPXXMJ2PGK81651',
'year': 2016}
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU66%2520XGP%27 HTTP/1.1" 200 None
2026-03-29 22:01:13 [bca.uk] INFO: Saving data for VU66%20XGP: {'auction_closing_time': 1774951200.0, 'created_time': 1774523554.650803, 'last_price_update_time': 1774821673.710405}
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VU66%2520XGP') HTTP/1.1" 204 0
2026-03-29 22:01:13 [bca.uk] INFO: Found listing with ID: YY62%20LLD
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY62%2520LLD%27 HTTP/1.1" 200 None
2026-03-29 22:01:13 [bca.uk] INFO: Scrape type for YY62%20LLD: 0
2026-03-29 22:01:13 [bca.uk] INFO: Found listing with ID: HJ73%20TXT
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ73%2520TXT%27 HTTP/1.1" 200 None
2026-03-29 22:01:13 [bca.uk] INFO: Scrape type for HJ73%20TXT: 1
2026-03-29 22:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 888140b1-3c5d-5e43-a8ef-e5925368639e with identifier: HJ73%20TXT
2026-03-29 22:01:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 888140b1-3c5d-5e43-a8ef-e5925368639e
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252004%27 HTTP/1.1" 200 None
2026-03-29 22:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252004 not downloaded yet
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699240002%27 HTTP/1.1" 200 None
2026-03-29 22:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699240002 not downloaded yet
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699212581%27 HTTP/1.1" 200 None
2026-03-29 22:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212581 not downloaded yet
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234566%27 HTTP/1.1" 200 None
2026-03-29 22:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234566 not downloaded yet
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699210999%27 HTTP/1.1" 200 None
2026-03-29 22:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699210999 not downloaded yet
2026-03-29 22:01:13 [bca.uk] INFO: Found listing with ID: DE61%20AOO
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE61%2520AOO%27 HTTP/1.1" 200 None
2026-03-29 22:01:13 [bca.uk] INFO: Scrape type for DE61%20AOO: 0
2026-03-29 22:01:13 [bca.uk] INFO: Found listing with ID: DS13%20FUY
2026-03-29 22:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS13%2520FUY%27 HTTP/1.1" 200 None
2026-03-29 22:01:14 [bca.uk] INFO: Scrape type for DS13%20FUY: 0
2026-03-29 22:01:14 [bca.uk] INFO: Found listing with ID: EU13%20BPY
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU13%2520BPY%27 HTTP/1.1" 200 None
2026-03-29 22:01:14 [bca.uk] INFO: Scrape type for EU13%20BPY: 0
2026-03-29 22:01:14 [bca.uk] INFO: Found listing with ID: EU63%20XYW
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU63%2520XYW%27 HTTP/1.1" 200 None
2026-03-29 22:01:14 [bca.uk] INFO: Scrape type for EU63%20XYW: 0
2026-03-29 22:01:14 [bca.uk] INFO: Found listing with ID: MM13%20HZU
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM13%2520HZU%27 HTTP/1.1" 200 None
2026-03-29 22:01:14 [bca.uk] INFO: Scrape type for MM13%20HZU: 0
2026-03-29 22:01:14 [bca.uk] INFO: Found listing with ID: ND63%20BDY
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND63%2520BDY%27 HTTP/1.1" 200 None
2026-03-29 22:01:14 [bca.uk] INFO: Scrape type for ND63%20BDY: 0
2026-03-29 22:01:14 [bca.uk] INFO: Found listing with ID: EX56%20XWU
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX56%2520XWU%27 HTTP/1.1" 200 None
2026-03-29 22:01:14 [bca.uk] INFO: Scrape type for EX56%20XWU: 2
2026-03-29 22:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 887f7b9e-77d7-51db-af6a-fa1b530aa86c with identifier: EX56%20XWU
2026-03-29 22:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 887f7b9e-77d7-51db-af6a-fa1b530aa86c with scrape type 2
2026-03-29 22:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 887f7b9e-77d7-51db-af6a-fa1b530aa86c with scrape type 2
2026-03-29 22:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 887f7b9e-77d7-51db-af6a-fa1b530aa86c, identifier: EX56%20XWU
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699242902%27 HTTP/1.1" 200 None
2026-03-29 22:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242902 not downloaded yet
2026-03-29 22:01:14 [bca.uk] INFO: Found listing with ID: AP16%20OYK
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP16%2520OYK%27 HTTP/1.1" 200 None
2026-03-29 22:01:14 [bca.uk] INFO: Scrape type for AP16%20OYK: 0
2026-03-29 22:01:14 [bca.uk] INFO: Found listing with ID: DX68%20ZVP
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX68%2520ZVP%27 HTTP/1.1" 200 None
2026-03-29 22:01:14 [bca.uk] INFO: Scrape type for DX68%20ZVP: 2
2026-03-29 22:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a534b48a-ee5d-52e5-9bfc-454f206aeaea with identifier: DX68%20ZVP
2026-03-29 22:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a534b48a-ee5d-52e5-9bfc-454f206aeaea with scrape type 2
2026-03-29 22:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a534b48a-ee5d-52e5-9bfc-454f206aeaea with scrape type 2
2026-03-29 22:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a534b48a-ee5d-52e5-9bfc-454f206aeaea, identifier: DX68%20ZVP
2026-03-29 22:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 887f7b9e-77d7-51db-af6a-fa1b530aa86c with identifier: EX56%20XWU
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-29 22:01:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 887f7b9e-77d7-51db-af6a-fa1b530aa86c with identifier: EX56%20XWU
2026-03-29 22:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 887f7b9e-77d7-51db-af6a-fa1b530aa86c with identifier: EX56%20XWU to the API
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 207,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EX56%20XWU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.8L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '887f7b9e-77d7-51db-af6a-fa1b530aa86c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EX56 XWU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EX56%20XWU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'CLK 200K',
'odometer': 102864,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLK 200K 1.8 AVANTGARDE TIP Coupe',
'transmission': 'manual',
'trim': 'AVANTGARDE TIP',
'vin': 'WDB2093422F208348',
'year': 2006}
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX56%2520XWU%27 HTTP/1.1" 200 None
2026-03-29 22:01:14 [bca.uk] INFO: Saving data for EX56%20XWU: {'auction_closing_time': 1774951200.0, 'created_time': 1774706977.521042, 'last_price_update_time': 1774821674.850809}
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EX56%2520XWU') HTTP/1.1" 204 0
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073164%27 HTTP/1.1" 200 None
2026-03-29 22:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073164 not downloaded yet
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023386%27 HTTP/1.1" 200 None
2026-03-29 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023386 not downloaded yet
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246741%27 HTTP/1.1" 200 None
2026-03-29 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246741 not downloaded yet
2026-03-29 22:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616dd110>
2026-03-29 22:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_expert_report_file_454b36be-2fc0-4155-a5ff-7668c6749ff3.pdf HTTP/1.1" 201 0
2026-03-29 22:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 779863fc-56f0-5718-9334-675ca35049bb
2026-03-29 22:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 779863fc-56f0-5718-9334-675ca35049bb, skipping ID generation
2026-03-29 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 779863fc-56f0-5718-9334-675ca35049bb
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVO58EBF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VO58EBF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a534b48a-ee5d-52e5-9bfc-454f206aeaea with identifier: DX68%20ZVP
2026-03-29 22:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a534b48a-ee5d-52e5-9bfc-454f206aeaea with identifier: DX68%20ZVP
2026-03-29 22:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a534b48a-ee5d-52e5-9bfc-454f206aeaea with identifier: DX68%20ZVP to the API
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DX68%20ZVP-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 6,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a534b48a-ee5d-52e5-9bfc-454f206aeaea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DX68 ZVP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DX68%20ZVP&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'TOYOTA',
'model': 'PROACE',
'odometer': 119525,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'TOYOTA PROACE 1.6 D 115 MEDIUM COMFORT PanelVan',
'transmission': 'manual',
'trim': 'D 115 MEDIUM COMFORT',
'vin': 'YARVBBHXHGZ123548',
'year': 2018}
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX68%2520ZVP%27 HTTP/1.1" 200 None
2026-03-29 22:01:15 [bca.uk] INFO: Saving data for DX68%20ZVP: {'auction_closing_time': 1775037600.0, 'created_time': 1773933577.767605, 'last_price_update_time': 1774821675.484187}
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DX68%2520ZVP') HTTP/1.1" 204 0
2026-03-29 22:01:15 [bca.uk] INFO: Found listing with ID: PK13%20HHL
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK13%2520HHL%27 HTTP/1.1" 200 None
2026-03-29 22:01:15 [bca.uk] INFO: Scrape type for PK13%20HHL: 1
2026-03-29 22:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1e4cdef-f735-5359-9a05-4d45d8b45964 with identifier: PK13%20HHL
2026-03-29 22:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a1e4cdef-f735-5359-9a05-4d45d8b45964
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252019%27 HTTP/1.1" 200 None
2026-03-29 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252019 not downloaded yet
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699240020%27 HTTP/1.1" 200 None
2026-03-29 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699240020 not downloaded yet
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699212596%27 HTTP/1.1" 200 None
2026-03-29 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212596 not downloaded yet
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234576%27 HTTP/1.1" 200 None
2026-03-29 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234576 not downloaded yet
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699211010%27 HTTP/1.1" 200 None
2026-03-29 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699211010 not downloaded yet
2026-03-29 22:01:15 [bca.uk] INFO: Found listing with ID: OV61%20FUE
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV61%2520FUE%27 HTTP/1.1" 200 None
2026-03-29 22:01:15 [bca.uk] INFO: Scrape type for OV61%20FUE: 0
2026-03-29 22:01:15 [bca.uk] INFO: Found listing with ID: PX63%20KGU
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX63%2520KGU%27 HTTP/1.1" 200 None
2026-03-29 22:01:15 [bca.uk] INFO: Scrape type for PX63%20KGU: 0
2026-03-29 22:01:15 [bca.uk] INFO: Found listing with ID: PY15%20DWJ
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY15%2520DWJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:15 [bca.uk] INFO: Scrape type for PY15%20DWJ: 0
2026-03-29 22:01:15 [bca.uk] INFO: Found listing with ID: BJ10%20KWZ
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ10%2520KWZ%27 HTTP/1.1" 200 None
2026-03-29 22:01:15 [bca.uk] INFO: Scrape type for BJ10%20KWZ: 2
2026-03-29 22:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27f69fac-bb0a-5636-ace4-3fea0252dc89 with identifier: BJ10%20KWZ
2026-03-29 22:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27f69fac-bb0a-5636-ace4-3fea0252dc89 with scrape type 2
2026-03-29 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27f69fac-bb0a-5636-ace4-3fea0252dc89 with scrape type 2
2026-03-29 22:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 27f69fac-bb0a-5636-ace4-3fea0252dc89, identifier: BJ10%20KWZ
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699242909%27 HTTP/1.1" 200 None
2026-03-29 22:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242909 not downloaded yet
2026-03-29 22:01:15 [bca.uk] INFO: Found listing with ID: LD21%20EYG
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD21%2520EYG%27 HTTP/1.1" 200 None
2026-03-29 22:01:15 [bca.uk] INFO: Scrape type for LD21%20EYG: 1
2026-03-29 22:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d394566c-2f64-5973-8159-519cccf81ad9 with identifier: LD21%20EYG
2026-03-29 22:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d394566c-2f64-5973-8159-519cccf81ad9
2026-03-29 22:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 27f69fac-bb0a-5636-ace4-3fea0252dc89 with identifier: BJ10%20KWZ
2026-03-29 22:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 27f69fac-bb0a-5636-ace4-3fea0252dc89 with identifier: BJ10%20KWZ
2026-03-29 22:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 27f69fac-bb0a-5636-ace4-3fea0252dc89 with identifier: BJ10%20KWZ to the API
2026-03-29 22:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ10%20KWZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '27f69fac-bb0a-5636-ace4-3fea0252dc89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ10 KWZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ10%20KWZ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'BMW',
'model': '116I',
'odometer': 60804,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'BMW 116I 2.0 M SPORT Hatchback',
'transmission': 'manual',
'trim': 'M SPORT',
'vin': 'WBAUK32060VM42405',
'year': 2010}
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ10%2520KWZ%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [bca.uk] INFO: Saving data for BJ10%20KWZ: {'auction_closing_time': 1774951200.0, 'created_time': 1774303298.107324, 'last_price_update_time': 1774821676.166102}
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ10%2520KWZ') HTTP/1.1" 204 0
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073179%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073179 not downloaded yet
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023397%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023397 not downloaded yet
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246750%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246750 not downloaded yet
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699457248%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457248 not downloaded yet
2026-03-29 22:01:16 [bca.uk] INFO: Found listing with ID: RO17%20AYF
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO17%2520AYF%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [bca.uk] INFO: Scrape type for RO17%20AYF: 0
2026-03-29 22:01:16 [bca.uk] INFO: Found listing with ID: WK22%20GWM
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK22%2520GWM%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [bca.uk] INFO: Scrape type for WK22%20GWM: 0
2026-03-29 22:01:16 [bca.uk] INFO: Found listing with ID: YC21%20PYK
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC21%2520PYK%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [bca.uk] INFO: Scrape type for YC21%20PYK: 2
2026-03-29 22:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44186c5e-817e-5d79-9567-39f8edb111e0 with identifier: YC21%20PYK
2026-03-29 22:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44186c5e-817e-5d79-9567-39f8edb111e0 with scrape type 2
2026-03-29 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44186c5e-817e-5d79-9567-39f8edb111e0 with scrape type 2
2026-03-29 22:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 44186c5e-817e-5d79-9567-39f8edb111e0, identifier: YC21%20PYK
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252032%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252032 not downloaded yet
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699240036%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699240036 not downloaded yet
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699212610%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212610 not downloaded yet
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234595%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234595 not downloaded yet
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699211016%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699211016 not downloaded yet
2026-03-29 22:01:16 [bca.uk] INFO: Found listing with ID: BN63%20XSE
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN63%2520XSE%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [bca.uk] INFO: Scrape type for BN63%20XSE: 2
2026-03-29 22:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3595d2c-a77f-56ea-a6be-d97575269efe with identifier: BN63%20XSE
2026-03-29 22:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3595d2c-a77f-56ea-a6be-d97575269efe with scrape type 2
2026-03-29 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3595d2c-a77f-56ea-a6be-d97575269efe with scrape type 2
2026-03-29 22:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d3595d2c-a77f-56ea-a6be-d97575269efe, identifier: BN63%20XSE
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699242917%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242917 not downloaded yet
2026-03-29 22:01:16 [bca.uk] INFO: Found listing with ID: AX19%20RXA
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX19%2520RXA%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [bca.uk] INFO: Scrape type for AX19%20RXA: 0
2026-03-29 22:01:16 [bca.uk] INFO: Found listing with ID: KM74%20JDZ
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM74%2520JDZ%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [bca.uk] INFO: Scrape type for KM74%20JDZ: 0
2026-03-29 22:01:16 [bca.uk] INFO: Found listing with ID: OV15%20WSW
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV15%2520WSW%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [bca.uk] INFO: Scrape type for OV15%20WSW: 0
2026-03-29 22:01:16 [bca.uk] INFO: Found listing with ID: LD70%20NXS
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD70%2520NXS%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [bca.uk] INFO: Scrape type for LD70%20NXS: 0
2026-03-29 22:01:16 [bca.uk] INFO: Found listing with ID: CF22%20XZC
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF22%2520XZC%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [bca.uk] INFO: Scrape type for CF22%20XZC: 0
2026-03-29 22:01:16 [bca.uk] INFO: Found listing with ID: EK69%20XRA
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK69%2520XRA%27 HTTP/1.1" 200 None
2026-03-29 22:01:16 [bca.uk] INFO: Scrape type for EK69%20XRA: 2
2026-03-29 22:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 667eec52-805f-50fa-ac96-3042aa830b81 with identifier: EK69%20XRA
2026-03-29 22:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667eec52-805f-50fa-ac96-3042aa830b81 with scrape type 2
2026-03-29 22:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 667eec52-805f-50fa-ac96-3042aa830b81 with scrape type 2
2026-03-29 22:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 667eec52-805f-50fa-ac96-3042aa830b81, identifier: EK69%20XRA
2026-03-29 22:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 44186c5e-817e-5d79-9567-39f8edb111e0 with identifier: YC21%20PYK
2026-03-29 22:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 44186c5e-817e-5d79-9567-39f8edb111e0 with identifier: YC21%20PYK
2026-03-29 22:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 44186c5e-817e-5d79-9567-39f8edb111e0 with identifier: YC21%20PYK to the API
2026-03-29 22:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC21%20PYK-GB',
'category': 'LightCommercialVehicle',
'color': 'black',
'currency': 'GBP',
'doors_number': 6,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '44186c5e-817e-5d79-9567-39f8edb111e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC21 PYK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC21%20PYK&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'VIVARO 3100',
'odometer': 109643,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VAUXHALL VIVARO 3100 2.0 D 120 SPORTIVE L2 H1 PanelVan',
'transmission': 'manual',
'trim': 'D 120 SPORTIVE L2 H1',
'vin': 'VXEVFAHKKM7836553',
'year': 2021}
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC21%2520PYK%27 HTTP/1.1" 200 None
2026-03-29 22:01:17 [bca.uk] INFO: Saving data for YC21%20PYK: {'auction_closing_time': 1775037600.0, 'created_time': 1774303753.164287, 'last_price_update_time': 1774821677.37294}
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC21%2520PYK') HTTP/1.1" 204 0
2026-03-29 22:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d3595d2c-a77f-56ea-a6be-d97575269efe with identifier: BN63%20XSE
2026-03-29 22:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d3595d2c-a77f-56ea-a6be-d97575269efe with identifier: BN63%20XSE
2026-03-29 22:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d3595d2c-a77f-56ea-a6be-d97575269efe with identifier: BN63%20XSE to the API
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BN63%20XSE-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd3595d2c-a77f-56ea-a6be-d97575269efe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BN63 XSE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BN63%20XSE&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 125547,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 100 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 ZETEC',
'vin': 'WF0CXXGAKCDA10825',
'year': 2013}
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN63%2520XSE%27 HTTP/1.1" 200 None
2026-03-29 22:01:17 [bca.uk] INFO: Saving data for BN63%20XSE: {'auction_closing_time': 1774951200.0, 'created_time': 1774419060.363526, 'last_price_update_time': 1774821677.850424}
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BN63%2520XSE') HTTP/1.1" 204 0
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073189%27 HTTP/1.1" 200 None
2026-03-29 22:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073189 not downloaded yet
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023406%27 HTTP/1.1" 200 None
2026-03-29 22:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023406 not downloaded yet
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246761%27 HTTP/1.1" 200 None
2026-03-29 22:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246761 not downloaded yet
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699457249%27 HTTP/1.1" 200 None
2026-03-29 22:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457249 not downloaded yet
2026-03-29 22:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 667eec52-805f-50fa-ac96-3042aa830b81 with identifier: EK69%20XRA
2026-03-29 22:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-29 22:01:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 667eec52-805f-50fa-ac96-3042aa830b81 with identifier: EK69%20XRA
2026-03-29 22:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 667eec52-805f-50fa-ac96-3042aa830b81 with identifier: EK69%20XRA to the API
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 204,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK69%20XRA-GB',
'category': 'LightCommercialVehicle',
'color': 'orange',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '667eec52-805f-50fa-ac96-3042aa830b81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EK69 XRA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EK69%20XRA&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'FORD',
'model': 'RANGER',
'odometer': 87964,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD RANGER 2.0 EBL 213 WILDTRAK CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'EBL 213 WILDTRAK',
'vin': '6FPPXXMJ2PKS35335',
'year': 2019}
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK69%2520XRA%27 HTTP/1.1" 200 None
2026-03-29 22:01:18 [bca.uk] INFO: Saving data for EK69%20XRA: {'auction_closing_time': 1774951200.0, 'created_time': 1773928902.634872, 'last_price_update_time': 1774821678.488584}
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EK69%2520XRA') HTTP/1.1" 204 0
2026-03-29 22:01:18 [bca.uk] INFO: Found listing with ID: YX73%20XWD
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX73%2520XWD%27 HTTP/1.1" 200 None
2026-03-29 22:01:18 [bca.uk] INFO: Scrape type for YX73%20XWD: 0
2026-03-29 22:01:18 [bca.uk] INFO: Found listing with ID: AV72%20MYN
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV72%2520MYN%27 HTTP/1.1" 200 None
2026-03-29 22:01:18 [bca.uk] INFO: Scrape type for AV72%20MYN: 2
2026-03-29 22:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60731a94-5da3-54a3-b985-5255e4a7447e with identifier: AV72%20MYN
2026-03-29 22:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60731a94-5da3-54a3-b985-5255e4a7447e with scrape type 2
2026-03-29 22:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60731a94-5da3-54a3-b985-5255e4a7447e with scrape type 2
2026-03-29 22:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 60731a94-5da3-54a3-b985-5255e4a7447e, identifier: AV72%20MYN
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252047%27 HTTP/1.1" 200 None
2026-03-29 22:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252047 not downloaded yet
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699240050%27 HTTP/1.1" 200 None
2026-03-29 22:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699240050 not downloaded yet
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699212624%27 HTTP/1.1" 200 None
2026-03-29 22:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212624 not downloaded yet
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234612%27 HTTP/1.1" 200 None
2026-03-29 22:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234612 not downloaded yet
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699211035%27 HTTP/1.1" 200 None
2026-03-29 22:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699211035 not downloaded yet
2026-03-29 22:01:18 [bca.uk] INFO: Found listing with ID: BT13%20WXY
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT13%2520WXY%27 HTTP/1.1" 200 None
2026-03-29 22:01:18 [bca.uk] INFO: Scrape type for BT13%20WXY: 2
2026-03-29 22:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4722e40a-09ea-5f3e-80db-e5ea0f389d99 with identifier: BT13%20WXY
2026-03-29 22:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4722e40a-09ea-5f3e-80db-e5ea0f389d99 with scrape type 2
2026-03-29 22:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4722e40a-09ea-5f3e-80db-e5ea0f389d99 with scrape type 2
2026-03-29 22:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4722e40a-09ea-5f3e-80db-e5ea0f389d99, identifier: BT13%20WXY
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699242922%27 HTTP/1.1" 200 None
2026-03-29 22:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242922 not downloaded yet
2026-03-29 22:01:18 [bca.uk] INFO: Found listing with ID: GU24%20POA
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU24%2520POA%27 HTTP/1.1" 200 None
2026-03-29 22:01:18 [bca.uk] INFO: Scrape type for GU24%20POA: 0
2026-03-29 22:01:18 [bca.uk] INFO: Found listing with ID: LP15%20JMU
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP15%2520JMU%27 HTTP/1.1" 200 None
2026-03-29 22:01:18 [bca.uk] INFO: Scrape type for LP15%20JMU: 0
2026-03-29 22:01:18 [bca.uk] INFO: Found listing with ID: CA21%20KKZ
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA21%2520KKZ%27 HTTP/1.1" 200 None
2026-03-29 22:01:18 [bca.uk] INFO: Scrape type for CA21%20KKZ: 2
2026-03-29 22:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 678de246-575d-51c5-b5f9-1b842a4c028b with identifier: CA21%20KKZ
2026-03-29 22:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 678de246-575d-51c5-b5f9-1b842a4c028b with scrape type 2
2026-03-29 22:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 678de246-575d-51c5-b5f9-1b842a4c028b with scrape type 2
2026-03-29 22:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 678de246-575d-51c5-b5f9-1b842a4c028b, identifier: CA21%20KKZ
2026-03-29 22:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 60731a94-5da3-54a3-b985-5255e4a7447e with identifier: AV72%20MYN
2026-03-29 22:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 60731a94-5da3-54a3-b985-5255e4a7447e with identifier: AV72%20MYN
2026-03-29 22:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 60731a94-5da3-54a3-b985-5255e4a7447e with identifier: AV72%20MYN to the API
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 192,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV72%20MYN-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 6,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '60731a94-5da3-54a3-b985-5255e4a7447e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV72 MYN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV72%20MYN&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'CITROEN',
'model': 'DISPATCH 1400',
'odometer': 49433,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'CITROEN DISPATCH 1400 2.0 B/HDI 145 M ENTERPRISE PRO PanelVan',
'transmission': 'manual',
'trim': 'B/HDI 145 M ENTERPRISE PRO',
'vin': 'VF7VFEHTMN7035318',
'year': 2022}
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV72%2520MYN%27 HTTP/1.1" 200 None
2026-03-29 22:01:19 [bca.uk] INFO: Saving data for AV72%20MYN: {'auction_closing_time': 1775037600.0, 'created_time': 1774216940.54194, 'last_price_update_time': 1774821679.343756}
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV72%2520MYN') HTTP/1.1" 204 0
2026-03-29 22:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4722e40a-09ea-5f3e-80db-e5ea0f389d99 with identifier: BT13%20WXY
2026-03-29 22:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4722e40a-09ea-5f3e-80db-e5ea0f389d99 with identifier: BT13%20WXY
2026-03-29 22:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4722e40a-09ea-5f3e-80db-e5ea0f389d99 with identifier: BT13%20WXY to the API
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT13%20WXY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4722e40a-09ea-5f3e-80db-e5ea0f389d99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BT13 WXY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BT13%20WXY&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 103510,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 125 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF0CXXGAKCDA11534',
'year': 2013}
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT13%2520WXY%27 HTTP/1.1" 200 None
2026-03-29 22:01:19 [bca.uk] INFO: Saving data for BT13%20WXY: {'auction_closing_time': 1774951200.0, 'created_time': 1774505368.040815, 'last_price_update_time': 1774821679.687053}
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BT13%2520WXY') HTTP/1.1" 204 0
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073196%27 HTTP/1.1" 200 None
2026-03-29 22:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073196 not downloaded yet
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023418%27 HTTP/1.1" 200 None
2026-03-29 22:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023418 not downloaded yet
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246766%27 HTTP/1.1" 200 None
2026-03-29 22:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246766 not downloaded yet
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699457250%27 HTTP/1.1" 200 None
2026-03-29 22:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457250 not downloaded yet
2026-03-29 22:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 678de246-575d-51c5-b5f9-1b842a4c028b with identifier: CA21%20KKZ
2026-03-29 22:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 678de246-575d-51c5-b5f9-1b842a4c028b with identifier: CA21%20KKZ
2026-03-29 22:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 678de246-575d-51c5-b5f9-1b842a4c028b with identifier: CA21%20KKZ to the API
2026-03-29 22:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CA21%20KKZ-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '678de246-575d-51c5-b5f9-1b842a4c028b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CA21 KKZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CA21%20KKZ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'CITROEN',
'model': 'BERLINGO M',
'odometer': 61248,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'CITROEN BERLINGO M 1.5 BLUEHDI 75 650 ENTERPRISE Van',
'transmission': 'manual',
'trim': 'BLUEHDI 75 650 ENTERPRISE',
'vin': 'VR7EFYHWCMJ566730',
'year': 2021}
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA21%2520KKZ%27 HTTP/1.1" 200 None
2026-03-29 22:01:20 [bca.uk] INFO: Saving data for CA21%20KKZ: {'auction_closing_time': 1775037600.0, 'created_time': 1773828795.775727, 'last_price_update_time': 1774821680.16295}
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CA21%2520KKZ') HTTP/1.1" 204 0
2026-03-29 22:01:20 [bca.uk] INFO: Found listing with ID: DU68%20OTW
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU68%2520OTW%27 HTTP/1.1" 200 None
2026-03-29 22:01:20 [bca.uk] INFO: Scrape type for DU68%20OTW: 1
2026-03-29 22:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4 with identifier: DU68%20OTW
2026-03-29 22:01:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234634%27 HTTP/1.1" 200 None
2026-03-29 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234634 not downloaded yet
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699211049%27 HTTP/1.1" 200 None
2026-03-29 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699211049 not downloaded yet
2026-03-29 22:01:20 [bca.uk] INFO: Found listing with ID: DF10%20EKT
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF10%2520EKT%27 HTTP/1.1" 200 None
2026-03-29 22:01:20 [bca.uk] INFO: Scrape type for DF10%20EKT: 2
2026-03-29 22:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d75b8aac-b892-54d4-8920-5998cf669892 with identifier: DF10%20EKT
2026-03-29 22:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d75b8aac-b892-54d4-8920-5998cf669892 with scrape type 2
2026-03-29 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d75b8aac-b892-54d4-8920-5998cf669892 with scrape type 2
2026-03-29 22:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d75b8aac-b892-54d4-8920-5998cf669892, identifier: DF10%20EKT
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699242935%27 HTTP/1.1" 200 None
2026-03-29 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242935 not downloaded yet
2026-03-29 22:01:20 [bca.uk] INFO: Found listing with ID: FJ71%20WBL
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ71%2520WBL%27 HTTP/1.1" 200 None
2026-03-29 22:01:20 [bca.uk] INFO: Scrape type for FJ71%20WBL: 0
2026-03-29 22:01:20 [bca.uk] INFO: Found listing with ID: LA69%20SXH
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA69%2520SXH%27 HTTP/1.1" 200 None
2026-03-29 22:01:20 [bca.uk] INFO: Scrape type for LA69%20SXH: 2
2026-03-29 22:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77f2d245-bb37-5df0-ac54-c61c2cdf1557 with identifier: LA69%20SXH
2026-03-29 22:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77f2d245-bb37-5df0-ac54-c61c2cdf1557 with scrape type 2
2026-03-29 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77f2d245-bb37-5df0-ac54-c61c2cdf1557 with scrape type 2
2026-03-29 22:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 77f2d245-bb37-5df0-ac54-c61c2cdf1557, identifier: LA69%20SXH
2026-03-29 22:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d75b8aac-b892-54d4-8920-5998cf669892 with identifier: DF10%20EKT
2026-03-29 22:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d75b8aac-b892-54d4-8920-5998cf669892 with identifier: DF10%20EKT
2026-03-29 22:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d75b8aac-b892-54d4-8920-5998cf669892 with identifier: DF10%20EKT to the API
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DF10%20EKT-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd75b8aac-b892-54d4-8920-5998cf669892',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DF10 EKT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DF10%20EKT&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLVO',
'model': 'XC60',
'odometer': 158066,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VOLVO XC60 2.4 D5 205 SE LUX G/T Estate',
'transmission': 'manual',
'trim': 'D5 205 SE LUX G/T',
'vin': 'YV1DZ7056B2145380',
'year': 2010}
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF10%2520EKT%27 HTTP/1.1" 200 None
2026-03-29 22:01:20 [bca.uk] INFO: Saving data for DF10%20EKT: {'auction_closing_time': 1774951200.0, 'created_time': 1774130600.615827, 'last_price_update_time': 1774821680.856521}
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DF10%2520EKT') HTTP/1.1" 204 0
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073213%27 HTTP/1.1" 200 None
2026-03-29 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073213 not downloaded yet
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023429%27 HTTP/1.1" 200 None
2026-03-29 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023429 not downloaded yet
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246776%27 HTTP/1.1" 200 None
2026-03-29 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246776 not downloaded yet
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699457251%27 HTTP/1.1" 200 None
2026-03-29 22:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457251 not downloaded yet
2026-03-29 22:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 77f2d245-bb37-5df0-ac54-c61c2cdf1557 with identifier: LA69%20SXH
2026-03-29 22:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 77f2d245-bb37-5df0-ac54-c61c2cdf1557 with identifier: LA69%20SXH
2026-03-29 22:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 77f2d245-bb37-5df0-ac54-c61c2cdf1557 with identifier: LA69%20SXH to the API
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LA69%20SXH-GB',
'category': 'LightCommercialVehicle',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '77f2d245-bb37-5df0-ac54-c61c2cdf1557',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LA69 SXH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LA69%20SXH&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'CITROEN',
'model': 'BERLINGO M',
'odometer': 33114,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'CITROEN BERLINGO M 1.6 BLUEHDI 100 1000 DRIVER Van',
'transmission': 'manual',
'trim': 'BLUEHDI 100 1000 DRIVER',
'vin': 'VR7EFBHYBKJ626209',
'year': 2020}
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA69%2520SXH%27 HTTP/1.1" 200 None
2026-03-29 22:01:21 [bca.uk] INFO: Saving data for LA69%20SXH: {'auction_closing_time': 1775037600.0, 'created_time': 1774620659.274329, 'last_price_update_time': 1774821681.293862}
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LA69%2520SXH') HTTP/1.1" 204 0
2026-03-29 22:01:21 [bca.uk] INFO: Found listing with ID: HW69%20OAO
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW69%2520OAO%27 HTTP/1.1" 200 None
2026-03-29 22:01:21 [bca.uk] INFO: Scrape type for HW69%20OAO: 0
2026-03-29 22:01:21 [bca.uk] INFO: Found listing with ID: LC71%20UFN
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC71%2520UFN%27 HTTP/1.1" 200 None
2026-03-29 22:01:21 [bca.uk] INFO: Scrape type for LC71%20UFN: 1
2026-03-29 22:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7b2a772-2b80-593a-be28-f56b16c4aace with identifier: LC71%20UFN
2026-03-29 22:01:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c7b2a772-2b80-593a-be28-f56b16c4aace
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234651%27 HTTP/1.1" 200 None
2026-03-29 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234651 not downloaded yet
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699211063%27 HTTP/1.1" 200 None
2026-03-29 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699211063 not downloaded yet
2026-03-29 22:01:21 [bca.uk] INFO: Found listing with ID: EX10%20BXE
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX10%2520BXE%27 HTTP/1.1" 200 None
2026-03-29 22:01:21 [bca.uk] INFO: Scrape type for EX10%20BXE: 2
2026-03-29 22:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5 with identifier: EX10%20BXE
2026-03-29 22:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5 with scrape type 2
2026-03-29 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5 with scrape type 2
2026-03-29 22:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5, identifier: EX10%20BXE
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699242956%27 HTTP/1.1" 200 None
2026-03-29 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242956 not downloaded yet
2026-03-29 22:01:21 [bca.uk] INFO: Found listing with ID: LG21%20WJX
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG21%2520WJX%27 HTTP/1.1" 200 None
2026-03-29 22:01:21 [bca.uk] INFO: Scrape type for LG21%20WJX: 2
2026-03-29 22:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9133ac4c-0000-553a-bf45-dd85407ab23a with identifier: LG21%20WJX
2026-03-29 22:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9133ac4c-0000-553a-bf45-dd85407ab23a with scrape type 2
2026-03-29 22:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9133ac4c-0000-553a-bf45-dd85407ab23a with scrape type 2
2026-03-29 22:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9133ac4c-0000-553a-bf45-dd85407ab23a, identifier: LG21%20WJX
2026-03-29 22:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5 with identifier: EX10%20BXE
2026-03-29 22:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5 with identifier: EX10%20BXE
2026-03-29 22:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5 with identifier: EX10%20BXE to the API
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EX10%20BXE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f5f9bed7-96bb-5ef8-8a52-e232dbf0b7d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EX10 BXE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EX10%20BXE&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 87635,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.6 ZETEC S Hatchback',
'transmission': 'manual',
'trim': 'ZETEC S',
'vin': 'WF0GXXGAJGAY09442',
'year': 2010}
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX10%2520BXE%27 HTTP/1.1" 200 None
2026-03-29 22:01:21 [bca.uk] INFO: Saving data for EX10%20BXE: {'auction_closing_time': 1774951200.0, 'created_time': 1774706598.922582, 'last_price_update_time': 1774821681.991738}
2026-03-29 22:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EX10%2520BXE') HTTP/1.1" 204 0
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073235%27 HTTP/1.1" 200 None
2026-03-29 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073235 not downloaded yet
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023450%27 HTTP/1.1" 200 None
2026-03-29 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023450 not downloaded yet
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246789%27 HTTP/1.1" 200 None
2026-03-29 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246789 not downloaded yet
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699457252%27 HTTP/1.1" 200 None
2026-03-29 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457252 not downloaded yet
2026-03-29 22:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9133ac4c-0000-553a-bf45-dd85407ab23a with identifier: LG21%20WJX
2026-03-29 22:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9133ac4c-0000-553a-bf45-dd85407ab23a with identifier: LG21%20WJX
2026-03-29 22:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9133ac4c-0000-553a-bf45-dd85407ab23a with identifier: LG21%20WJX to the API
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 153,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LG21%20WJX-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9133ac4c-0000-553a-bf45-dd85407ab23a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LG21 WJX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LG21%20WJX&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'CITROEN',
'model': 'BERLINGO M',
'odometer': 105824,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'CITROEN BERLINGO M 1.5 BLUEHDI 130 1000 ENTERPRISE(8) Van',
'transmission': 'automatic',
'trim': 'BLUEHDI 130 1000 ENTERPRISE(8)',
'vin': 'VR7EFYHZRMJ594532',
'year': 2021}
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG21%2520WJX%27 HTTP/1.1" 200 None
2026-03-29 22:01:22 [bca.uk] INFO: Saving data for LG21%20WJX: {'auction_closing_time': 1775037600.0, 'created_time': 1774274572.599611, 'last_price_update_time': 1774821682.502324}
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LG21%2520WJX') HTTP/1.1" 204 0
2026-03-29 22:01:22 [bca.uk] INFO: Found listing with ID: LF67%20FSE
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF67%2520FSE%27 HTTP/1.1" 200 None
2026-03-29 22:01:22 [bca.uk] INFO: Scrape type for LF67%20FSE: 2
2026-03-29 22:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d79ecda5-7b2e-55f5-9be8-d1bd6ad8cacd with identifier: LF67%20FSE
2026-03-29 22:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d79ecda5-7b2e-55f5-9be8-d1bd6ad8cacd with scrape type 2
2026-03-29 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d79ecda5-7b2e-55f5-9be8-d1bd6ad8cacd with scrape type 2
2026-03-29 22:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d79ecda5-7b2e-55f5-9be8-d1bd6ad8cacd, identifier: LF67%20FSE
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699211077%27 HTTP/1.1" 200 None
2026-03-29 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699211077 not downloaded yet
2026-03-29 22:01:22 [bca.uk] INFO: Found listing with ID: FX12%20YZO
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX12%2520YZO%27 HTTP/1.1" 200 None
2026-03-29 22:01:22 [bca.uk] INFO: Scrape type for FX12%20YZO: 0
2026-03-29 22:01:22 [bca.uk] INFO: Found listing with ID: GF10%20FSY
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF10%2520FSY%27 HTTP/1.1" 200 None
2026-03-29 22:01:22 [bca.uk] INFO: Scrape type for GF10%20FSY: 2
2026-03-29 22:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 758db1f9-d737-5506-abd8-56c685b3eaa7 with identifier: GF10%20FSY
2026-03-29 22:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 758db1f9-d737-5506-abd8-56c685b3eaa7 with scrape type 2
2026-03-29 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 758db1f9-d737-5506-abd8-56c685b3eaa7 with scrape type 2
2026-03-29 22:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 758db1f9-d737-5506-abd8-56c685b3eaa7, identifier: GF10%20FSY
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699242976%27 HTTP/1.1" 200 None
2026-03-29 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242976 not downloaded yet
2026-03-29 22:01:22 [bca.uk] INFO: Found listing with ID: WJ70%20FPX
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ70%2520FPX%27 HTTP/1.1" 200 None
2026-03-29 22:01:22 [bca.uk] INFO: Scrape type for WJ70%20FPX: 2
2026-03-29 22:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 172135bb-25b0-52f9-8f7f-54ad34f9b0fc with identifier: WJ70%20FPX
2026-03-29 22:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 172135bb-25b0-52f9-8f7f-54ad34f9b0fc with scrape type 2
2026-03-29 22:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 172135bb-25b0-52f9-8f7f-54ad34f9b0fc with scrape type 2
2026-03-29 22:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 172135bb-25b0-52f9-8f7f-54ad34f9b0fc, identifier: WJ70%20FPX
2026-03-29 22:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d79ecda5-7b2e-55f5-9be8-d1bd6ad8cacd with identifier: LF67%20FSE
2026-03-29 22:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d79ecda5-7b2e-55f5-9be8-d1bd6ad8cacd with identifier: LF67%20FSE
2026-03-29 22:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d79ecda5-7b2e-55f5-9be8-d1bd6ad8cacd with identifier: LF67%20FSE to the API
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LF67%20FSE-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd79ecda5-7b2e-55f5-9be8-d1bd6ad8cacd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LF67 FSE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LF67%20FSE&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'TRANSIT 410 RWD',
'odometer': 25515,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FORD TRANSIT 410 RWD 2.2 TDCI 155 LWB TREND H/R Bus',
'transmission': 'manual',
'trim': 'TDCI 155 LWB TREND H/R',
'vin': 'WF0HXXTTGHHB58212',
'year': 2017}
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF67%2520FSE%27 HTTP/1.1" 200 None
2026-03-29 22:01:23 [bca.uk] INFO: Saving data for LF67%20FSE: {'auction_closing_time': 1775037600.0, 'created_time': 1774188640.807951, 'last_price_update_time': 1774821683.256047}
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LF67%2520FSE') HTTP/1.1" 204 0
2026-03-29 22:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 758db1f9-d737-5506-abd8-56c685b3eaa7 with identifier: GF10%20FSY
2026-03-29 22:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 758db1f9-d737-5506-abd8-56c685b3eaa7 with identifier: GF10%20FSY
2026-03-29 22:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 758db1f9-d737-5506-abd8-56c685b3eaa7 with identifier: GF10%20FSY to the API
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF10%20FSY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '758db1f9-d737-5506-abd8-56c685b3eaa7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF10 FSY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF10%20FSY&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'TOYOTA',
'model': 'AVENSIS',
'odometer': 82346,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'TOYOTA AVENSIS 2.0 D-4D TR Estate',
'transmission': 'manual',
'trim': 'D-4D TR',
'vin': 'SB1ED76L20E036686',
'year': 2010}
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF10%2520FSY%27 HTTP/1.1" 200 None
2026-03-29 22:01:23 [bca.uk] INFO: Saving data for GF10%20FSY: {'auction_closing_time': 1774951200.0, 'created_time': 1774706978.384182, 'last_price_update_time': 1774821683.593363}
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF10%2520FSY') HTTP/1.1" 204 0
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073258%27 HTTP/1.1" 200 None
2026-03-29 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073258 not downloaded yet
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023478%27 HTTP/1.1" 200 None
2026-03-29 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023478 not downloaded yet
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246805%27 HTTP/1.1" 200 None
2026-03-29 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246805 not downloaded yet
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699457253%27 HTTP/1.1" 200 None
2026-03-29 22:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457253 not downloaded yet
2026-03-29 22:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 172135bb-25b0-52f9-8f7f-54ad34f9b0fc with identifier: WJ70%20FPX
2026-03-29 22:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 172135bb-25b0-52f9-8f7f-54ad34f9b0fc with identifier: WJ70%20FPX
2026-03-29 22:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 172135bb-25b0-52f9-8f7f-54ad34f9b0fc with identifier: WJ70%20FPX to the API
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 205,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ70%20FPX-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '172135bb-25b0-52f9-8f7f-54ad34f9b0fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ70 FPX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ70%20FPX&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'CRAFTER 35 FWD',
'odometer': 191045,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN CRAFTER 35 FWD 2.0 TDI 140 LWB T/L H/R PanelVan',
'transmission': 'manual',
'trim': 'TDI 140 LWB T/L H/R',
'vin': 'WV1ZZZSYZL9054703',
'year': 2020}
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ70%2520FPX%27 HTTP/1.1" 200 None
2026-03-29 22:01:24 [bca.uk] INFO: Saving data for WJ70%20FPX: {'auction_closing_time': 1775037600.0, 'created_time': 1774304791.312122, 'last_price_update_time': 1774821684.022482}
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ70%2520FPX') HTTP/1.1" 204 0
2026-03-29 22:01:24 [bca.uk] INFO: Found listing with ID: LT64%20BWF
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT64%2520BWF%27 HTTP/1.1" 200 None
2026-03-29 22:01:24 [bca.uk] INFO: Scrape type for LT64%20BWF: 1
2026-03-29 22:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c286c031-4c72-5d7f-8c06-04157dc85649 with identifier: LT64%20BWF
2026-03-29 22:01:24 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c286c031-4c72-5d7f-8c06-04157dc85649
2026-03-29 22:01:24 [bca.uk] INFO: Found listing with ID: GF57%20MWW
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF57%2520MWW%27 HTTP/1.1" 200 None
2026-03-29 22:01:24 [bca.uk] INFO: Scrape type for GF57%20MWW: 2
2026-03-29 22:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdcc838c-10d3-5f36-90c6-59ef07eececc with identifier: GF57%20MWW
2026-03-29 22:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdcc838c-10d3-5f36-90c6-59ef07eececc with scrape type 2
2026-03-29 22:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdcc838c-10d3-5f36-90c6-59ef07eececc with scrape type 2
2026-03-29 22:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cdcc838c-10d3-5f36-90c6-59ef07eececc, identifier: GF57%20MWW
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699242996%27 HTTP/1.1" 200 None
2026-03-29 22:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242996 not downloaded yet
2026-03-29 22:01:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457251/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457251>
2026-03-29 22:01:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246776/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246776>
2026-03-29 22:01:24 [bca.uk] INFO: Found listing with ID: BG20%20KFL
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG20%2520KFL%27 HTTP/1.1" 200 None
2026-03-29 22:01:24 [bca.uk] INFO: Scrape type for BG20%20KFL: 0
2026-03-29 22:01:24 [bca.uk] INFO: Found listing with ID: GF14%20ZWW
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF14%2520ZWW%27 HTTP/1.1" 200 None
2026-03-29 22:01:24 [bca.uk] INFO: Scrape type for GF14%20ZWW: 0
2026-03-29 22:01:24 [bca.uk] INFO: Found listing with ID: BD13%20XHZ
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD13%2520XHZ%27 HTTP/1.1" 200 None
2026-03-29 22:01:24 [bca.uk] INFO: Scrape type for BD13%20XHZ: 0
2026-03-29 22:01:24 [bca.uk] INFO: Found listing with ID: NX66%20UNL
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX66%2520UNL%27 HTTP/1.1" 200 None
2026-03-29 22:01:24 [bca.uk] INFO: Scrape type for NX66%20UNL: 0
2026-03-29 22:01:24 [bca.uk] INFO: Found listing with ID: SA71%20KKC
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA71%2520KKC%27 HTTP/1.1" 200 None
2026-03-29 22:01:24 [bca.uk] INFO: Scrape type for SA71%20KKC: 2
2026-03-29 22:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7de1708-c34f-5ab2-a6f2-70cc1189a8dd with identifier: SA71%20KKC
2026-03-29 22:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7de1708-c34f-5ab2-a6f2-70cc1189a8dd with scrape type 2
2026-03-29 22:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7de1708-c34f-5ab2-a6f2-70cc1189a8dd with scrape type 2
2026-03-29 22:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b7de1708-c34f-5ab2-a6f2-70cc1189a8dd, identifier: SA71%20KKC
2026-03-29 22:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cdcc838c-10d3-5f36-90c6-59ef07eececc with identifier: GF57%20MWW
2026-03-29 22:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cdcc838c-10d3-5f36-90c6-59ef07eececc with identifier: GF57%20MWW
2026-03-29 22:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cdcc838c-10d3-5f36-90c6-59ef07eececc with identifier: GF57%20MWW to the API
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 216,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF57%20MWW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'cdcc838c-10d3-5f36-90c6-59ef07eececc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF57 MWW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF57%20MWW&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 139336,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'NISSAN X-TRAIL 2.0 DCI SPORT StationWagon',
'transmission': 'automatic',
'trim': 'DCI SPORT',
'vin': 'JN1TCNT31U0009236',
'year': 2007}
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF57%2520MWW%27 HTTP/1.1" 200 None
2026-03-29 22:01:24 [bca.uk] INFO: Saving data for GF57%20MWW: {'auction_closing_time': 1774951200.0, 'created_time': 1774706598.092464, 'last_price_update_time': 1774821684.743508}
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF57%2520MWW') HTTP/1.1" 204 0
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073271%27 HTTP/1.1" 200 None
2026-03-29 22:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073271 not downloaded yet
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023576%27 HTTP/1.1" 200 None
2026-03-29 22:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023576 not downloaded yet
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246821%27 HTTP/1.1" 200 None
2026-03-29 22:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246821 not downloaded yet
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699457254%27 HTTP/1.1" 200 None
2026-03-29 22:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457254 not downloaded yet
2026-03-29 22:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b7de1708-c34f-5ab2-a6f2-70cc1189a8dd with identifier: SA71%20KKC
2026-03-29 22:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b7de1708-c34f-5ab2-a6f2-70cc1189a8dd with identifier: SA71%20KKC
2026-03-29 22:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b7de1708-c34f-5ab2-a6f2-70cc1189a8dd with identifier: SA71%20KKC to the API
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 209,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SA71%20KKC-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b7de1708-c34f-5ab2-a6f2-70cc1189a8dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SA71 KKC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SA71%20KKC&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FIAT',
'model': 'DOBLO CARGO',
'odometer': 102114,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'FIAT DOBLO CARGO 1.6 M/JET 105 LWB WORK UP S/S Dropside',
'transmission': 'manual',
'trim': 'M/JET 105 LWB WORK UP S/S',
'vin': 'ZFA26300006V24819',
'year': 2021}
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA71%2520KKC%27 HTTP/1.1" 200 None
2026-03-29 22:01:25 [bca.uk] INFO: Saving data for SA71%20KKC: {'auction_closing_time': 1775037600.0, 'created_time': 1774365788.050828, 'last_price_update_time': 1774821685.26599}
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SA71%2520KKC') HTTP/1.1" 204 0
2026-03-29 22:01:25 [bca.uk] INFO: Found listing with ID: LX68%20ORU
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX68%2520ORU%27 HTTP/1.1" 200 None
2026-03-29 22:01:25 [bca.uk] INFO: Scrape type for LX68%20ORU: 1
2026-03-29 22:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0556e924-104a-5552-a701-fc5b5327996f with identifier: LX68%20ORU
2026-03-29 22:01:25 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0556e924-104a-5552-a701-fc5b5327996f
2026-03-29 22:01:25 [bca.uk] INFO: Found listing with ID: KB57%20YOG
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KB57%2520YOG%27 HTTP/1.1" 200 None
2026-03-29 22:01:25 [bca.uk] INFO: Scrape type for KB57%20YOG: 0
2026-03-29 22:01:25 [bca.uk] INFO: Found listing with ID: LB60%20DWY
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB60%2520DWY%27 HTTP/1.1" 200 None
2026-03-29 22:01:25 [bca.uk] INFO: Scrape type for LB60%20DWY: 0
2026-03-29 22:01:25 [bca.uk] INFO: Found listing with ID: LL09%20JMU
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL09%2520JMU%27 HTTP/1.1" 200 None
2026-03-29 22:01:25 [bca.uk] INFO: Scrape type for LL09%20JMU: 2
2026-03-29 22:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 235de476-54fd-5482-aa9c-f9758fabd7a4 with identifier: LL09%20JMU
2026-03-29 22:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 235de476-54fd-5482-aa9c-f9758fabd7a4 with scrape type 2
2026-03-29 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 235de476-54fd-5482-aa9c-f9758fabd7a4 with scrape type 2
2026-03-29 22:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 235de476-54fd-5482-aa9c-f9758fabd7a4, identifier: LL09%20JMU
2026-03-29 22:01:25 [bca.uk] INFO: Found listing with ID: CP19%20KFJ
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP19%2520KFJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:25 [bca.uk] INFO: Scrape type for CP19%20KFJ: 2
2026-03-29 22:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1932effe-01ba-5c46-8437-cad15752aaa0 with identifier: CP19%20KFJ
2026-03-29 22:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1932effe-01ba-5c46-8437-cad15752aaa0 with scrape type 2
2026-03-29 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1932effe-01ba-5c46-8437-cad15752aaa0 with scrape type 2
2026-03-29 22:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1932effe-01ba-5c46-8437-cad15752aaa0, identifier: CP19%20KFJ
2026-03-29 22:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 235de476-54fd-5482-aa9c-f9758fabd7a4 with identifier: LL09%20JMU
2026-03-29 22:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 235de476-54fd-5482-aa9c-f9758fabd7a4 with identifier: LL09%20JMU
2026-03-29 22:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 235de476-54fd-5482-aa9c-f9758fabd7a4 with identifier: LL09%20JMU to the API
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LL09%20JMU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '235de476-54fd-5482-aa9c-f9758fabd7a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL09 JMU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LL09%20JMU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'TOYOTA',
'model': 'IQ',
'odometer': 145266,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'TOYOTA IQ 1.0 VVT-I 2 Hatchback',
'transmission': 'automatic',
'trim': 'VVT-I 2',
'vin': 'JTNML11090J030875',
'year': 2009}
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL09%2520JMU%27 HTTP/1.1" 200 None
2026-03-29 22:01:25 [bca.uk] INFO: Saving data for LL09%20JMU: {'auction_closing_time': 1774951200.0, 'created_time': 1774418896.117705, 'last_price_update_time': 1774821685.890431}
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LL09%2520JMU') HTTP/1.1" 204 0
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023613%27 HTTP/1.1" 200 None
2026-03-29 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023613 not downloaded yet
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699246836%27 HTTP/1.1" 200 None
2026-03-29 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246836 not downloaded yet
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699457256%27 HTTP/1.1" 200 None
2026-03-29 22:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457256 not downloaded yet
2026-03-29 22:01:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023429/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023429>
2026-03-29 22:01:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073213/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073213>
2026-03-29 22:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1932effe-01ba-5c46-8437-cad15752aaa0 with identifier: CP19%20KFJ
2026-03-29 22:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1932effe-01ba-5c46-8437-cad15752aaa0 with identifier: CP19%20KFJ
2026-03-29 22:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1932effe-01ba-5c46-8437-cad15752aaa0 with identifier: CP19%20KFJ to the API
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CP19%20KFJ-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 6,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1932effe-01ba-5c46-8437-cad15752aaa0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CP19 KFJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CP19%20KFJ&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VOLKSWAGEN',
'model': 'CADDY MAXI C20',
'odometer': 71357,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN CADDY MAXI C20 2.0 TDI 102 BMT KOMBI CrewCab Van',
'transmission': 'manual',
'trim': 'TDI 102 BMT KOMBI',
'vin': 'WV1ZZZ2KZKX051619',
'year': 2019}
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP19%2520KFJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:26 [bca.uk] INFO: Saving data for CP19%20KFJ: {'auction_closing_time': 1775037600.0, 'created_time': 1774523538.356845, 'last_price_update_time': 1774821686.356102}
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CP19%2520KFJ') HTTP/1.1" 204 0
2026-03-29 22:01:26 [bca.uk] INFO: Found listing with ID: MJ69%20VDN
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ69%2520VDN%27 HTTP/1.1" 200 None
2026-03-29 22:01:26 [bca.uk] INFO: Scrape type for MJ69%20VDN: 0
2026-03-29 22:01:26 [bca.uk] INFO: Found listing with ID: RK70%20VND
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK70%2520VND%27 HTTP/1.1" 200 None
2026-03-29 22:01:26 [bca.uk] INFO: Scrape type for RK70%20VND: 2
2026-03-29 22:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9221c30e-44b9-505e-8bb3-a606619f22f0 with identifier: RK70%20VND
2026-03-29 22:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9221c30e-44b9-505e-8bb3-a606619f22f0 with scrape type 2
2026-03-29 22:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9221c30e-44b9-505e-8bb3-a606619f22f0 with scrape type 2
2026-03-29 22:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9221c30e-44b9-505e-8bb3-a606619f22f0, identifier: RK70%20VND
2026-03-29 22:01:26 [bca.uk] INFO: Found listing with ID: LR11%20XWM
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR11%2520XWM%27 HTTP/1.1" 200 None
2026-03-29 22:01:26 [bca.uk] INFO: Scrape type for LR11%20XWM: 2
2026-03-29 22:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e with identifier: LR11%20XWM
2026-03-29 22:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e with scrape type 2
2026-03-29 22:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e with scrape type 2
2026-03-29 22:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e, identifier: LR11%20XWM
2026-03-29 22:01:26 [bca.uk] INFO: Found listing with ID: MW72%20VBF
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW72%2520VBF%27 HTTP/1.1" 200 None
2026-03-29 22:01:26 [bca.uk] INFO: Scrape type for MW72%20VBF: 0
2026-03-29 22:01:26 [bca.uk] INFO: Found listing with ID: SD57%20CYU
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD57%2520CYU%27 HTTP/1.1" 200 None
2026-03-29 22:01:26 [bca.uk] INFO: Scrape type for SD57%20CYU: 0
2026-03-29 22:01:26 [bca.uk] INFO: Found listing with ID: SM16%20KFW
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM16%2520KFW%27 HTTP/1.1" 200 None
2026-03-29 22:01:26 [bca.uk] INFO: Scrape type for SM16%20KFW: 0
2026-03-29 22:01:26 [bca.uk] INFO: Found listing with ID: FE73%20ZRF
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE73%2520ZRF%27 HTTP/1.1" 200 None
2026-03-29 22:01:26 [bca.uk] INFO: Scrape type for FE73%20ZRF: 0
2026-03-29 22:01:26 [bca.uk] INFO: Found listing with ID: NX25%20UWF
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX25%2520UWF%27 HTTP/1.1" 200 None
2026-03-29 22:01:26 [bca.uk] INFO: Scrape type for NX25%20UWF: 0
2026-03-29 22:01:26 [bca.uk] INFO: Found listing with ID: WG69%20VDE
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG69%2520VDE%27 HTTP/1.1" 200 None
2026-03-29 22:01:26 [bca.uk] INFO: Scrape type for WG69%20VDE: 2
2026-03-29 22:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05a31599-7a81-5351-8e0c-bb5190d331ee with identifier: WG69%20VDE
2026-03-29 22:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05a31599-7a81-5351-8e0c-bb5190d331ee with scrape type 2
2026-03-29 22:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05a31599-7a81-5351-8e0c-bb5190d331ee with scrape type 2
2026-03-29 22:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 05a31599-7a81-5351-8e0c-bb5190d331ee, identifier: WG69%20VDE
2026-03-29 22:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9221c30e-44b9-505e-8bb3-a606619f22f0 with identifier: RK70%20VND
2026-03-29 22:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9221c30e-44b9-505e-8bb3-a606619f22f0 with identifier: RK70%20VND
2026-03-29 22:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9221c30e-44b9-505e-8bb3-a606619f22f0 with identifier: RK70%20VND to the API
2026-03-29 22:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 165,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RK70%20VND-GB',
'category': 'LightCommercialVehicle',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9221c30e-44b9-505e-8bb3-a606619f22f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RK70 VND',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RK70%20VND&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'TRANSPORTER T30',
'odometer': 85265,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TRANSPORTER T30 2.0 BITDI 199 LWB H/L DSG PanelVan',
'transmission': 'automatic',
'trim': 'BITDI 199 LWB H/L DSG',
'vin': 'WV1ZZZ7HZLH034580',
'year': 2020}
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK70%2520VND%27 HTTP/1.1" 200 None
2026-03-29 22:01:27 [bca.uk] INFO: Saving data for RK70%20VND: {'auction_closing_time': 1775037600.0, 'created_time': 1774524530.42819, 'last_price_update_time': 1774821687.150793}
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RK70%2520VND') HTTP/1.1" 204 0
2026-03-29 22:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e with identifier: LR11%20XWM
2026-03-29 22:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e with identifier: LR11%20XWM
2026-03-29 22:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e with identifier: LR11%20XWM to the API
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR11%20XWM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0b12c0fe-3ab8-5445-ad6b-256ccebc3b9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR11 XWM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LR11%20XWM&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 151294,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'HONDA CR-V 2.2 I-DTEC EX Estate',
'transmission': 'automatic',
'trim': 'I-DTEC EX',
'vin': 'SHSRE6870BU008503',
'year': 2011}
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR11%2520XWM%27 HTTP/1.1" 200 None
2026-03-29 22:01:27 [bca.uk] INFO: Saving data for LR11%20XWM: {'auction_closing_time': 1774951200.0, 'created_time': 1774706632.016031, 'last_price_update_time': 1774821687.602291}
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LR11%2520XWM') HTTP/1.1" 204 0
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699457259%27 HTTP/1.1" 200 None
2026-03-29 22:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457259 not downloaded yet
2026-03-29 22:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 05a31599-7a81-5351-8e0c-bb5190d331ee with identifier: WG69%20VDE
2026-03-29 22:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 05a31599-7a81-5351-8e0c-bb5190d331ee with identifier: WG69%20VDE
2026-03-29 22:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 05a31599-7a81-5351-8e0c-bb5190d331ee with identifier: WG69%20VDE to the API
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 231,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WG69%20VDE-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '05a31599-7a81-5351-8e0c-bb5190d331ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WG69 VDE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WG69%20VDE&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'VOLKSWAGEN',
'model': 'AMAROK A33',
'odometer': 82475,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN AMAROK A33 3.0 V6 TDI 204 BMT HIGHLINE 4M CrewCab '
'Pick-up',
'transmission': 'manual',
'trim': 'V6 TDI 204 BMT HIGHLINE 4M',
'vin': 'WV1ZZZ2HZLH011931',
'year': 2019}
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG69%2520VDE%27 HTTP/1.1" 200 None
2026-03-29 22:01:27 [bca.uk] INFO: Saving data for WG69%20VDE: {'auction_closing_time': 1774951200.0, 'created_time': 1774524448.591522, 'last_price_update_time': 1774821687.991825}
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WG69%2520VDE') HTTP/1.1" 204 0
2026-03-29 22:01:28 [bca.uk] INFO: Found listing with ID: CX05%20YUG
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX05%2520YUG%27 HTTP/1.1" 200 None
2026-03-29 22:01:28 [bca.uk] INFO: Scrape type for CX05%20YUG: 1
2026-03-29 22:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f8e435e-d477-50a3-aea7-4952aa2ce397 with identifier: CX05%20YUG
2026-03-29 22:01:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9f8e435e-d477-50a3-aea7-4952aa2ce397
2026-03-29 22:01:28 [bca.uk] INFO: Found listing with ID: FL18%20SXT
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL18%2520SXT%27 HTTP/1.1" 200 None
2026-03-29 22:01:28 [bca.uk] INFO: Scrape type for FL18%20SXT: 0
2026-03-29 22:01:28 [bca.uk] INFO: Found listing with ID: GN64%20WLF
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN64%2520WLF%27 HTTP/1.1" 200 None
2026-03-29 22:01:28 [bca.uk] INFO: Scrape type for GN64%20WLF: 0
2026-03-29 22:01:28 [bca.uk] INFO: Found listing with ID: KR67%20KTX
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR67%2520KTX%27 HTTP/1.1" 200 None
2026-03-29 22:01:28 [bca.uk] INFO: Scrape type for KR67%20KTX: 0
2026-03-29 22:01:28 [bca.uk] INFO: Found listing with ID: EK11%20EKW
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK11%2520EKW%27 HTTP/1.1" 200 None
2026-03-29 22:01:28 [bca.uk] INFO: Scrape type for EK11%20EKW: 0
2026-03-29 22:01:28 [bca.uk] INFO: Found listing with ID: GX16%20XKY
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX16%2520XKY%27 HTTP/1.1" 200 None
2026-03-29 22:01:28 [bca.uk] INFO: Scrape type for GX16%20XKY: 2
2026-03-29 22:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 910a75ab-5151-5937-9c64-ec8e4308b234 with identifier: GX16%20XKY
2026-03-29 22:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 910a75ab-5151-5937-9c64-ec8e4308b234 with scrape type 2
2026-03-29 22:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 910a75ab-5151-5937-9c64-ec8e4308b234 with scrape type 2
2026-03-29 22:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 910a75ab-5151-5937-9c64-ec8e4308b234, identifier: GX16%20XKY
2026-03-29 22:01:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211049/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699211049>
2026-03-29 22:01:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242935/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242935>
2026-03-29 22:01:28 [bca.uk] INFO: Found listing with ID: DN23%20HTG
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN23%2520HTG%27 HTTP/1.1" 200 None
2026-03-29 22:01:28 [bca.uk] INFO: Scrape type for DN23%20HTG: 2
2026-03-29 22:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d11ba757-62a3-52a4-8879-a31869fb93f5 with identifier: DN23%20HTG
2026-03-29 22:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d11ba757-62a3-52a4-8879-a31869fb93f5 with scrape type 2
2026-03-29 22:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d11ba757-62a3-52a4-8879-a31869fb93f5 with scrape type 2
2026-03-29 22:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d11ba757-62a3-52a4-8879-a31869fb93f5, identifier: DN23%20HTG
2026-03-29 22:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 910a75ab-5151-5937-9c64-ec8e4308b234 with identifier: GX16%20XKY
2026-03-29 22:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 910a75ab-5151-5937-9c64-ec8e4308b234 with identifier: GX16%20XKY
2026-03-29 22:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 910a75ab-5151-5937-9c64-ec8e4308b234 with identifier: GX16%20XKY to the API
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GX16%20XKY-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '910a75ab-5151-5937-9c64-ec8e4308b234',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GX16 XKY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GX16%20XKY&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 43857,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.2 DIG-T N-CONNECTA Hatchback',
'transmission': 'automatic',
'trim': 'DIG-T N-CONNECTA',
'vin': 'SJNFEAJ11U1631899',
'year': 2016}
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX16%2520XKY%27 HTTP/1.1" 200 None
2026-03-29 22:01:28 [bca.uk] INFO: Saving data for GX16%20XKY: {'auction_closing_time': 1774951200.0, 'created_time': 1774391942.236272, 'last_price_update_time': 1774821688.726952}
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GX16%2520XKY') HTTP/1.1" 204 0
2026-03-29 22:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d11ba757-62a3-52a4-8879-a31869fb93f5 with identifier: DN23%20HTG
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=cream HTTP/1.1" 200 None
2026-03-29 22:01:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d11ba757-62a3-52a4-8879-a31869fb93f5 with identifier: DN23%20HTG
2026-03-29 22:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d11ba757-62a3-52a4-8879-a31869fb93f5 with identifier: DN23%20HTG to the API
2026-03-29 22:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 173,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DN23%20HTG-GB',
'category': 'LightCommercialVehicle',
'color': 'cream',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.5L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd11ba757-62a3-52a4-8879-a31869fb93f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DN23 HTG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DN23%20HTG&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'SUZUKI',
'model': 'JIMNY',
'odometer': 1383,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'SUZUKI JIMNY 1.5 ALLGRIP COMMERCIAL Van',
'transmission': 'manual',
'trim': 'ALLGRIP COMMERCIAL',
'vin': 'JSAHJB74B00129980',
'year': 2023}
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN23%2520HTG%27 HTTP/1.1" 200 None
2026-03-29 22:01:29 [bca.uk] INFO: Saving data for DN23%20HTG: {'auction_closing_time': 1775037600.0, 'created_time': 1774523256.380201, 'last_price_update_time': 1774821689.227346}
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DN23%2520HTG') HTTP/1.1" 204 0
2026-03-29 22:01:29 [bca.uk] INFO: Found listing with ID: LP66%20SVX
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP66%2520SVX%27 HTTP/1.1" 200 None
2026-03-29 22:01:29 [bca.uk] INFO: Scrape type for LP66%20SVX: 1
2026-03-29 22:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 392ba6d2-142e-521e-9c14-6f3c87e57d15 with identifier: LP66%20SVX
2026-03-29 22:01:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 392ba6d2-142e-521e-9c14-6f3c87e57d15
2026-03-29 22:01:29 [bca.uk] INFO: Found listing with ID: KM67%20WBP
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM67%2520WBP%27 HTTP/1.1" 200 None
2026-03-29 22:01:29 [bca.uk] INFO: Scrape type for KM67%20WBP: 2
2026-03-29 22:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e944d65b-4e9e-513c-a6ae-acea2437087d with identifier: KM67%20WBP
2026-03-29 22:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e944d65b-4e9e-513c-a6ae-acea2437087d with scrape type 2
2026-03-29 22:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e944d65b-4e9e-513c-a6ae-acea2437087d with scrape type 2
2026-03-29 22:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e944d65b-4e9e-513c-a6ae-acea2437087d, identifier: KM67%20WBP
2026-03-29 22:01:29 [bca.uk] INFO: Found listing with ID: YG23%20WLF
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG23%2520WLF%27 HTTP/1.1" 200 None
2026-03-29 22:01:29 [bca.uk] INFO: Scrape type for YG23%20WLF: 0
2026-03-29 22:01:29 [bca.uk] INFO: Found listing with ID: C8%20SUP
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27C8%2520SUP%27 HTTP/1.1" 200 None
2026-03-29 22:01:29 [bca.uk] INFO: Scrape type for C8%20SUP: 0
2026-03-29 22:01:29 [bca.uk] INFO: Found listing with ID: YX17%20UST
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX17%2520UST%27 HTTP/1.1" 200 None
2026-03-29 22:01:29 [bca.uk] INFO: Scrape type for YX17%20UST: 0
2026-03-29 22:01:29 [bca.uk] INFO: Found listing with ID: EO21%20SJV
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO21%2520SJV%27 HTTP/1.1" 200 None
2026-03-29 22:01:29 [bca.uk] INFO: Scrape type for EO21%20SJV: 2
2026-03-29 22:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8ad826d-d8ff-545b-9099-19954146acfb with identifier: EO21%20SJV
2026-03-29 22:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8ad826d-d8ff-545b-9099-19954146acfb with scrape type 2
2026-03-29 22:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8ad826d-d8ff-545b-9099-19954146acfb with scrape type 2
2026-03-29 22:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e8ad826d-d8ff-545b-9099-19954146acfb, identifier: EO21%20SJV
2026-03-29 22:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e944d65b-4e9e-513c-a6ae-acea2437087d with identifier: KM67%20WBP
2026-03-29 22:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e944d65b-4e9e-513c-a6ae-acea2437087d with identifier: KM67%20WBP
2026-03-29 22:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e944d65b-4e9e-513c-a6ae-acea2437087d with identifier: KM67%20WBP to the API
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 49,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM67%20WBP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'e944d65b-4e9e-513c-a6ae-acea2437087d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM67 WBP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM67%20WBP&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLVO',
'model': 'XC90',
'odometer': 157626,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'VOLVO XC90 2.0 T8 T/E INSCRIPTION PRO G/T StationWagon',
'transmission': 'manual',
'trim': 'T8 T/E INSCRIPTION PRO G/T',
'vin': 'YV1LFBABDJ1332484',
'year': 2017}
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM67%2520WBP%27 HTTP/1.1" 200 None
2026-03-29 22:01:29 [bca.uk] INFO: Saving data for KM67%20WBP: {'auction_closing_time': 1774951200.0, 'created_time': 1774706564.233436, 'last_price_update_time': 1774821689.931468}
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM67%2520WBP') HTTP/1.1" 204 0
2026-03-29 22:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e8ad826d-d8ff-545b-9099-19954146acfb with identifier: EO21%20SJV
2026-03-29 22:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e8ad826d-d8ff-545b-9099-19954146acfb with identifier: EO21%20SJV
2026-03-29 22:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e8ad826d-d8ff-545b-9099-19954146acfb with identifier: EO21%20SJV to the API
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 244,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO21%20SJV-GB',
'category': 'LightCommercialVehicle',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e8ad826d-d8ff-545b-9099-19954146acfb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EO21 SJV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EO21%20SJV&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'FORD',
'model': 'RANGER',
'odometer': 69849,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'FORD RANGER 2.0 EBL 213 WILDTRAK CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'EBL 213 WILDTRAK',
'vin': '6FPPXXMJ2PMJ59644',
'year': 2021}
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO21%2520SJV%27 HTTP/1.1" 200 None
2026-03-29 22:01:30 [bca.uk] INFO: Saving data for EO21%20SJV: {'auction_closing_time': 1774951200.0, 'created_time': 1774523284.596605, 'last_price_update_time': 1774821690.439748}
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EO21%2520SJV') HTTP/1.1" 204 0
2026-03-29 22:01:30 [bca.uk] INFO: Found listing with ID: MT19%20KYO
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT19%2520KYO%27 HTTP/1.1" 200 None
2026-03-29 22:01:30 [bca.uk] INFO: Scrape type for MT19%20KYO: 0
2026-03-29 22:01:30 [bca.uk] INFO: Found listing with ID: YM16%20PKU
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM16%2520PKU%27 HTTP/1.1" 200 None
2026-03-29 22:01:30 [bca.uk] INFO: Scrape type for YM16%20PKU: 2
2026-03-29 22:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9719e2c-1d60-5312-b549-1fd9c83f05d9 with identifier: YM16%20PKU
2026-03-29 22:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9719e2c-1d60-5312-b549-1fd9c83f05d9 with scrape type 2
2026-03-29 22:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9719e2c-1d60-5312-b549-1fd9c83f05d9 with scrape type 2
2026-03-29 22:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c9719e2c-1d60-5312-b549-1fd9c83f05d9, identifier: YM16%20PKU
2026-03-29 22:01:30 [bca.uk] INFO: Found listing with ID: LM57%20EYK
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM57%2520EYK%27 HTTP/1.1" 200 None
2026-03-29 22:01:30 [bca.uk] INFO: Scrape type for LM57%20EYK: 0
2026-03-29 22:01:30 [bca.uk] INFO: Found listing with ID: LV63%20DFY
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV63%2520DFY%27 HTTP/1.1" 200 None
2026-03-29 22:01:30 [bca.uk] INFO: Scrape type for LV63%20DFY: 0
2026-03-29 22:01:30 [bca.uk] INFO: Found listing with ID: LX66%20XGU
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX66%2520XGU%27 HTTP/1.1" 200 None
2026-03-29 22:01:30 [bca.uk] INFO: Scrape type for LX66%20XGU: 2
2026-03-29 22:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59e0d1bf-73d7-5811-a0ff-a2a694262d4e with identifier: LX66%20XGU
2026-03-29 22:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59e0d1bf-73d7-5811-a0ff-a2a694262d4e with scrape type 2
2026-03-29 22:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59e0d1bf-73d7-5811-a0ff-a2a694262d4e with scrape type 2
2026-03-29 22:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 59e0d1bf-73d7-5811-a0ff-a2a694262d4e, identifier: LX66%20XGU
2026-03-29 22:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68OTW/42811886?sv=2020-08-04&st=2026-03-29T22%3A01%3A29Z&se=2026-03-29T22%3A26%3A29Z&sr=b&sp=r&sig=fuk2ajppUL%2BpY5Jq%2BLDEOSIJIqcNrPdxnkllkXnrnUc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DU68%20OTW-GB>
2026-03-29 22:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234634/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234634>
2026-03-29 22:01:30 [bca.uk] INFO: Found listing with ID: FT22%20PYB
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT22%2520PYB%27 HTTP/1.1" 200 None
2026-03-29 22:01:30 [bca.uk] INFO: Scrape type for FT22%20PYB: 2
2026-03-29 22:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eae91b04-911a-5b7c-be0e-b1657a8ca392 with identifier: FT22%20PYB
2026-03-29 22:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eae91b04-911a-5b7c-be0e-b1657a8ca392 with scrape type 2
2026-03-29 22:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eae91b04-911a-5b7c-be0e-b1657a8ca392 with scrape type 2
2026-03-29 22:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: eae91b04-911a-5b7c-be0e-b1657a8ca392, identifier: FT22%20PYB
2026-03-29 22:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c9719e2c-1d60-5312-b549-1fd9c83f05d9 with identifier: YM16%20PKU
2026-03-29 22:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c9719e2c-1d60-5312-b549-1fd9c83f05d9 with identifier: YM16%20PKU
2026-03-29 22:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c9719e2c-1d60-5312-b549-1fd9c83f05d9 with identifier: YM16%20PKU to the API
2026-03-29 22:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 170,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM16%20PKU-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c9719e2c-1d60-5312-b549-1fd9c83f05d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YM16 PKU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YM16%20PKU&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'VIVARO 2.7T',
'odometer': 140523,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL VIVARO 2.7T 1.6 CDTI 115 SWB SPORTIVE PanelVan',
'transmission': 'manual',
'trim': 'CDTI 115 SWB SPORTIVE',
'vin': 'W0L3F7002GV652182',
'year': 2016}
2026-03-29 22:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM16%2520PKU%27 HTTP/1.1" 200 None
2026-03-29 22:01:31 [bca.uk] INFO: Saving data for YM16%20PKU: {'auction_closing_time': 1775037600.0, 'created_time': 1774276667.664572, 'last_price_update_time': 1774821691.61873}
2026-03-29 22:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YM16%2520PKU') HTTP/1.1" 204 0
2026-03-29 22:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 59e0d1bf-73d7-5811-a0ff-a2a694262d4e with identifier: LX66%20XGU
2026-03-29 22:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 59e0d1bf-73d7-5811-a0ff-a2a694262d4e with identifier: LX66%20XGU
2026-03-29 22:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 59e0d1bf-73d7-5811-a0ff-a2a694262d4e with identifier: LX66%20XGU to the API
2026-03-29 22:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX66%20XGU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '59e0d1bf-73d7-5811-a0ff-a2a694262d4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LX66 XGU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LX66%20XGU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'S-MAX VIGNALE',
'odometer': 126071,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD S-MAX VIGNALE 2.0 TDCI 210 P/S MPV',
'transmission': 'automatic',
'trim': 'TDCI 210 P/S',
'vin': 'WF0JXXWPCJGK53805',
'year': 2016}
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX66%2520XGU%27 HTTP/1.1" 200 None
2026-03-29 22:01:32 [bca.uk] INFO: Saving data for LX66%20XGU: {'auction_closing_time': 1774951200.0, 'created_time': 1774706560.384624, 'last_price_update_time': 1774821692.139696}
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LX66%2520XGU') HTTP/1.1" 204 0
2026-03-29 22:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411726/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP65LKN/42812099?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=YYiddic%2BqcqY2M0XPOfW0%2FrAPtac9opCHs6%2B5ikpuFw%3D)
2026-03-29 22:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430146/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19VSX/42812111?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=qlSeQUbf83xHqWfD9mYZ2SCAALVwdddlxYHgmUNU2tY%3D)
2026-03-29 22:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414843/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ72FOT/42812096?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=F1eqEFipUoySPGKOeLKkFyyLLItl9dJbMFy96XQcSRY%3D)
2026-03-29 22:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427749/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19VXX/42812304?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=YzGWBhkemG5tXMwAwvYpsWX0bEfwiTWFoG%2FIuzQzr2c%3D)
2026-03-29 22:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427715/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE20EVL/42811999?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=QNaGwsE1HTKndyV7dS5jfLI1ozyFJBkYcrsiWmkuv8k%3D)
2026-03-29 22:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406206/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG69FWY/42811982?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=iIU0ZFwxCrfo9iR2T7l%2BEKiHBXHpV%2FjhvFuNPQMcBwU%3D)
2026-03-29 22:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: eae91b04-911a-5b7c-be0e-b1657a8ca392 with identifier: FT22%20PYB
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 22:01:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: eae91b04-911a-5b7c-be0e-b1657a8ca392 with identifier: FT22%20PYB
2026-03-29 22:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: eae91b04-911a-5b7c-be0e-b1657a8ca392 with identifier: FT22%20PYB to the API
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 126,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FT22%20PYB-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'eae91b04-911a-5b7c-be0e-b1657a8ca392',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FT22 PYB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FT22%20PYB&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'LEXUS',
'model': 'UX 250H',
'odometer': 29443,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'LEXUS UX 250H 2.0 F-SPORT Hatchback',
'transmission': 'automatic',
'trim': 'F-SPORT',
'vin': 'JTHY65BH802128068',
'year': 2022}
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT22%2520PYB%27 HTTP/1.1" 200 None
2026-03-29 22:01:32 [bca.uk] INFO: Saving data for FT22%20PYB: {'auction_closing_time': 1775037600.0, 'created_time': 1773824057.940482, 'last_price_update_time': 1774821692.642921}
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FT22%2520PYB') HTTP/1.1" 204 0
2026-03-29 22:01:32 [bca.uk] INFO: Found listing with ID: AE17%20MKZ
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE17%2520MKZ%27 HTTP/1.1" 200 None
2026-03-29 22:01:32 [bca.uk] INFO: Scrape type for AE17%20MKZ: 0
2026-03-29 22:01:32 [bca.uk] INFO: Found listing with ID: AE20%20WTL
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE20%2520WTL%27 HTTP/1.1" 200 None
2026-03-29 22:01:32 [bca.uk] INFO: Scrape type for AE20%20WTL: 0
2026-03-29 22:01:32 [bca.uk] INFO: Found listing with ID: BL20%20DZB
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL20%2520DZB%27 HTTP/1.1" 200 None
2026-03-29 22:01:32 [bca.uk] INFO: Scrape type for BL20%20DZB: 0
2026-03-29 22:01:32 [bca.uk] INFO: Found listing with ID: GF18%20OOY
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF18%2520OOY%27 HTTP/1.1" 200 None
2026-03-29 22:01:32 [bca.uk] INFO: Scrape type for GF18%20OOY: 2
2026-03-29 22:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4f0a842-15bd-5216-9323-ad2b5e6a8683 with identifier: GF18%20OOY
2026-03-29 22:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4f0a842-15bd-5216-9323-ad2b5e6a8683 with scrape type 2
2026-03-29 22:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4f0a842-15bd-5216-9323-ad2b5e6a8683 with scrape type 2
2026-03-29 22:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d4f0a842-15bd-5216-9323-ad2b5e6a8683, identifier: GF18%20OOY
2026-03-29 22:01:32 [bca.uk] INFO: Found listing with ID: NU70%20NRJ
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU70%2520NRJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:32 [bca.uk] INFO: Scrape type for NU70%20NRJ: 0
2026-03-29 22:01:32 [bca.uk] INFO: Found listing with ID: SF10%20VGU
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF10%2520VGU%27 HTTP/1.1" 200 None
2026-03-29 22:01:32 [bca.uk] INFO: Scrape type for SF10%20VGU: 2
2026-03-29 22:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1354586b-ebdf-50f3-b385-b6477e33ad86 with identifier: SF10%20VGU
2026-03-29 22:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1354586b-ebdf-50f3-b385-b6477e33ad86 with scrape type 2
2026-03-29 22:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1354586b-ebdf-50f3-b385-b6477e33ad86 with scrape type 2
2026-03-29 22:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1354586b-ebdf-50f3-b385-b6477e33ad86, identifier: SF10%20VGU
2026-03-29 22:01:32 [bca.uk] INFO: Found listing with ID: WO70%20CKC
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO70%2520CKC%27 HTTP/1.1" 200 None
2026-03-29 22:01:32 [bca.uk] INFO: Scrape type for WO70%20CKC: 2
2026-03-29 22:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f59a0119-3a39-586e-9e0a-6a5ed8711403 with identifier: WO70%20CKC
2026-03-29 22:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59a0119-3a39-586e-9e0a-6a5ed8711403 with scrape type 2
2026-03-29 22:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f59a0119-3a39-586e-9e0a-6a5ed8711403 with scrape type 2
2026-03-29 22:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f59a0119-3a39-586e-9e0a-6a5ed8711403, identifier: WO70%20CKC
2026-03-29 22:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d4f0a842-15bd-5216-9323-ad2b5e6a8683 with identifier: GF18%20OOY
2026-03-29 22:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d4f0a842-15bd-5216-9323-ad2b5e6a8683 with identifier: GF18%20OOY
2026-03-29 22:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d4f0a842-15bd-5216-9323-ad2b5e6a8683 with identifier: GF18%20OOY to the API
2026-03-29 22:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 183,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF18%20OOY-GB',
'category': 'LightCommercialVehicle',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.3L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd4f0a842-15bd-5216-9323-ad2b5e6a8683',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF18 OOY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF18%20OOY&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'NISSAN',
'model': 'NAVARA',
'odometer': 69696,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'NISSAN NAVARA 2.3 DCI 190 4WD TEKNA CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'DCI 190 4WD TEKNA',
'vin': 'VSKCTND23U0102473',
'year': 2018}
2026-03-29 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF18%2520OOY%27 HTTP/1.1" 200 None
2026-03-29 22:01:33 [bca.uk] INFO: Saving data for GF18%20OOY: {'auction_closing_time': 1774951200.0, 'created_time': 1774277350.592854, 'last_price_update_time': 1774821693.46272}
2026-03-29 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF18%2520OOY') HTTP/1.1" 204 0
2026-03-29 22:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1354586b-ebdf-50f3-b385-b6477e33ad86 with identifier: SF10%20VGU
2026-03-29 22:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1354586b-ebdf-50f3-b385-b6477e33ad86 with identifier: SF10%20VGU
2026-03-29 22:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1354586b-ebdf-50f3-b385-b6477e33ad86 with identifier: SF10%20VGU to the API
2026-03-29 22:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SF10%20VGU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1354586b-ebdf-50f3-b385-b6477e33ad86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SF10 VGU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SF10%20VGU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'TOURAN',
'odometer': 57079,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TOURAN 1.4 (NON UK) DSG MPV',
'transmission': 'automatic',
'trim': '(NON UK) DSG',
'vin': 'WVGZZZ1TZAW077709',
'year': 2023}
2026-03-29 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF10%2520VGU%27 HTTP/1.1" 200 None
2026-03-29 22:01:33 [bca.uk] INFO: Saving data for SF10%20VGU: {'auction_closing_time': 1774951200.0, 'created_time': 1773820662.535659, 'last_price_update_time': 1774821693.955945}
2026-03-29 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SF10%2520VGU') HTTP/1.1" 204 0
2026-03-29 22:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f59a0119-3a39-586e-9e0a-6a5ed8711403 with identifier: WO70%20CKC
2026-03-29 22:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f59a0119-3a39-586e-9e0a-6a5ed8711403 with identifier: WO70%20CKC
2026-03-29 22:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f59a0119-3a39-586e-9e0a-6a5ed8711403 with identifier: WO70%20CKC to the API
2026-03-29 22:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WO70%20CKC-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 6,
'engine': '2.3L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f59a0119-3a39-586e-9e0a-6a5ed8711403',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WO70 CKC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WO70%20CKC&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'RENAULT',
'model': 'MASTER 3.5T FWD',
'odometer': 38406,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'RENAULT MASTER 3.5T FWD 2.3 DCI 150 LM BUSINESS+ PanelVan',
'transmission': 'manual',
'trim': 'DCI 150 LM BUSINESS+',
'vin': 'VF1MA000466800254',
'year': 2021}
2026-03-29 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO70%2520CKC%27 HTTP/1.1" 200 None
2026-03-29 22:01:34 [bca.uk] INFO: Saving data for WO70%20CKC: {'auction_closing_time': 1775037600.0, 'created_time': 1774609418.112833, 'last_price_update_time': 1774821694.351158}
2026-03-29 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WO70%2520CKC') HTTP/1.1" 204 0
2026-03-29 22:01:34 [bca.uk] INFO: Found listing with ID: HK22%20DXB
2026-03-29 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK22%2520DXB%27 HTTP/1.1" 200 None
2026-03-29 22:01:34 [bca.uk] INFO: Scrape type for HK22%20DXB: 2
2026-03-29 22:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec0e0d1e-8a04-54f9-ba50-3f01dcb217c1 with identifier: HK22%20DXB
2026-03-29 22:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec0e0d1e-8a04-54f9-ba50-3f01dcb217c1 with scrape type 2
2026-03-29 22:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec0e0d1e-8a04-54f9-ba50-3f01dcb217c1 with scrape type 2
2026-03-29 22:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ec0e0d1e-8a04-54f9-ba50-3f01dcb217c1, identifier: HK22%20DXB
2026-03-29 22:01:34 [bca.uk] INFO: Found listing with ID: HG18%20UAP
2026-03-29 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG18%2520UAP%27 HTTP/1.1" 200 None
2026-03-29 22:01:34 [bca.uk] INFO: Scrape type for HG18%20UAP: 2
2026-03-29 22:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f094f15d-0ae9-5678-a8f2-3226d9b024b2 with identifier: HG18%20UAP
2026-03-29 22:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f094f15d-0ae9-5678-a8f2-3226d9b024b2 with scrape type 2
2026-03-29 22:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f094f15d-0ae9-5678-a8f2-3226d9b024b2 with scrape type 2
2026-03-29 22:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f094f15d-0ae9-5678-a8f2-3226d9b024b2, identifier: HG18%20UAP
2026-03-29 22:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246776/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST62SYF/42809590?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=r1Z4o1RO41%2Frbsi6j2NujNSq2CIa1MRr3E0xDNV9JdE%3D)
2026-03-29 22:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023429/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12WNS/42810774?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=tTo%2B0xotySQc25NFgljm0ZLwDTnsvqG5v%2FSimEvL7PM%3D)
2026-03-29 22:01:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246766/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246766>
2026-03-29 22:01:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457250/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457250>
2026-03-29 22:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457251/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO58EBF/42810110?sv=2020-08-04&st=2026-03-29T22%3A01%3A02Z&se=2026-03-29T22%3A26%3A02Z&sr=b&sp=r&sig=l1yGxyGiXjxmhLTIgBa00vRGvOItb%2B7FOLk9BOk0TjI%3D)
2026-03-29 22:01:34 [bca.uk] INFO: Found listing with ID: FG11%20WTU
2026-03-29 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG11%2520WTU%27 HTTP/1.1" 200 None
2026-03-29 22:01:34 [bca.uk] INFO: Scrape type for FG11%20WTU: 2
2026-03-29 22:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c568eece-5c52-515e-a714-92f2b194dd20 with identifier: FG11%20WTU
2026-03-29 22:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c568eece-5c52-515e-a714-92f2b194dd20 with scrape type 2
2026-03-29 22:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c568eece-5c52-515e-a714-92f2b194dd20 with scrape type 2
2026-03-29 22:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c568eece-5c52-515e-a714-92f2b194dd20, identifier: FG11%20WTU
2026-03-29 22:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ec0e0d1e-8a04-54f9-ba50-3f01dcb217c1 with identifier: HK22%20DXB
2026-03-29 22:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ec0e0d1e-8a04-54f9-ba50-3f01dcb217c1 with identifier: HK22%20DXB
2026-03-29 22:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ec0e0d1e-8a04-54f9-ba50-3f01dcb217c1 with identifier: HK22%20DXB to the API
2026-03-29 22:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 253,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK22%20DXB-GB',
'category': 'LightCommercialVehicle',
'color': 'orange',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ec0e0d1e-8a04-54f9-ba50-3f01dcb217c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK22 DXB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK22%20DXB&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'FORD',
'model': 'RANGER',
'odometer': 34573,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'FORD RANGER 2.0 EBL 213 WILDTRAK CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'EBL 213 WILDTRAK',
'vin': '6FPPXXMJ2PNY78955',
'year': 2022}
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK22%2520DXB%27 HTTP/1.1" 200 None
2026-03-29 22:01:35 [bca.uk] INFO: Saving data for HK22%20DXB: {'auction_closing_time': 1774951200.0, 'created_time': 1774610678.713279, 'last_price_update_time': 1774821695.077399}
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK22%2520DXB') HTTP/1.1" 204 0
2026-03-29 22:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f094f15d-0ae9-5678-a8f2-3226d9b024b2 with identifier: HG18%20UAP
2026-03-29 22:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f094f15d-0ae9-5678-a8f2-3226d9b024b2 with identifier: HG18%20UAP
2026-03-29 22:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f094f15d-0ae9-5678-a8f2-3226d9b024b2 with identifier: HG18%20UAP to the API
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HG18%20UAP-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f094f15d-0ae9-5678-a8f2-3226d9b024b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HG18 UAP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HG18%20UAP&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'JAGUAR',
'model': 'E-PACE',
'odometer': 49452,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'JAGUAR E-PACE 2.0 D150 AWD S Hatchback',
'transmission': 'automatic',
'trim': 'D150 AWD S',
'vin': 'SADFA2AN7J1Z16770',
'year': 2018}
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG18%2520UAP%27 HTTP/1.1" 200 None
2026-03-29 22:01:35 [bca.uk] INFO: Saving data for HG18%20UAP: {'auction_closing_time': 1774951200.0, 'created_time': 1774390937.001368, 'last_price_update_time': 1774821695.430937}
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HG18%2520UAP') HTTP/1.1" 204 0
2026-03-29 22:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242935/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58XVG/42790595?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=vcjXHy%2BXcxnL8fVcBSIy1zRUfNwdkYA77TQSDd3JyNw%3D)
2026-03-29 22:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073213/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF17VPN/42811060?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=YkLrcIHkwtrZsjUa2prubREuXQStMy8DMOWlaZjCM6o%3D)
2026-03-29 22:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211049/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO08HUA/42769935?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=UrTho4OU5emtGOfXKZ0dWvPhmltT%2BxjdBAxxllTvFdc%3D)
2026-03-29 22:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c568eece-5c52-515e-a714-92f2b194dd20 with identifier: FG11%20WTU
2026-03-29 22:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c568eece-5c52-515e-a714-92f2b194dd20 with identifier: FG11%20WTU
2026-03-29 22:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c568eece-5c52-515e-a714-92f2b194dd20 with identifier: FG11%20WTU to the API
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 244,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG11%20WTU-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c568eece-5c52-515e-a714-92f2b194dd20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG11 WTU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FG11%20WTU&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'RANGER',
'odometer': 99854,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'FORD RANGER 2.5 TDCI 143 XL 4WD CrewCab Pick-up',
'transmission': 'manual',
'trim': 'TDCI 143 XL 4WD',
'vin': 'WF0LMFE10BW931006',
'year': 2011}
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG11%2520WTU%27 HTTP/1.1" 200 None
2026-03-29 22:01:35 [bca.uk] INFO: Saving data for FG11%20WTU: {'auction_closing_time': 1774951200.0, 'created_time': 1774523296.505208, 'last_price_update_time': 1774821695.87328}
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FG11%2520WTU') HTTP/1.1" 204 0
2026-03-29 22:01:35 [bca.uk] INFO: Found listing with ID: LP22%20BZS
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP22%2520BZS%27 HTTP/1.1" 200 None
2026-03-29 22:01:35 [bca.uk] INFO: Scrape type for LP22%20BZS: 0
2026-03-29 22:01:35 [bca.uk] INFO: Found listing with ID: KU16%20WMW
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU16%2520WMW%27 HTTP/1.1" 200 None
2026-03-29 22:01:35 [bca.uk] INFO: Scrape type for KU16%20WMW: 2
2026-03-29 22:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44026097-942c-5144-9fa7-c5a52898935d with identifier: KU16%20WMW
2026-03-29 22:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44026097-942c-5144-9fa7-c5a52898935d with scrape type 2
2026-03-29 22:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44026097-942c-5144-9fa7-c5a52898935d with scrape type 2
2026-03-29 22:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 44026097-942c-5144-9fa7-c5a52898935d, identifier: KU16%20WMW
2026-03-29 22:01:36 [bca.uk] INFO: Found listing with ID: FD18%20SVU
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD18%2520SVU%27 HTTP/1.1" 200 None
2026-03-29 22:01:36 [bca.uk] INFO: Scrape type for FD18%20SVU: 0
2026-03-29 22:01:36 [bca.uk] INFO: Found listing with ID: NK17%20UZV
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK17%2520UZV%27 HTTP/1.1" 200 None
2026-03-29 22:01:36 [bca.uk] INFO: Scrape type for NK17%20UZV: 2
2026-03-29 22:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3902049c-7c47-5636-bbb3-3468c754f44d with identifier: NK17%20UZV
2026-03-29 22:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3902049c-7c47-5636-bbb3-3468c754f44d with scrape type 2
2026-03-29 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3902049c-7c47-5636-bbb3-3468c754f44d with scrape type 2
2026-03-29 22:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3902049c-7c47-5636-bbb3-3468c754f44d, identifier: NK17%20UZV
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61727810>
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP65LKN%252F699411726%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411726/600 saved to cache
2026-03-29 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6062366a-77b0-5b3c-aa23-49414d769971
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b8790>
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19VSX%252F699430146%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430146/600 saved to cache
2026-03-29 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 732664ff-2041-53f2-83f7-e4a6aeaa1df2
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61774990>
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ72FOT%252F699414843%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414843/600 saved to cache
2026-03-29 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616dd150>
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19VXX%252F699427749%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427749/600 saved to cache
2026-03-29 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 553a9526-308c-5e9f-97f5-1bce769f99d7
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6191f050>
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE20EVL%252F699427715%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427715/600 saved to cache
2026-03-29 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b145ed4d-e096-5329-b7ec-7396067fba60
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61966990>
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG69FWY%252F699406206%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406206/600 saved to cache
2026-03-29 22:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23673480-b7c5-5707-903a-2783d4797f75
2026-03-29 22:01:36 [bca.uk] INFO: Found listing with ID: MT64%20GVX
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT64%2520GVX%27 HTTP/1.1" 200 None
2026-03-29 22:01:36 [bca.uk] INFO: Scrape type for MT64%20GVX: 1
2026-03-29 22:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65250f67-b63f-5f19-a165-a7afa44cd815 with identifier: MT64%20GVX
2026-03-29 22:01:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 65250f67-b63f-5f19-a165-a7afa44cd815
2026-03-29 22:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 44026097-942c-5144-9fa7-c5a52898935d with identifier: KU16%20WMW
2026-03-29 22:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 44026097-942c-5144-9fa7-c5a52898935d with identifier: KU16%20WMW
2026-03-29 22:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 44026097-942c-5144-9fa7-c5a52898935d with identifier: KU16%20WMW to the API
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 170,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU16%20WMW-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '44026097-942c-5144-9fa7-c5a52898935d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU16 WMW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KU16%20WMW&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VAUXHALL',
'model': 'VIVARO 2.7T',
'odometer': 136343,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL VIVARO 2.7T 1.6 CDTI 115 SWB SPORTIVE PanelVan',
'transmission': 'manual',
'trim': 'CDTI 115 SWB SPORTIVE',
'vin': 'W0L3F7002GV643780',
'year': 2016}
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU16%2520WMW%27 HTTP/1.1" 200 None
2026-03-29 22:01:36 [bca.uk] INFO: Saving data for KU16%20WMW: {'auction_closing_time': 1775037600.0, 'created_time': 1773821296.436468, 'last_price_update_time': 1774821696.787434}
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KU16%2520WMW') HTTP/1.1" 204 0
2026-03-29 22:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3902049c-7c47-5636-bbb3-3468c754f44d with identifier: NK17%20UZV
2026-03-29 22:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3902049c-7c47-5636-bbb3-3468c754f44d with identifier: NK17%20UZV
2026-03-29 22:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3902049c-7c47-5636-bbb3-3468c754f44d with identifier: NK17%20UZV to the API
2026-03-29 22:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 95,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NK17%20UZV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3902049c-7c47-5636-bbb3-3468c754f44d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NK17 UZV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NK17%20UZV&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'CITROEN',
'model': 'C3',
'odometer': 37495,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'CITROEN C3 1.6 BLUEHDI 100 FLAIR S/S Hatchback',
'transmission': 'manual',
'trim': 'BLUEHDI 100 FLAIR S/S',
'vin': 'VF7SXBHY6GT561444',
'year': 2017}
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK17%2520UZV%27 HTTP/1.1" 200 None
2026-03-29 22:01:37 [bca.uk] INFO: Saving data for NK17%20UZV: {'auction_closing_time': 1774951200.0, 'created_time': 1774696058.340666, 'last_price_update_time': 1774821697.138457}
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NK17%2520UZV') HTTP/1.1" 204 0
2026-03-29 22:01:37 [bca.uk] INFO: Found listing with ID: KU68%20AVW
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU68%2520AVW%27 HTTP/1.1" 200 None
2026-03-29 22:01:37 [bca.uk] INFO: Scrape type for KU68%20AVW: 2
2026-03-29 22:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58476ba3-dd98-57b5-85a5-87c9fe83de41 with identifier: KU68%20AVW
2026-03-29 22:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58476ba3-dd98-57b5-85a5-87c9fe83de41 with scrape type 2
2026-03-29 22:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58476ba3-dd98-57b5-85a5-87c9fe83de41 with scrape type 2
2026-03-29 22:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 58476ba3-dd98-57b5-85a5-87c9fe83de41, identifier: KU68%20AVW
2026-03-29 22:01:37 [bca.uk] INFO: Found listing with ID: NU67%20AWA
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU67%2520AWA%27 HTTP/1.1" 200 None
2026-03-29 22:01:37 [bca.uk] INFO: Scrape type for NU67%20AWA: 2
2026-03-29 22:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e05fd6a-3de7-568a-814e-ad3b0cd6fb04 with identifier: NU67%20AWA
2026-03-29 22:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e05fd6a-3de7-568a-814e-ad3b0cd6fb04 with scrape type 2
2026-03-29 22:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e05fd6a-3de7-568a-814e-ad3b0cd6fb04 with scrape type 2
2026-03-29 22:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9e05fd6a-3de7-568a-814e-ad3b0cd6fb04, identifier: NU67%20AWA
2026-03-29 22:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246836/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246836>
2026-03-29 22:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023613/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023613>
2026-03-29 22:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457259/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457259>
2026-03-29 22:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68OTW/42811886?sv=2020-08-04&st=2026-03-29T22%3A01%3A29Z&se=2026-03-29T22%3A26%3A29Z&sr=b&sp=r&sig=fuk2ajppUL%2BpY5Jq%2BLDEOSIJIqcNrPdxnkllkXnrnUc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66SVX/42805972?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=yl9q46AoV3wQNjXIFCNniksZeCLN9BE%2FANgZ6Iluhps%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LP66%20SVX-GB>
2026-03-29 22:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457256/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457256>
2026-03-29 22:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX05YUG/42800121?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=MySGDJ66pbFCM8Of63GwPM4lST90Oc%2FUCupYTeM%2FDJ0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CX05%20YUG-GB>
2026-03-29 22:01:37 [bca.uk] INFO: Found listing with ID: LP25%20CGX
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP25%2520CGX%27 HTTP/1.1" 200 None
2026-03-29 22:01:37 [bca.uk] INFO: Scrape type for LP25%20CGX: 0
2026-03-29 22:01:37 [bca.uk] INFO: Found listing with ID: SA17%20JEH
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA17%2520JEH%27 HTTP/1.1" 200 None
2026-03-29 22:01:37 [bca.uk] INFO: Scrape type for SA17%20JEH: 2
2026-03-29 22:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16132d3d-775b-55af-a9c0-8dbb74f64b22 with identifier: SA17%20JEH
2026-03-29 22:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16132d3d-775b-55af-a9c0-8dbb74f64b22 with scrape type 2
2026-03-29 22:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16132d3d-775b-55af-a9c0-8dbb74f64b22 with scrape type 2
2026-03-29 22:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 16132d3d-775b-55af-a9c0-8dbb74f64b22, identifier: SA17%20JEH
2026-03-29 22:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 58476ba3-dd98-57b5-85a5-87c9fe83de41 with identifier: KU68%20AVW
2026-03-29 22:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 58476ba3-dd98-57b5-85a5-87c9fe83de41 with identifier: KU68%20AVW
2026-03-29 22:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 58476ba3-dd98-57b5-85a5-87c9fe83de41 with identifier: KU68%20AVW to the API
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU68%20AVW-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '58476ba3-dd98-57b5-85a5-87c9fe83de41',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU68 AVW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KU68%20AVW&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'MERCEDES-BENZ',
'model': 'VITO 119',
'odometer': 142455,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ VITO 119 2.1 CDI COMPACT SPORT 7G CrewCab Van',
'transmission': 'automatic',
'trim': 'CDI COMPACT SPORT 7G',
'vin': 'WDF44770123542433',
'year': 2018}
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU68%2520AVW%27 HTTP/1.1" 200 None
2026-03-29 22:01:37 [bca.uk] INFO: Saving data for KU68%20AVW: {'auction_closing_time': 1775037600.0, 'created_time': 1773833413.125742, 'last_price_update_time': 1774821697.868201}
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KU68%2520AVW') HTTP/1.1" 204 0
2026-03-29 22:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9e05fd6a-3de7-568a-814e-ad3b0cd6fb04 with identifier: NU67%20AWA
2026-03-29 22:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9e05fd6a-3de7-568a-814e-ad3b0cd6fb04 with identifier: NU67%20AWA
2026-03-29 22:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9e05fd6a-3de7-568a-814e-ad3b0cd6fb04 with identifier: NU67%20AWA to the API
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NU67%20AWA-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9e05fd6a-3de7-568a-814e-ad3b0cd6fb04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NU67 AWA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NU67%20AWA&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 26416,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 ACENTA XTRONIC Hatchback',
'transmission': 'automatic',
'trim': 'ACENTA XTRONIC',
'vin': 'SJNFBAF15U7390380',
'year': 2017}
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU67%2520AWA%27 HTTP/1.1" 200 None
2026-03-29 22:01:38 [bca.uk] INFO: Saving data for NU67%20AWA: {'auction_closing_time': 1774951200.0, 'created_time': 1774391925.881505, 'last_price_update_time': 1774821698.3714}
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NU67%2520AWA') HTTP/1.1" 204 0
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6221f690>
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST62SYF%252F699246776%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246776/600 saved to cache
2026-03-29 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b294b559-83e7-5079-b89e-3524dea19cc0
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69ae3d10>
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12WNS%252F699023429%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023429/600 saved to cache
2026-03-29 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4e630b36-cd01-5007-b4b4-e80c316bb326
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61689610>
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO58EBF%252F699457251%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457251/600 saved to cache
2026-03-29 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 779863fc-56f0-5718-9334-675ca35049bb
2026-03-29 22:01:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6221f690>
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58XVG%252F699242935%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242935/600 saved to cache
2026-03-29 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cdbe3643-d056-5481-b487-6a8e20861864
2026-03-29 22:01:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618fc610>
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF17VPN%252F699073213%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073213/600 saved to cache
2026-03-29 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5439021f-449a-5c9e-a193-64352e476208
2026-03-29 22:01:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b4dd0>
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO08HUA%252F699211049%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211049/600 saved to cache
2026-03-29 22:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9816a6af-47f8-5106-89d9-6d77d25fd0f4
2026-03-29 22:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234634/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK55EXG/42758130?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=zNKuCsXwY5YBweBL8fGiYSmIg6c7hmRzF6E4Qyh0WVI%3D)
2026-03-29 22:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 16132d3d-775b-55af-a9c0-8dbb74f64b22 with identifier: SA17%20JEH
2026-03-29 22:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 16132d3d-775b-55af-a9c0-8dbb74f64b22 with identifier: SA17%20JEH
2026-03-29 22:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 16132d3d-775b-55af-a9c0-8dbb74f64b22 with identifier: SA17%20JEH to the API
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SA17%20JEH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Electric',
'id': '16132d3d-775b-55af-a9c0-8dbb74f64b22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SA17 JEH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SA17%20JEH&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'TESLA',
'model': 'MODEL X',
'odometer': 70102,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'TESLA MODEL X 100KWH D/M StationWagon',
'transmission': 'automatic',
'trim': '100KWH D/M',
'vin': '5YJXDCE23HF046398',
'year': 2017}
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA17%2520JEH%27 HTTP/1.1" 200 None
2026-03-29 22:01:38 [bca.uk] INFO: Saving data for SA17%20JEH: {'auction_closing_time': 1775037600.0, 'created_time': 1773959337.126495, 'last_price_update_time': 1774821698.953148}
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SA17%2520JEH') HTTP/1.1" 204 0
2026-03-29 22:01:38 [bca.uk] INFO: Found listing with ID: KM08%20XXA
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM08%2520XXA%27 HTTP/1.1" 200 None
2026-03-29 22:01:38 [bca.uk] INFO: Scrape type for KM08%20XXA: 0
2026-03-29 22:01:38 [bca.uk] INFO: Found listing with ID: YF57%20YKB
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF57%2520YKB%27 HTTP/1.1" 200 None
2026-03-29 22:01:38 [bca.uk] INFO: Scrape type for YF57%20YKB: 2
2026-03-29 22:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b30b5141-7817-520e-930e-2b905f96cc0b with identifier: YF57%20YKB
2026-03-29 22:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b30b5141-7817-520e-930e-2b905f96cc0b with scrape type 2
2026-03-29 22:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b30b5141-7817-520e-930e-2b905f96cc0b with scrape type 2
2026-03-29 22:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b30b5141-7817-520e-930e-2b905f96cc0b, identifier: YF57%20YKB
2026-03-29 22:01:39 [bca.uk] INFO: Found listing with ID: PX15%20ZPR
2026-03-29 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX15%2520ZPR%27 HTTP/1.1" 200 None
2026-03-29 22:01:39 [bca.uk] INFO: Scrape type for PX15%20ZPR: 0
2026-03-29 22:01:39 [bca.uk] INFO: Found listing with ID: SM58%20BYK
2026-03-29 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM58%2520BYK%27 HTTP/1.1" 200 None
2026-03-29 22:01:39 [bca.uk] INFO: Scrape type for SM58%20BYK: 0
2026-03-29 22:01:39 [bca.uk] INFO: Found listing with ID: ND05%20TWY
2026-03-29 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND05%2520TWY%27 HTTP/1.1" 200 None
2026-03-29 22:01:39 [bca.uk] INFO: Scrape type for ND05%20TWY: 0
2026-03-29 22:01:39 [bca.uk] INFO: Found listing with ID: NX18%20OER
2026-03-29 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX18%2520OER%27 HTTP/1.1" 200 None
2026-03-29 22:01:39 [bca.uk] INFO: Scrape type for NX18%20OER: 2
2026-03-29 22:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d1e2530-65a8-5fae-b5b5-8d5341862e70 with identifier: NX18%20OER
2026-03-29 22:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d1e2530-65a8-5fae-b5b5-8d5341862e70 with scrape type 2
2026-03-29 22:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d1e2530-65a8-5fae-b5b5-8d5341862e70 with scrape type 2
2026-03-29 22:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3d1e2530-65a8-5fae-b5b5-8d5341862e70, identifier: NX18%20OER
2026-03-29 22:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b30b5141-7817-520e-930e-2b905f96cc0b with identifier: YF57%20YKB
2026-03-29 22:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b30b5141-7817-520e-930e-2b905f96cc0b with identifier: YF57%20YKB
2026-03-29 22:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b30b5141-7817-520e-930e-2b905f96cc0b with identifier: YF57%20YKB to the API
2026-03-29 22:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 183,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF57%20YKB-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b30b5141-7817-520e-930e-2b905f96cc0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF57 YKB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF57%20YKB&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'AUDI',
'model': 'TT',
'odometer': 120272,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'AUDI TT 2.0 TFSI Coupe',
'transmission': 'manual',
'trim': 'TFSI',
'vin': 'TRUZZZ8J481028510',
'year': 2007}
2026-03-29 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF57%2520YKB%27 HTTP/1.1" 200 None
2026-03-29 22:01:39 [bca.uk] INFO: Saving data for YF57%20YKB: {'auction_closing_time': 1774951200.0, 'created_time': 1773820302.678276, 'last_price_update_time': 1774821699.661788}
2026-03-29 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF57%2520YKB') HTTP/1.1" 204 0
2026-03-29 22:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3d1e2530-65a8-5fae-b5b5-8d5341862e70 with identifier: NX18%20OER
2026-03-29 22:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3d1e2530-65a8-5fae-b5b5-8d5341862e70 with identifier: NX18%20OER
2026-03-29 22:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3d1e2530-65a8-5fae-b5b5-8d5341862e70 with identifier: NX18%20OER to the API
2026-03-29 22:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NX18%20OER-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3d1e2530-65a8-5fae-b5b5-8d5341862e70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NX18 OER',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NX18%20OER&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'HYUNDAI',
'model': 'I10',
'odometer': 42610,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'HYUNDAI I10 1.2 PREMIUM Hatchback',
'transmission': 'manual',
'trim': 'PREMIUM',
'vin': 'NLHA851CLJZ415381',
'year': 2018}
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX18%2520OER%27 HTTP/1.1" 200 None
2026-03-29 22:01:40 [bca.uk] INFO: Saving data for NX18%20OER: {'auction_closing_time': 1774951200.0, 'created_time': 1774524288.554336, 'last_price_update_time': 1774821700.039622}
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NX18%2520OER') HTTP/1.1" 204 0
2026-03-29 22:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246766/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST62SYF/42809590?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=r1Z4o1RO41%2Frbsi6j2NujNSq2CIa1MRr3E0xDNV9JdE%3D)
2026-03-29 22:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457250/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO58EBF/42810110?sv=2020-08-04&st=2026-03-29T22%3A01%3A02Z&se=2026-03-29T22%3A26%3A02Z&sr=b&sp=r&sig=l1yGxyGiXjxmhLTIgBa00vRGvOItb%2B7FOLk9BOk0TjI%3D)
2026-03-29 22:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023576/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023576>
2026-03-29 22:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457254/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457254>
2026-03-29 22:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246821/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246821>
2026-03-29 22:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073271/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073271>
2026-03-29 22:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX68ORU/42812293?sv=2020-08-04&st=2026-03-29T22%3A01%3A38Z&se=2026-03-29T22%3A26%3A38Z&sr=b&sp=r&sig=dTIgs41eJnjcU89aOFdmMmWrmPHqSDyWtMj1MxYIWm4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX68%20ORU-GB>
2026-03-29 22:01:40 [bca.uk] INFO: Found listing with ID: YH63%20TXR
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH63%2520TXR%27 HTTP/1.1" 200 None
2026-03-29 22:01:40 [bca.uk] INFO: Scrape type for YH63%20TXR: 0
2026-03-29 22:01:40 [bca.uk] INFO: Found listing with ID: YN63%20HJU
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN63%2520HJU%27 HTTP/1.1" 200 None
2026-03-29 22:01:40 [bca.uk] INFO: Scrape type for YN63%20HJU: 0
2026-03-29 22:01:40 [bca.uk] INFO: Found listing with ID: BG17%20FBZ
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG17%2520FBZ%27 HTTP/1.1" 200 None
2026-03-29 22:01:40 [bca.uk] INFO: Scrape type for BG17%20FBZ: 0
2026-03-29 22:01:40 [bca.uk] INFO: Found listing with ID: BN62%20UZG
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN62%2520UZG%27 HTTP/1.1" 200 None
2026-03-29 22:01:40 [bca.uk] INFO: Scrape type for BN62%20UZG: 1
2026-03-29 22:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0b17972-5ab7-56c0-825d-14139cf5492c with identifier: BN62%20UZG
2026-03-29 22:01:40 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f0b17972-5ab7-56c0-825d-14139cf5492c
2026-03-29 22:01:40 [bca.uk] INFO: Found listing with ID: SN14%20XMR
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN14%2520XMR%27 HTTP/1.1" 200 None
2026-03-29 22:01:40 [bca.uk] INFO: Scrape type for SN14%20XMR: 2
2026-03-29 22:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8add0ce3-3dfb-5144-93ab-96b2c1497c86 with identifier: SN14%20XMR
2026-03-29 22:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8add0ce3-3dfb-5144-93ab-96b2c1497c86 with scrape type 2
2026-03-29 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8add0ce3-3dfb-5144-93ab-96b2c1497c86 with scrape type 2
2026-03-29 22:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8add0ce3-3dfb-5144-93ab-96b2c1497c86, identifier: SN14%20XMR
2026-03-29 22:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8add0ce3-3dfb-5144-93ab-96b2c1497c86 with identifier: SN14%20XMR
2026-03-29 22:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8add0ce3-3dfb-5144-93ab-96b2c1497c86 with identifier: SN14%20XMR
2026-03-29 22:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8add0ce3-3dfb-5144-93ab-96b2c1497c86 with identifier: SN14%20XMR to the API
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SN14%20XMR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8add0ce3-3dfb-5144-93ab-96b2c1497c86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SN14 XMR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SN14%20XMR&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'CHEVROLET',
'model': 'SPARK',
'odometer': 40443,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'CHEVROLET SPARK 1.0 LS Hatchback',
'transmission': 'manual',
'trim': 'LS',
'vin': 'KL1MF4819EC426657',
'year': 2014}
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN14%2520XMR%27 HTTP/1.1" 200 None
2026-03-29 22:01:40 [bca.uk] INFO: Saving data for SN14%20XMR: {'auction_closing_time': 1774951200.0, 'created_time': 1774695951.874337, 'last_price_update_time': 1774821700.60495}
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SN14%2520XMR') HTTP/1.1" 204 0
2026-03-29 22:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242996/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242996>
2026-03-29 22:01:40 [bca.uk] INFO: Found listing with ID: BT13%20WSV
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT13%2520WSV%27 HTTP/1.1" 200 None
2026-03-29 22:01:40 [bca.uk] INFO: Scrape type for BT13%20WSV: 2
2026-03-29 22:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ed2dcfb-35de-5ada-ad91-353ae2183e85 with identifier: BT13%20WSV
2026-03-29 22:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ed2dcfb-35de-5ada-ad91-353ae2183e85 with scrape type 2
2026-03-29 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ed2dcfb-35de-5ada-ad91-353ae2183e85 with scrape type 2
2026-03-29 22:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6ed2dcfb-35de-5ada-ad91-353ae2183e85, identifier: BT13%20WSV
2026-03-29 22:01:40 [bca.uk] INFO: Found listing with ID: BJ66%20NYU
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ66%2520NYU%27 HTTP/1.1" 200 None
2026-03-29 22:01:40 [bca.uk] INFO: Scrape type for BJ66%20NYU: 0
2026-03-29 22:01:40 [bca.uk] INFO: Found listing with ID: EN67%20XLH
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN67%2520XLH%27 HTTP/1.1" 200 None
2026-03-29 22:01:40 [bca.uk] INFO: Scrape type for EN67%20XLH: 2
2026-03-29 22:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa55a28e-6d3c-5194-ab57-72376a8229bd with identifier: EN67%20XLH
2026-03-29 22:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa55a28e-6d3c-5194-ab57-72376a8229bd with scrape type 2
2026-03-29 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa55a28e-6d3c-5194-ab57-72376a8229bd with scrape type 2
2026-03-29 22:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fa55a28e-6d3c-5194-ab57-72376a8229bd, identifier: EN67%20XLH
2026-03-29 22:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637a7990>
2026-03-29 22:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_expert_report_file_2a2f3f2d-3047-4271-9dc3-2549008fb989.pdf HTTP/1.1" 201 0
2026-03-29 22:01:40 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4
2026-03-29 22:01:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4, skipping ID generation
2026-03-29 22:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDU68OTW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DU68OTW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636157d0>
2026-03-29 22:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK55EXG%252F699234634%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234634/600 saved to cache
2026-03-29 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0991f76e-fa68-5257-8869-29bbc185bed6
2026-03-29 22:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66SVX/42805972?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=yl9q46AoV3wQNjXIFCNniksZeCLN9BE%2FANgZ6Iluhps%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT64GVX/42811943?sv=2020-08-04&st=2026-03-29T22%3A01%3A40Z&se=2026-03-29T22%3A26%3A40Z&sr=b&sp=r&sig=cep50iJLm5T2T%2FJIF3KYJUQN262Xx397yLSJF4VsirI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT64%20GVX-GB>
2026-03-29 22:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX05YUG/42800121?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=MySGDJ66pbFCM8Of63GwPM4lST90Oc%2FUCupYTeM%2FDJ0%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6ed2dcfb-35de-5ada-ad91-353ae2183e85 with identifier: BT13%20WSV
2026-03-29 22:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6ed2dcfb-35de-5ada-ad91-353ae2183e85 with identifier: BT13%20WSV
2026-03-29 22:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6ed2dcfb-35de-5ada-ad91-353ae2183e85 with identifier: BT13%20WSV to the API
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT13%20WSV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6ed2dcfb-35de-5ada-ad91-353ae2183e85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BT13 WSV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BT13%20WSV&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 127069,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.6 DCI 130 TEKNA S/S Hatchback',
'transmission': 'manual',
'trim': 'DCI 130 TEKNA S/S',
'vin': 'SJNFEAJ10U2829678',
'year': 2013}
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT13%2520WSV%27 HTTP/1.1" 200 None
2026-03-29 22:01:41 [bca.uk] INFO: Saving data for BT13%20WSV: {'auction_closing_time': 1774951200.0, 'created_time': 1774696073.381553, 'last_price_update_time': 1774821701.41677}
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BT13%2520WSV') HTTP/1.1" 204 0
2026-03-29 22:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fa55a28e-6d3c-5194-ab57-72376a8229bd with identifier: EN67%20XLH
2026-03-29 22:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fa55a28e-6d3c-5194-ab57-72376a8229bd with identifier: EN67%20XLH
2026-03-29 22:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fa55a28e-6d3c-5194-ab57-72376a8229bd with identifier: EN67%20XLH to the API
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN67%20XLH-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fa55a28e-6d3c-5194-ab57-72376a8229bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN67 XLH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN67%20XLH&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'CITROEN',
'model': 'C3 AIRCROSS',
'odometer': 46947,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'CITROEN C3 AIRCROSS 1.2 P/T 110 FEEL Hatchback',
'transmission': 'manual',
'trim': 'P/T 110 FEEL',
'vin': 'VF72RHNZBJ4167628',
'year': 2018}
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN67%2520XLH%27 HTTP/1.1" 200 None
2026-03-29 22:01:41 [bca.uk] INFO: Saving data for EN67%20XLH: {'auction_closing_time': 1774951200.0, 'created_time': 1774390900.932913, 'last_price_update_time': 1774821701.743832}
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN67%2520XLH') HTTP/1.1" 204 0
2026-03-29 22:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457256/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO58EBF/42810110?sv=2020-08-04&st=2026-03-29T22%3A01%3A02Z&se=2026-03-29T22%3A26%3A02Z&sr=b&sp=r&sig=l1yGxyGiXjxmhLTIgBa00vRGvOItb%2B7FOLk9BOk0TjI%3D)
2026-03-29 22:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023613/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12WNS/42810774?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=tTo%2B0xotySQc25NFgljm0ZLwDTnsvqG5v%2FSimEvL7PM%3D)
2026-03-29 22:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246836/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST62SYF/42809590?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=r1Z4o1RO41%2Frbsi6j2NujNSq2CIa1MRr3E0xDNV9JdE%3D)
2026-03-29 22:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457259/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO58EBF/42810110?sv=2020-08-04&st=2026-03-29T22%3A01%3A02Z&se=2026-03-29T22%3A26%3A02Z&sr=b&sp=r&sig=l1yGxyGiXjxmhLTIgBa00vRGvOItb%2B7FOLk9BOk0TjI%3D)
2026-03-29 22:01:41 [bca.uk] INFO: Found listing with ID: BV61%20UFD
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV61%2520UFD%27 HTTP/1.1" 200 None
2026-03-29 22:01:41 [bca.uk] INFO: Scrape type for BV61%20UFD: 0
2026-03-29 22:01:41 [bca.uk] INFO: Found listing with ID: DU64%20MTJ
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU64%2520MTJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:41 [bca.uk] INFO: Scrape type for DU64%20MTJ: 0
2026-03-29 22:01:41 [bca.uk] INFO: Found listing with ID: DX16%20MYY
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX16%2520MYY%27 HTTP/1.1" 200 None
2026-03-29 22:01:41 [bca.uk] INFO: Scrape type for DX16%20MYY: 2
2026-03-29 22:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b761556c-b9e2-584e-8b60-6ef79cfe0123 with identifier: DX16%20MYY
2026-03-29 22:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b761556c-b9e2-584e-8b60-6ef79cfe0123 with scrape type 2
2026-03-29 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b761556c-b9e2-584e-8b60-6ef79cfe0123 with scrape type 2
2026-03-29 22:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b761556c-b9e2-584e-8b60-6ef79cfe0123, identifier: DX16%20MYY
2026-03-29 22:01:41 [bca.uk] INFO: Found listing with ID: ND19%20VHL
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND19%2520VHL%27 HTTP/1.1" 200 None
2026-03-29 22:01:41 [bca.uk] INFO: Scrape type for ND19%20VHL: 2
2026-03-29 22:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3da52437-88a6-5c28-8143-adc9baabdca3 with identifier: ND19%20VHL
2026-03-29 22:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3da52437-88a6-5c28-8143-adc9baabdca3 with scrape type 2
2026-03-29 22:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3da52437-88a6-5c28-8143-adc9baabdca3 with scrape type 2
2026-03-29 22:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3da52437-88a6-5c28-8143-adc9baabdca3, identifier: ND19%20VHL
2026-03-29 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388344%27 HTTP/1.1" 200 None
2026-03-29 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388344 not downloaded yet
2026-03-29 22:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6372e0d0>
2026-03-29 22:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST62SYF%252F699246766%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246766/600 saved to cache
2026-03-29 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b294b559-83e7-5079-b89e-3524dea19cc0
2026-03-29 22:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6360c0d0>
2026-03-29 22:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO58EBF%252F699457250%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457250/600 saved to cache
2026-03-29 22:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 779863fc-56f0-5718-9334-675ca35049bb
2026-03-29 22:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64BWF/42812128?sv=2020-08-04&st=2026-03-29T22%3A01%3A41Z&se=2026-03-29T22%3A26%3A41Z&sr=b&sp=r&sig=MzwyyqM%2Fq9XpCMHPmp7VRaX08ubizr8jYVfx3e066Lo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT64%20BWF-GB>
2026-03-29 22:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b761556c-b9e2-584e-8b60-6ef79cfe0123 with identifier: DX16%20MYY
2026-03-29 22:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b761556c-b9e2-584e-8b60-6ef79cfe0123 with identifier: DX16%20MYY
2026-03-29 22:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b761556c-b9e2-584e-8b60-6ef79cfe0123 with identifier: DX16%20MYY to the API
2026-03-29 22:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DX16%20MYY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b761556c-b9e2-584e-8b60-6ef79cfe0123',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DX16 MYY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DX16%20MYY&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 104167,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF05XXGCC5GB19734',
'year': 2016}
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX16%2520MYY%27 HTTP/1.1" 200 None
2026-03-29 22:01:43 [bca.uk] INFO: Saving data for DX16%20MYY: {'auction_closing_time': 1774951200.0, 'created_time': 1774696072.208053, 'last_price_update_time': 1774821703.337882}
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DX16%2520MYY') HTTP/1.1" 204 0
2026-03-29 22:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3da52437-88a6-5c28-8143-adc9baabdca3 with identifier: ND19%20VHL
2026-03-29 22:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3da52437-88a6-5c28-8143-adc9baabdca3 with identifier: ND19%20VHL
2026-03-29 22:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3da52437-88a6-5c28-8143-adc9baabdca3 with identifier: ND19%20VHL to the API
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 206,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND19%20VHL-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3da52437-88a6-5c28-8143-adc9baabdca3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND19 VHL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND19%20VHL&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'BMW',
'model': 'X3',
'odometer': 46778,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW X3 3.0 XDRIVE M40I STEP StationWagon',
'transmission': 'manual',
'trim': 'XDRIVE M40I STEP',
'vin': 'WBATS32040LP75158',
'year': 2019}
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND19%2520VHL%27 HTTP/1.1" 200 None
2026-03-29 22:01:43 [bca.uk] INFO: Saving data for ND19%20VHL: {'auction_closing_time': 1774951200.0, 'created_time': 1774706543.524976, 'last_price_update_time': 1774821703.677592}
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND19%2520VHL') HTTP/1.1" 204 0
2026-03-29 22:01:43 [bca.uk] INFO: Found listing with ID: EJ13%20JTO
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ13%2520JTO%27 HTTP/1.1" 200 None
2026-03-29 22:01:43 [bca.uk] INFO: Scrape type for EJ13%20JTO: 2
2026-03-29 22:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5be82b2b-6926-5451-8e0e-f3d801ad1cad with identifier: EJ13%20JTO
2026-03-29 22:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5be82b2b-6926-5451-8e0e-f3d801ad1cad with scrape type 2
2026-03-29 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5be82b2b-6926-5451-8e0e-f3d801ad1cad with scrape type 2
2026-03-29 22:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5be82b2b-6926-5451-8e0e-f3d801ad1cad, identifier: EJ13%20JTO
2026-03-29 22:01:43 [bca.uk] INFO: Found listing with ID: SR68%20NWE
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR68%2520NWE%27 HTTP/1.1" 200 None
2026-03-29 22:01:43 [bca.uk] INFO: Scrape type for SR68%20NWE: 0
2026-03-29 22:01:43 [bca.uk] INFO: Found listing with ID: EK19%20ZSU
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK19%2520ZSU%27 HTTP/1.1" 200 None
2026-03-29 22:01:43 [bca.uk] INFO: Scrape type for EK19%20ZSU: 0
2026-03-29 22:01:43 [bca.uk] INFO: Found listing with ID: YD08%20FXX
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD08%2520FXX%27 HTTP/1.1" 200 None
2026-03-29 22:01:43 [bca.uk] INFO: Scrape type for YD08%20FXX: 0
2026-03-29 22:01:43 [bca.uk] INFO: Found listing with ID: PO68%20KXK
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO68%2520KXK%27 HTTP/1.1" 200 None
2026-03-29 22:01:43 [bca.uk] INFO: Scrape type for PO68%20KXK: 0
2026-03-29 22:01:43 [bca.uk] INFO: Found listing with ID: GK60%20RPO
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK60%2520RPO%27 HTTP/1.1" 200 None
2026-03-29 22:01:43 [bca.uk] INFO: Scrape type for GK60%20RPO: 0
2026-03-29 22:01:43 [bca.uk] INFO: Found listing with ID: SE64%20GDF
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE64%2520GDF%27 HTTP/1.1" 200 None
2026-03-29 22:01:43 [bca.uk] INFO: Scrape type for SE64%20GDF: 0
2026-03-29 22:01:43 [bca.uk] INFO: Found listing with ID: SL14%20FUV
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL14%2520FUV%27 HTTP/1.1" 200 None
2026-03-29 22:01:43 [bca.uk] INFO: Scrape type for SL14%20FUV: 2
2026-03-29 22:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4af4afff-8541-5597-ac35-e3d1f2d229bb with identifier: SL14%20FUV
2026-03-29 22:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4af4afff-8541-5597-ac35-e3d1f2d229bb with scrape type 2
2026-03-29 22:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4af4afff-8541-5597-ac35-e3d1f2d229bb with scrape type 2
2026-03-29 22:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4af4afff-8541-5597-ac35-e3d1f2d229bb, identifier: SL14%20FUV
2026-03-29 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388358%27 HTTP/1.1" 200 None
2026-03-29 22:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388358 not downloaded yet
2026-03-29 22:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457253/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457253>
2026-03-29 22:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246805/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246805>
2026-03-29 22:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX68ORU/42812293?sv=2020-08-04&st=2026-03-29T22%3A01%3A38Z&se=2026-03-29T22%3A26%3A38Z&sr=b&sp=r&sig=dTIgs41eJnjcU89aOFdmMmWrmPHqSDyWtMj1MxYIWm4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5be82b2b-6926-5451-8e0e-f3d801ad1cad with identifier: EJ13%20JTO
2026-03-29 22:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5be82b2b-6926-5451-8e0e-f3d801ad1cad with identifier: EJ13%20JTO
2026-03-29 22:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5be82b2b-6926-5451-8e0e-f3d801ad1cad with identifier: EJ13%20JTO to the API
2026-03-29 22:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ13%20JTO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5be82b2b-6926-5451-8e0e-f3d801ad1cad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EJ13 JTO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EJ13%20JTO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'AUDI',
'model': 'A3',
'odometer': 114071,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'AUDI A3 1.4 TFSI 122 S LINE Hatchback',
'transmission': 'manual',
'trim': 'TFSI 122 S LINE',
'vin': 'WAUZZZ8V4DA069000',
'year': 2013}
2026-03-29 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ13%2520JTO%27 HTTP/1.1" 200 None
2026-03-29 22:01:44 [bca.uk] INFO: Saving data for EJ13%20JTO: {'auction_closing_time': 1774951200.0, 'created_time': 1774706955.098336, 'last_price_update_time': 1774821704.392638}
2026-03-29 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EJ13%2520JTO') HTTP/1.1" 204 0
2026-03-29 22:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4af4afff-8541-5597-ac35-e3d1f2d229bb with identifier: SL14%20FUV
2026-03-29 22:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4af4afff-8541-5597-ac35-e3d1f2d229bb with identifier: SL14%20FUV
2026-03-29 22:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4af4afff-8541-5597-ac35-e3d1f2d229bb with identifier: SL14%20FUV to the API
2026-03-29 22:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL14%20FUV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4af4afff-8541-5597-ac35-e3d1f2d229bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SL14 FUV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SL14%20FUV&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'MINI',
'model': 'ROADSTER',
'odometer': 45542,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MINI ROADSTER 1.6 COOPER Roadster',
'transmission': 'manual',
'trim': 'COOPER',
'vin': 'WMWSY120X0T667397',
'year': 2014}
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL14%2520FUV%27 HTTP/1.1" 200 None
2026-03-29 22:01:45 [bca.uk] INFO: Saving data for SL14%20FUV: {'auction_closing_time': 1774951200.0, 'created_time': 1774418825.731066, 'last_price_update_time': 1774821705.341185}
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SL14%2520FUV') HTTP/1.1" 204 0
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637eb110>
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_expert_report_file_6e537952-ed79-4392-90c5-ec140f41d90a.pdf HTTP/1.1" 201 0
2026-03-29 22:01:45 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 392ba6d2-142e-521e-9c14-6f3c87e57d15
2026-03-29 22:01:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 392ba6d2-142e-521e-9c14-6f3c87e57d15, skipping ID generation
2026-03-29 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 392ba6d2-142e-521e-9c14-6f3c87e57d15
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLP66SVX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LP66SVX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637a3710>
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_expert_report_file_a0dd377e-60d6-4b67-b577-9358a3a77113.pdf HTTP/1.1" 201 0
2026-03-29 22:01:45 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9f8e435e-d477-50a3-aea7-4952aa2ce397
2026-03-29 22:01:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f8e435e-d477-50a3-aea7-4952aa2ce397, skipping ID generation
2026-03-29 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f8e435e-d477-50a3-aea7-4952aa2ce397
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCX05YUG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CX05YUG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637b5150>
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO58EBF%252F699457256%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457256/600 saved to cache
2026-03-29 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 779863fc-56f0-5718-9334-675ca35049bb
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637c4750>
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12WNS%252F699023613%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023613/600 saved to cache
2026-03-29 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4e630b36-cd01-5007-b4b4-e80c316bb326
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63646f10>
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST62SYF%252F699246836%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246836/600 saved to cache
2026-03-29 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b294b559-83e7-5079-b89e-3524dea19cc0
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63638f50>
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO58EBF%252F699457259%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457259/600 saved to cache
2026-03-29 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 779863fc-56f0-5718-9334-675ca35049bb
2026-03-29 22:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073271/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF17VPN/42811060?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=YkLrcIHkwtrZsjUa2prubREuXQStMy8DMOWlaZjCM6o%3D)
2026-03-29 22:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023576/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12WNS/42810774?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=tTo%2B0xotySQc25NFgljm0ZLwDTnsvqG5v%2FSimEvL7PM%3D)
2026-03-29 22:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246821/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST62SYF/42809590?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=r1Z4o1RO41%2Frbsi6j2NujNSq2CIa1MRr3E0xDNV9JdE%3D)
2026-03-29 22:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457254/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO58EBF/42810110?sv=2020-08-04&st=2026-03-29T22%3A01%3A02Z&se=2026-03-29T22%3A26%3A02Z&sr=b&sp=r&sig=l1yGxyGiXjxmhLTIgBa00vRGvOItb%2B7FOLk9BOk0TjI%3D)
2026-03-29 22:01:45 [bca.uk] INFO: Found listing with ID: EU13%20RYM
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU13%2520RYM%27 HTTP/1.1" 200 None
2026-03-29 22:01:45 [bca.uk] INFO: Scrape type for EU13%20RYM: 0
2026-03-29 22:01:45 [bca.uk] INFO: Found listing with ID: KV60%20ZZA
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV60%2520ZZA%27 HTTP/1.1" 200 None
2026-03-29 22:01:45 [bca.uk] INFO: Scrape type for KV60%20ZZA: 2
2026-03-29 22:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4 with identifier: KV60%20ZZA
2026-03-29 22:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4 with scrape type 2
2026-03-29 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4 with scrape type 2
2026-03-29 22:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4, identifier: KV60%20ZZA
2026-03-29 22:01:45 [bca.uk] INFO: Found listing with ID: YK18%20EUH
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK18%2520EUH%27 HTTP/1.1" 200 None
2026-03-29 22:01:45 [bca.uk] INFO: Scrape type for YK18%20EUH: 0
2026-03-29 22:01:45 [bca.uk] INFO: Found listing with ID: SV10%20UOD
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV10%2520UOD%27 HTTP/1.1" 200 None
2026-03-29 22:01:45 [bca.uk] INFO: Scrape type for SV10%20UOD: 0
2026-03-29 22:01:45 [bca.uk] INFO: Found listing with ID: YG58%20WEO
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG58%2520WEO%27 HTTP/1.1" 200 None
2026-03-29 22:01:45 [bca.uk] INFO: Scrape type for YG58%20WEO: 1
2026-03-29 22:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac73288d-b563-5983-b5d9-ecc76436c89b with identifier: YG58%20WEO
2026-03-29 22:01:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ac73288d-b563-5983-b5d9-ecc76436c89b
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388379%27 HTTP/1.1" 200 None
2026-03-29 22:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388379 not downloaded yet
2026-03-29 22:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242996/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58XVG/42790595?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=vcjXHy%2BXcxnL8fVcBSIy1zRUfNwdkYA77TQSDd3JyNw%3D)
2026-03-29 22:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4 with identifier: KV60%20ZZA
2026-03-29 22:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4 with identifier: KV60%20ZZA
2026-03-29 22:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3f54d261-9f82-51f4-9ce3-cc4413b8b6c4 with identifier: KV60%20ZZA to the API
2026-03-29 22:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KV60%20ZZA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3f54d261-9f82-51f4-9ce3-cc4413b8b6c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KV60 ZZA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KV60%20ZZA&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VOLKSWAGEN',
'model': 'PASSAT',
'odometer': 113862,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN PASSAT 2.0 TDI CR 140 HIGHLINE PLUS Saloon',
'transmission': 'manual',
'trim': 'TDI CR 140 HIGHLINE PLUS',
'vin': 'WVWZZZ3CZAP064863',
'year': 2010}
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV60%2520ZZA%27 HTTP/1.1" 200 None
2026-03-29 22:01:46 [bca.uk] INFO: Saving data for KV60%20ZZA: {'auction_closing_time': 1774951200.0, 'created_time': 1774706958.49784, 'last_price_update_time': 1774821706.265325}
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KV60%2520ZZA') HTTP/1.1" 204 0
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251805%27 HTTP/1.1" 200 None
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251805 not downloaded yet
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250223%27 HTTP/1.1" 200 None
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250223 not downloaded yet
2026-03-29 22:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT64GVX/42811943?sv=2020-08-04&st=2026-03-29T22%3A01%3A40Z&se=2026-03-29T22%3A26%3A40Z&sr=b&sp=r&sig=cep50iJLm5T2T%2FJIF3KYJUQN262Xx397yLSJF4VsirI%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN62UZG/42812357?sv=2020-08-04&st=2026-03-29T22%3A01%3A45Z&se=2026-03-29T22%3A26%3A45Z&sr=b&sp=r&sig=X9pErQDsrXNy4qMwHp8m59UtcG5VKGVtuCOpQCnsZBk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BN62%20UZG-GB>
2026-03-29 22:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388325/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DU68OTW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:01:46 [bca.uk] INFO: Found listing with ID: ML12%20ZHW
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML12%2520ZHW%27 HTTP/1.1" 200 None
2026-03-29 22:01:46 [bca.uk] INFO: Scrape type for ML12%20ZHW: 1
2026-03-29 22:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: affe99a9-0b91-5662-a514-563a71ce6efc with identifier: ML12%20ZHW
2026-03-29 22:01:46 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item affe99a9-0b91-5662-a514-563a71ce6efc
2026-03-29 22:01:46 [bca.uk] INFO: Found listing with ID: AJ10%20CHY
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ10%2520CHY%27 HTTP/1.1" 200 None
2026-03-29 22:01:46 [bca.uk] INFO: Scrape type for AJ10%20CHY: 1
2026-03-29 22:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0 with identifier: AJ10%20CHY
2026-03-29 22:01:46 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388397%27 HTTP/1.1" 200 None
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388397 not downloaded yet
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63647f50>
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_expert_report_file_7b61bbf5-20a6-4a95-bfa5-50dcbb995c5d.pdf HTTP/1.1" 201 0
2026-03-29 22:01:46 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0556e924-104a-5552-a701-fc5b5327996f
2026-03-29 22:01:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0556e924-104a-5552-a701-fc5b5327996f, skipping ID generation
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0556e924-104a-5552-a701-fc5b5327996f
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLX68ORU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LX68ORU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073258/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073258>
2026-03-29 22:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023478/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023478>
2026-03-29 22:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242976/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242976>
2026-03-29 22:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211077/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699211077>
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251813%27 HTTP/1.1" 200 None
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251813 not downloaded yet
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250229%27 HTTP/1.1" 200 None
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250229 not downloaded yet
2026-03-29 22:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64BWF/42812128?sv=2020-08-04&st=2026-03-29T22%3A01%3A41Z&se=2026-03-29T22%3A26%3A41Z&sr=b&sp=r&sig=MzwyyqM%2Fq9XpCMHPmp7VRaX08ubizr8jYVfx3e066Lo%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:46 [bca.uk] INFO: Found listing with ID: SF62%20EFA
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF62%2520EFA%27 HTTP/1.1" 200 None
2026-03-29 22:01:46 [bca.uk] INFO: Scrape type for SF62%20EFA: 0
2026-03-29 22:01:46 [bca.uk] INFO: Found listing with ID: SJ63%20URU
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ63%2520URU%27 HTTP/1.1" 200 None
2026-03-29 22:01:46 [bca.uk] INFO: Scrape type for SJ63%20URU: 0
2026-03-29 22:01:46 [bca.uk] INFO: Found listing with ID: WV13%20ZTH
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV13%2520ZTH%27 HTTP/1.1" 200 None
2026-03-29 22:01:46 [bca.uk] INFO: Scrape type for WV13%20ZTH: 2
2026-03-29 22:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4766d63c-47f2-5b85-8b2c-c4d089a16b5c with identifier: WV13%20ZTH
2026-03-29 22:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4766d63c-47f2-5b85-8b2c-c4d089a16b5c with scrape type 2
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4766d63c-47f2-5b85-8b2c-c4d089a16b5c with scrape type 2
2026-03-29 22:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4766d63c-47f2-5b85-8b2c-c4d089a16b5c, identifier: WV13%20ZTH
2026-03-29 22:01:46 [bca.uk] INFO: Found listing with ID: GU10%20JMO
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU10%2520JMO%27 HTTP/1.1" 200 None
2026-03-29 22:01:46 [bca.uk] INFO: Scrape type for GU10%20JMO: 1
2026-03-29 22:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac4d9299-bbf0-53f0-9801-f000c8d0940d with identifier: GU10%20JMO
2026-03-29 22:01:46 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ac4d9299-bbf0-53f0-9801-f000c8d0940d
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388445%27 HTTP/1.1" 200 None
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388445 not downloaded yet
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426091%27 HTTP/1.1" 200 None
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426091 not downloaded yet
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636798d0>
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF17VPN%252F699073271%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073271/600 saved to cache
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5439021f-449a-5c9e-a193-64352e476208
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6367bad0>
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12WNS%252F699023576%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023576/600 saved to cache
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4e630b36-cd01-5007-b4b4-e80c316bb326
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63547210>
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST62SYF%252F699246821%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246821/600 saved to cache
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b294b559-83e7-5079-b89e-3524dea19cc0
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614b8950>
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO58EBF%252F699457254%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457254/600 saved to cache
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 779863fc-56f0-5718-9334-675ca35049bb
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621b8050>
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58XVG%252F699242996%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242996/600 saved to cache
2026-03-29 22:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cdbe3643-d056-5481-b487-6a8e20861864
2026-03-29 22:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4766d63c-47f2-5b85-8b2c-c4d089a16b5c with identifier: WV13%20ZTH
2026-03-29 22:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4766d63c-47f2-5b85-8b2c-c4d089a16b5c with identifier: WV13%20ZTH
2026-03-29 22:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4766d63c-47f2-5b85-8b2c-c4d089a16b5c with identifier: WV13%20ZTH to the API
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV13%20ZTH-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4766d63c-47f2-5b85-8b2c-c4d089a16b5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WV13 ZTH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WV13%20ZTH&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'C-MAX',
'odometer': 114926,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD C-MAX 2.0 TDCI 163 TITANIUM X MPV',
'transmission': 'manual',
'trim': 'TDCI 163 TITANIUM X',
'vin': 'WF0JXXWPBJDP35712',
'year': 2013}
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV13%2520ZTH%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [bca.uk] INFO: Saving data for WV13%20ZTH: {'auction_closing_time': 1774951200.0, 'created_time': 1774706609.436311, 'last_price_update_time': 1774821707.222223}
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WV13%2520ZTH') HTTP/1.1" 204 0
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251818%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251818 not downloaded yet
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250242%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250242 not downloaded yet
2026-03-29 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388344/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388344>
2026-03-29 22:01:47 [bca.uk] INFO: Found listing with ID: YC10%20VCE
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC10%2520VCE%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [bca.uk] INFO: Scrape type for YC10%20VCE: 0
2026-03-29 22:01:47 [bca.uk] INFO: Found listing with ID: YD62%20CXW
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD62%2520CXW%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [bca.uk] INFO: Scrape type for YD62%20CXW: 0
2026-03-29 22:01:47 [bca.uk] INFO: Found listing with ID: YH07%20EZO
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH07%2520EZO%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [bca.uk] INFO: Scrape type for YH07%20EZO: 0
2026-03-29 22:01:47 [bca.uk] INFO: Found listing with ID: BT73%20RVP
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT73%2520RVP%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [bca.uk] INFO: Scrape type for BT73%20RVP: 1
2026-03-29 22:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85fa43ad-0cd8-5fcb-8570-724bee64deae with identifier: BT73%20RVP
2026-03-29 22:01:47 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 85fa43ad-0cd8-5fcb-8570-724bee64deae
2026-03-29 22:01:47 [bca.uk] INFO: Found listing with ID: OV62%20WYY
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV62%2520WYY%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [bca.uk] INFO: Scrape type for OV62%20WYY: 1
2026-03-29 22:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24ad4fc7-54b2-5a7b-9fae-16e0849e8972 with identifier: OV62%20WYY
2026-03-29 22:01:47 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 24ad4fc7-54b2-5a7b-9fae-16e0849e8972
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388471%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388471 not downloaded yet
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426103%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426103 not downloaded yet
2026-03-29 22:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617fed90>
2026-03-29 22:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_expert_report_file_11d605b0-43fd-4596-be8b-2e85d6d6f8c9.pdf HTTP/1.1" 201 0
2026-03-29 22:01:47 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 65250f67-b63f-5f19-a165-a7afa44cd815
2026-03-29 22:01:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65250f67-b63f-5f19-a165-a7afa44cd815, skipping ID generation
2026-03-29 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65250f67-b63f-5f19-a165-a7afa44cd815
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMT64GVX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MT64GVX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023450/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023450>
2026-03-29 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457252/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457252>
2026-03-29 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388358/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388358>
2026-03-29 22:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246789/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246789>
2026-03-29 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246805/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST62SYF/42809590?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=r1Z4o1RO41%2Frbsi6j2NujNSq2CIa1MRr3E0xDNV9JdE%3D)
2026-03-29 22:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457253/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO58EBF/42810110?sv=2020-08-04&st=2026-03-29T22%3A01%3A02Z&se=2026-03-29T22%3A26%3A02Z&sr=b&sp=r&sig=l1yGxyGiXjxmhLTIgBa00vRGvOItb%2B7FOLk9BOk0TjI%3D)
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251827%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251827 not downloaded yet
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250248%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250248 not downloaded yet
2026-03-29 22:01:47 [bca.uk] INFO: Found listing with ID: OE68%20NPP
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE68%2520NPP%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [bca.uk] INFO: Scrape type for OE68%20NPP: 2
2026-03-29 22:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7d28589-fb9e-53e0-a969-3ddefcb6568d with identifier: OE68%20NPP
2026-03-29 22:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7d28589-fb9e-53e0-a969-3ddefcb6568d with scrape type 2
2026-03-29 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7d28589-fb9e-53e0-a969-3ddefcb6568d with scrape type 2
2026-03-29 22:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d7d28589-fb9e-53e0-a969-3ddefcb6568d, identifier: OE68%20NPP
2026-03-29 22:01:47 [bca.uk] INFO: Found listing with ID: WP06%20LGD
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP06%2520LGD%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [bca.uk] INFO: Scrape type for WP06%20LGD: 1
2026-03-29 22:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd537952-b4a0-5a83-afdd-36c493417154 with identifier: WP06%20LGD
2026-03-29 22:01:47 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bd537952-b4a0-5a83-afdd-36c493417154
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388482%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388482 not downloaded yet
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426120%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426120 not downloaded yet
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392005%27 HTTP/1.1" 200 None
2026-03-29 22:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392005 not downloaded yet
2026-03-29 22:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d7d28589-fb9e-53e0-a969-3ddefcb6568d with identifier: OE68%20NPP
2026-03-29 22:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d7d28589-fb9e-53e0-a969-3ddefcb6568d with identifier: OE68%20NPP
2026-03-29 22:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d7d28589-fb9e-53e0-a969-3ddefcb6568d with identifier: OE68%20NPP to the API
2026-03-29 22:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 186,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OE68%20NPP-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd7d28589-fb9e-53e0-a969-3ddefcb6568d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OE68 NPP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OE68%20NPP&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 43868,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 SD4 240 HSE StationWagon',
'transmission': 'automatic',
'trim': 'SD4 240 HSE',
'vin': 'SALCA2AN1KH800979',
'year': 2018}
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE68%2520NPP%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [bca.uk] INFO: Saving data for OE68%20NPP: {'auction_closing_time': 1774951200.0, 'created_time': 1774390935.79991, 'last_price_update_time': 1774821708.206327}
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OE68%2520NPP') HTTP/1.1" 204 0
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251834%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251834 not downloaded yet
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250259%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250259 not downloaded yet
2026-03-29 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61746550>
2026-03-29 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_expert_report_file_013874a4-58a1-4121-8c39-5732ce8ba4e4.pdf HTTP/1.1" 201 0
2026-03-29 22:01:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c286c031-4c72-5d7f-8c06-04157dc85649
2026-03-29 22:01:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c286c031-4c72-5d7f-8c06-04157dc85649, skipping ID generation
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c286c031-4c72-5d7f-8c06-04157dc85649
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLT64BWF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT64BWF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388325/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68OTW/42811886?sv=2020-08-04&st=2026-03-29T22%3A01%3A29Z&se=2026-03-29T22%3A26%3A29Z&sr=b&sp=r&sig=fuk2ajppUL%2BpY5Jq%2BLDEOSIJIqcNrPdxnkllkXnrnUc%3D)
2026-03-29 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388379/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388379>
2026-03-29 22:01:48 [bca.uk] INFO: Found listing with ID: DX68%20HXN
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX68%2520HXN%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [bca.uk] INFO: Scrape type for DX68%20HXN: 0
2026-03-29 22:01:48 [bca.uk] INFO: Found listing with ID: IXZ%208865
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27IXZ%25208865%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [bca.uk] INFO: Scrape type for IXZ%208865: 1
2026-03-29 22:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d19e50d-f395-509a-9c03-74299fc0a339 with identifier: IXZ%208865
2026-03-29 22:01:48 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2d19e50d-f395-509a-9c03-74299fc0a339
2026-03-29 22:01:48 [bca.uk] INFO: Found listing with ID: GV18%20BTX
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV18%2520BTX%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [bca.uk] INFO: Scrape type for GV18%20BTX: 1
2026-03-29 22:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f452a12-ff71-5168-a92c-5282beaef88c with identifier: GV18%20BTX
2026-03-29 22:01:48 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9f452a12-ff71-5168-a92c-5282beaef88c
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388498%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388498 not downloaded yet
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426130%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426130 not downloaded yet
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392008%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392008 not downloaded yet
2026-03-29 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073258/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF17VPN/42811060?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=YkLrcIHkwtrZsjUa2prubREuXQStMy8DMOWlaZjCM6o%3D)
2026-03-29 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023478/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12WNS/42810774?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=tTo%2B0xotySQc25NFgljm0ZLwDTnsvqG5v%2FSimEvL7PM%3D)
2026-03-29 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242976/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58XVG/42790595?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=vcjXHy%2BXcxnL8fVcBSIy1zRUfNwdkYA77TQSDd3JyNw%3D)
2026-03-29 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211077/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO08HUA/42769935?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=UrTho4OU5emtGOfXKZ0dWvPhmltT%2BxjdBAxxllTvFdc%3D)
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251845%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251845 not downloaded yet
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250273%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250273 not downloaded yet
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400458%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400458 not downloaded yet
2026-03-29 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61811150>
2026-03-29 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST62SYF%252F699246805%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246805/600 saved to cache
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b294b559-83e7-5079-b89e-3524dea19cc0
2026-03-29 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636f4a10>
2026-03-29 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO58EBF%252F699457253%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457253/600 saved to cache
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 779863fc-56f0-5718-9334-675ca35049bb
2026-03-29 22:01:48 [bca.uk] INFO: Found listing with ID: VU17%20ESV
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU17%2520ESV%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [bca.uk] INFO: Scrape type for VU17%20ESV: 1
2026-03-29 22:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b771c8f-dd52-56d3-87b9-72b4d2130708 with identifier: VU17%20ESV
2026-03-29 22:01:48 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8b771c8f-dd52-56d3-87b9-72b4d2130708
2026-03-29 22:01:48 [bca.uk] INFO: Found listing with ID: HV18%20WBP
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV18%2520WBP%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [bca.uk] INFO: Scrape type for HV18%20WBP: 1
2026-03-29 22:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c168010-7a7e-5fdd-b0cd-fac1fdc97858 with identifier: HV18%20WBP
2026-03-29 22:01:48 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1c168010-7a7e-5fdd-b0cd-fac1fdc97858
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388507%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388507 not downloaded yet
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426143%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426143 not downloaded yet
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392010%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392010 not downloaded yet
2026-03-29 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN62UZG/42812357?sv=2020-08-04&st=2026-03-29T22%3A01%3A45Z&se=2026-03-29T22%3A26%3A45Z&sr=b&sp=r&sig=X9pErQDsrXNy4qMwHp8m59UtcG5VKGVtuCOpQCnsZBk%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251858%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251858 not downloaded yet
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250294%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250294 not downloaded yet
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400464%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400464 not downloaded yet
2026-03-29 22:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618087d0>
2026-03-29 22:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68OTW%252F699388325%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388325/600 saved to cache
2026-03-29 22:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4
2026-03-29 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388358/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68OTW/42811886?sv=2020-08-04&st=2026-03-29T22%3A01%3A29Z&se=2026-03-29T22%3A26%3A29Z&sr=b&sp=r&sig=fuk2ajppUL%2BpY5Jq%2BLDEOSIJIqcNrPdxnkllkXnrnUc%3D)
2026-03-29 22:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426066/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LX68ORU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457252/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO58EBF/42810110?sv=2020-08-04&st=2026-03-29T22%3A01%3A02Z&se=2026-03-29T22%3A26%3A02Z&sr=b&sp=r&sig=l1yGxyGiXjxmhLTIgBa00vRGvOItb%2B7FOLk9BOk0TjI%3D)
2026-03-29 22:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388344/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68OTW/42811886?sv=2020-08-04&st=2026-03-29T22%3A01%3A29Z&se=2026-03-29T22%3A26%3A29Z&sr=b&sp=r&sig=fuk2ajppUL%2BpY5Jq%2BLDEOSIJIqcNrPdxnkllkXnrnUc%3D)
2026-03-29 22:01:48 [bca.uk] INFO: Found listing with ID: BL15%20GPF
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL15%2520GPF%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [bca.uk] INFO: Scrape type for BL15%20GPF: 1
2026-03-29 22:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d69b9e39-94d5-5512-b4c2-1dbe0861f944 with identifier: BL15%20GPF
2026-03-29 22:01:48 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d69b9e39-94d5-5512-b4c2-1dbe0861f944
2026-03-29 22:01:48 [bca.uk] INFO: Found listing with ID: LO18%20HDJ
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO18%2520HDJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:48 [bca.uk] INFO: Scrape type for LO18%20HDJ: 1
2026-03-29 22:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdab8438-e5c7-52d5-82d4-2d0efd86d463 with identifier: LO18%20HDJ
2026-03-29 22:01:48 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bdab8438-e5c7-52d5-82d4-2d0efd86d463
2026-03-29 22:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426159%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426159 not downloaded yet
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392011%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392011 not downloaded yet
2026-03-29 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250212/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CX05YUG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023450/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12WNS/42810774?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=tTo%2B0xotySQc25NFgljm0ZLwDTnsvqG5v%2FSimEvL7PM%3D)
2026-03-29 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246789/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST62SYF/42809590?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=r1Z4o1RO41%2Frbsi6j2NujNSq2CIa1MRr3E0xDNV9JdE%3D)
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251875%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251875 not downloaded yet
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250312%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250312 not downloaded yet
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400468%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400468 not downloaded yet
2026-03-29 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250242/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250242>
2026-03-29 22:01:49 [bca.uk] INFO: Found listing with ID: DS67%20KOJ
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS67%2520KOJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [bca.uk] INFO: Scrape type for DS67%20KOJ: 1
2026-03-29 22:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1059463b-3c93-584e-a414-d6327bf60ecc with identifier: DS67%20KOJ
2026-03-29 22:01:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1059463b-3c93-584e-a414-d6327bf60ecc
2026-03-29 22:01:49 [bca.uk] INFO: Found listing with ID: NL20%20LHD
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL20%2520LHD%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [bca.uk] INFO: Scrape type for NL20%20LHD: 1
2026-03-29 22:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 567aca6a-4739-5529-95c7-9434b19eb603 with identifier: NL20%20LHD
2026-03-29 22:01:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 567aca6a-4739-5529-95c7-9434b19eb603
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426188%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426188 not downloaded yet
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392014%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392014 not downloaded yet
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6867afd0>
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF17VPN%252F699073258%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073258/600 saved to cache
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5439021f-449a-5c9e-a193-64352e476208
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6182f7d0>
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12WNS%252F699023478%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023478/600 saved to cache
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4e630b36-cd01-5007-b4b4-e80c316bb326
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637b50d0>
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58XVG%252F699242976%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242976/600 saved to cache
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cdbe3643-d056-5481-b487-6a8e20861864
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63575fd0>
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO08HUA%252F699211077%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211077/600 saved to cache
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9816a6af-47f8-5106-89d9-6d77d25fd0f4
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637fa710>
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_expert_report_file_6efc9d43-76d4-4c65-99ed-eac49e447b6c.pdf HTTP/1.1" 201 0
2026-03-29 22:01:49 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f0b17972-5ab7-56c0-825d-14139cf5492c
2026-03-29 22:01:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0b17972-5ab7-56c0-825d-14139cf5492c, skipping ID generation
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f0b17972-5ab7-56c0-825d-14139cf5492c
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBN62UZG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BN62UZG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388379/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68OTW/42811886?sv=2020-08-04&st=2026-03-29T22%3A01%3A29Z&se=2026-03-29T22%3A26%3A29Z&sr=b&sp=r&sig=fuk2ajppUL%2BpY5Jq%2BLDEOSIJIqcNrPdxnkllkXnrnUc%3D)
2026-03-29 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251818/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251818>
2026-03-29 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400450/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT64BWF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250259/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250259>
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251890%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251890 not downloaded yet
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250332%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250332 not downloaded yet
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400473%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400473 not downloaded yet
2026-03-29 22:01:49 [bca.uk] INFO: Found listing with ID: FL64%20TGO
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL64%2520TGO%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [bca.uk] INFO: Scrape type for FL64%20TGO: 1
2026-03-29 22:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f1adfaa-144b-529f-85fc-38ebafca0461 with identifier: FL64%20TGO
2026-03-29 22:01:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9f1adfaa-144b-529f-85fc-38ebafca0461
2026-03-29 22:01:49 [bca.uk] INFO: Found listing with ID: GY18%20YLV
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY18%2520YLV%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [bca.uk] INFO: Scrape type for GY18%20YLV: 1
2026-03-29 22:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ddd1886-59fc-5660-a00b-37dddc9ca1b3 with identifier: GY18%20YLV
2026-03-29 22:01:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0ddd1886-59fc-5660-a00b-37dddc9ca1b3
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426208%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426208 not downloaded yet
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392017%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392017 not downloaded yet
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435117%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435117 not downloaded yet
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400478%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400478 not downloaded yet
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61819d50>
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68OTW%252F699388358%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388358/600 saved to cache
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618ce890>
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO58EBF%252F699457252%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457252/600 saved to cache
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 779863fc-56f0-5718-9334-675ca35049bb
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6331bb10>
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68OTW%252F699388344%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388344/600 saved to cache
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616bba90>
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12WNS%252F699023450%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023450/600 saved to cache
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4e630b36-cd01-5007-b4b4-e80c316bb326
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63779190>
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST62SYF%252F699246789%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246789/600 saved to cache
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b294b559-83e7-5079-b89e-3524dea19cc0
2026-03-29 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251834/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251834>
2026-03-29 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400458/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400458>
2026-03-29 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392005/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392005>
2026-03-29 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426066/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX68ORU/42812293?sv=2020-08-04&st=2026-03-29T22%3A01%3A38Z&se=2026-03-29T22%3A26%3A38Z&sr=b&sp=r&sig=dTIgs41eJnjcU89aOFdmMmWrmPHqSDyWtMj1MxYIWm4%3D)
2026-03-29 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392010/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392010>
2026-03-29 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388507/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388507>
2026-03-29 22:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426143/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426143>
2026-03-29 22:01:49 [bca.uk] INFO: Found listing with ID: BJ51%20OUG
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ51%2520OUG%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [bca.uk] INFO: Scrape type for BJ51%20OUG: 1
2026-03-29 22:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff1eccc8-fddb-5844-83d2-04a1cea933d7 with identifier: BJ51%20OUG
2026-03-29 22:01:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ff1eccc8-fddb-5844-83d2-04a1cea933d7
2026-03-29 22:01:49 [bca.uk] INFO: Found listing with ID: HK59%20XZJ
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK59%2520XZJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [bca.uk] INFO: Scrape type for HK59%20XZJ: 1
2026-03-29 22:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63ad9332-ca60-5606-b72d-c629c976dd98 with identifier: HK59%20XZJ
2026-03-29 22:01:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 63ad9332-ca60-5606-b72d-c629c976dd98
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426221%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426221 not downloaded yet
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392022%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392022 not downloaded yet
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699432935%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432935 not downloaded yet
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400484%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400484 not downloaded yet
2026-03-29 22:01:49 [bca.uk] INFO: Found listing with ID: DA08%20NWF
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA08%2520NWF%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [bca.uk] INFO: Scrape type for DA08%20NWF: 1
2026-03-29 22:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55260bef-13ca-53e6-8438-967001fdad8a with identifier: DA08%20NWF
2026-03-29 22:01:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 55260bef-13ca-53e6-8438-967001fdad8a
2026-03-29 22:01:49 [bca.uk] INFO: Found listing with ID: EO67%20CJZ
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO67%2520CJZ%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [bca.uk] INFO: Scrape type for EO67%20CJZ: 1
2026-03-29 22:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4452e7a2-008a-5460-ac69-330bdd58f5d4 with identifier: EO67%20CJZ
2026-03-29 22:01:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4452e7a2-008a-5460-ac69-330bdd58f5d4
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392026%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392026 not downloaded yet
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435125%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435125 not downloaded yet
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63767210>
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68OTW%252F699388379%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388379/600 saved to cache
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400489%27 HTTP/1.1" 200 None
2026-03-29 22:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400489 not downloaded yet
2026-03-29 22:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250212/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX05YUG/42800121?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=MySGDJ66pbFCM8Of63GwPM4lST90Oc%2FUCupYTeM%2FDJ0%3D)
2026-03-29 22:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250242/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX05YUG/42800121?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=MySGDJ66pbFCM8Of63GwPM4lST90Oc%2FUCupYTeM%2FDJ0%3D)
2026-03-29 22:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251818/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66SVX/42805972?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=yl9q46AoV3wQNjXIFCNniksZeCLN9BE%2FANgZ6Iluhps%3D)
2026-03-29 22:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400450/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64BWF/42812128?sv=2020-08-04&st=2026-03-29T22%3A01%3A41Z&se=2026-03-29T22%3A26%3A41Z&sr=b&sp=r&sig=MzwyyqM%2Fq9XpCMHPmp7VRaX08ubizr8jYVfx3e066Lo%3D)
2026-03-29 22:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250259/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX05YUG/42800121?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=MySGDJ66pbFCM8Of63GwPM4lST90Oc%2FUCupYTeM%2FDJ0%3D)
2026-03-29 22:01:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426159/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426159>
2026-03-29 22:01:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392011/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392011>
2026-03-29 22:01:50 [bca.uk] INFO: Found listing with ID: LB06%20FEG
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB06%2520FEG%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [bca.uk] INFO: Scrape type for LB06%20FEG: 1
2026-03-29 22:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a15dc9f-1f43-5f77-8956-0299042e5086 with identifier: LB06%20FEG
2026-03-29 22:01:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5a15dc9f-1f43-5f77-8956-0299042e5086
2026-03-29 22:01:50 [bca.uk] INFO: Found listing with ID: EJ65%20LKG
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ65%2520LKG%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [bca.uk] INFO: Scrape type for EJ65%20LKG: 1
2026-03-29 22:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26623def-55ab-5dd0-bf5f-2b44624045f6 with identifier: EJ65%20LKG
2026-03-29 22:01:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 26623def-55ab-5dd0-bf5f-2b44624045f6
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392030%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392030 not downloaded yet
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699432946%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432946 not downloaded yet
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400494%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400494 not downloaded yet
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61508350>
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX68ORU%252F699426066%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426066/600 saved to cache
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0556e924-104a-5552-a701-fc5b5327996f
2026-03-29 22:01:50 [bca.uk] INFO: Found listing with ID: NA04%20XFU
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA04%2520XFU%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [bca.uk] INFO: Scrape type for NA04%20XFU: 1
2026-03-29 22:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6199b36-64a9-5e19-9093-4273bab95743 with identifier: NA04%20XFU
2026-03-29 22:01:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e6199b36-64a9-5e19-9093-4273bab95743
2026-03-29 22:01:50 [bca.uk] INFO: Found listing with ID: FY64%20YYK
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY64%2520YYK%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [bca.uk] INFO: Scrape type for FY64%20YYK: 1
2026-03-29 22:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7797c46-b28a-5526-a960-afcea68790a7 with identifier: FY64%20YYK
2026-03-29 22:01:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a7797c46-b28a-5526-a960-afcea68790a7
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435133%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435133 not downloaded yet
2026-03-29 22:01:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426120/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426120>
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400498%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400498 not downloaded yet
2026-03-29 22:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392010/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT64GVX/42811943?sv=2020-08-04&st=2026-03-29T22%3A01%3A40Z&se=2026-03-29T22%3A26%3A40Z&sr=b&sp=r&sig=cep50iJLm5T2T%2FJIF3KYJUQN262Xx397yLSJF4VsirI%3D)
2026-03-29 22:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426143/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX68ORU/42812293?sv=2020-08-04&st=2026-03-29T22%3A01%3A38Z&se=2026-03-29T22%3A26%3A38Z&sr=b&sp=r&sig=dTIgs41eJnjcU89aOFdmMmWrmPHqSDyWtMj1MxYIWm4%3D)
2026-03-29 22:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251834/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66SVX/42805972?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=yl9q46AoV3wQNjXIFCNniksZeCLN9BE%2FANgZ6Iluhps%3D)
2026-03-29 22:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392005/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT64GVX/42811943?sv=2020-08-04&st=2026-03-29T22%3A01%3A40Z&se=2026-03-29T22%3A26%3A40Z&sr=b&sp=r&sig=cep50iJLm5T2T%2FJIF3KYJUQN262Xx397yLSJF4VsirI%3D)
2026-03-29 22:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400458/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64BWF/42812128?sv=2020-08-04&st=2026-03-29T22%3A01%3A41Z&se=2026-03-29T22%3A26%3A41Z&sr=b&sp=r&sig=MzwyyqM%2Fq9XpCMHPmp7VRaX08ubizr8jYVfx3e066Lo%3D)
2026-03-29 22:01:50 [bca.uk] INFO: Found listing with ID: BW15%20CWC
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW15%2520CWC%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [bca.uk] INFO: Scrape type for BW15%20CWC: 0
2026-03-29 22:01:50 [bca.uk] INFO: Found listing with ID: EK10%20GHA
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK10%2520GHA%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [bca.uk] INFO: Scrape type for EK10%20GHA: 1
2026-03-29 22:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec08eddb-f63d-54e1-9917-94a9b51f829d with identifier: EK10%20GHA
2026-03-29 22:01:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ec08eddb-f63d-54e1-9917-94a9b51f829d
2026-03-29 22:01:50 [bca.uk] INFO: Found listing with ID: RK59%20OSL
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK59%2520OSL%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [bca.uk] INFO: Scrape type for RK59%20OSL: 1
2026-03-29 22:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faae600b-2d2c-5cfb-9bd2-3ccad03ec918 with identifier: RK59%20OSL
2026-03-29 22:01:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item faae600b-2d2c-5cfb-9bd2-3ccad03ec918
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699432959%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432959 not downloaded yet
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63559a50>
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX05YUG%252F699250212%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250212/600 saved to cache
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f8e435e-d477-50a3-aea7-4952aa2ce397
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6368c3d0>
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX05YUG%252F699250242%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250242/600 saved to cache
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f8e435e-d477-50a3-aea7-4952aa2ce397
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63574e90>
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66SVX%252F699251818%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251818/600 saved to cache
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 392ba6d2-142e-521e-9c14-6f3c87e57d15
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6365dbd0>
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64BWF%252F699400450%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400450/600 saved to cache
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c286c031-4c72-5d7f-8c06-04157dc85649
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6185fe50>
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX05YUG%252F699250259%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250259/600 saved to cache
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f8e435e-d477-50a3-aea7-4952aa2ce397
2026-03-29 22:01:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400468/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400468>
2026-03-29 22:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388507/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68OTW/42811886?sv=2020-08-04&st=2026-03-29T22%3A01%3A29Z&se=2026-03-29T22%3A26%3A29Z&sr=b&sp=r&sig=fuk2ajppUL%2BpY5Jq%2BLDEOSIJIqcNrPdxnkllkXnrnUc%3D)
2026-03-29 22:01:50 [bca.uk] INFO: Found listing with ID: GV13%20PTO
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV13%2520PTO%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [bca.uk] INFO: Scrape type for GV13%20PTO: 1
2026-03-29 22:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c5d6f92-e516-5861-9e52-fa759468ecc2 with identifier: GV13%20PTO
2026-03-29 22:01:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8c5d6f92-e516-5861-9e52-fa759468ecc2
2026-03-29 22:01:50 [bca.uk] INFO: Found listing with ID: MA57%20YZF
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA57%2520YZF%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [bca.uk] INFO: Scrape type for MA57%20YZF: 1
2026-03-29 22:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3ee94bc-ee6e-5446-95d3-63f1fb5a289c with identifier: MA57%20YZF
2026-03-29 22:01:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d3ee94bc-ee6e-5446-95d3-63f1fb5a289c
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435140%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435140 not downloaded yet
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6209b850>
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT64GVX%252F699392010%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392010/600 saved to cache
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65250f67-b63f-5f19-a165-a7afa44cd815
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61776010>
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX68ORU%252F699426143%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426143/600 saved to cache
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0556e924-104a-5552-a701-fc5b5327996f
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6173f050>
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66SVX%252F699251834%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251834/600 saved to cache
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 392ba6d2-142e-521e-9c14-6f3c87e57d15
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614edbd0>
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT64GVX%252F699392005%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392005/600 saved to cache
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65250f67-b63f-5f19-a165-a7afa44cd815
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61846590>
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64BWF%252F699400458%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400458/600 saved to cache
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c286c031-4c72-5d7f-8c06-04157dc85649
2026-03-29 22:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392011/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT64GVX/42811943?sv=2020-08-04&st=2026-03-29T22%3A01%3A40Z&se=2026-03-29T22%3A26%3A40Z&sr=b&sp=r&sig=cep50iJLm5T2T%2FJIF3KYJUQN262Xx397yLSJF4VsirI%3D)
2026-03-29 22:01:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392026/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392026>
2026-03-29 22:01:50 [bca.uk] INFO: Found listing with ID: PK62%20FRL
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK62%2520FRL%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [bca.uk] INFO: Scrape type for PK62%20FRL: 0
2026-03-29 22:01:50 [bca.uk] INFO: Found listing with ID: SJ14%20OEO
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ14%2520OEO%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [bca.uk] INFO: Scrape type for SJ14%20OEO: 0
2026-03-29 22:01:50 [bca.uk] INFO: Found listing with ID: YR58%20LGK
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR58%2520LGK%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [bca.uk] INFO: Scrape type for YR58%20LGK: 0
2026-03-29 22:01:50 [bca.uk] INFO: Found listing with ID: MF14%20BJJ
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF14%2520BJJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [bca.uk] INFO: Scrape type for MF14%20BJJ: 0
2026-03-29 22:01:50 [bca.uk] INFO: Found listing with ID: PJ61%20APK
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ61%2520APK%27 HTTP/1.1" 200 None
2026-03-29 22:01:50 [bca.uk] INFO: Scrape type for PJ61%20APK: 2
2026-03-29 22:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3b8d87e-26a0-5a66-8e5c-a30517c7ec87 with identifier: PJ61%20APK
2026-03-29 22:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3b8d87e-26a0-5a66-8e5c-a30517c7ec87 with scrape type 2
2026-03-29 22:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3b8d87e-26a0-5a66-8e5c-a30517c7ec87 with scrape type 2
2026-03-29 22:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f3b8d87e-26a0-5a66-8e5c-a30517c7ec87, identifier: PJ61%20APK
2026-03-29 22:01:51 [bca.uk] INFO: Found listing with ID: NU58%20OJT
2026-03-29 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU58%2520OJT%27 HTTP/1.1" 200 None
2026-03-29 22:01:51 [bca.uk] INFO: Scrape type for NU58%20OJT: 1
2026-03-29 22:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae5b05cb-e1db-52c3-a568-516b686268d9 with identifier: NU58%20OJT
2026-03-29 22:01:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ae5b05cb-e1db-52c3-a568-516b686268d9
2026-03-29 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699432980%27 HTTP/1.1" 200 None
2026-03-29 22:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432980 not downloaded yet
2026-03-29 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO67CJZ/42812295?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=f5P0DwslIG4nez3ramT%2BBglIeMphiUhV3LeShcWO2lA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO67%20CJZ-GB>
2026-03-29 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435125/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435125>
2026-03-29 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435117/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435117>
2026-03-29 22:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400489/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400489>
2026-03-29 22:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f3b8d87e-26a0-5a66-8e5c-a30517c7ec87 with identifier: PJ61%20APK
2026-03-29 22:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f3b8d87e-26a0-5a66-8e5c-a30517c7ec87 with identifier: PJ61%20APK
2026-03-29 22:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f3b8d87e-26a0-5a66-8e5c-a30517c7ec87 with identifier: PJ61%20APK to the API
2026-03-29 22:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 162,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ61%20APK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.3L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f3b8d87e-26a0-5a66-8e5c-a30517c7ec87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ61 APK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ61%20APK&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'SUZUKI',
'model': 'JIMNY',
'odometer': 52080,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'SUZUKI JIMNY 1.3 VVT SZ4 Estate',
'transmission': 'manual',
'trim': 'VVT SZ4',
'vin': 'JSAFJB43V00524957',
'year': 2012}
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ61%2520APK%27 HTTP/1.1" 200 None
2026-03-29 22:01:52 [bca.uk] INFO: Saving data for PJ61%20APK: {'auction_closing_time': 1774951200.0, 'created_time': 1774102205.356445, 'last_price_update_time': 1774821712.436842}
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ61%2520APK') HTTP/1.1" 204 0
2026-03-29 22:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08NWF/42812303?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=%2FmvSSUyiAYVN8KnXHHAVZPAhaX5NwULjoP6vZooLMQE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA08%20NWF-GB>
2026-03-29 22:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426159/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX68ORU/42812293?sv=2020-08-04&st=2026-03-29T22%3A01%3A38Z&se=2026-03-29T22%3A26%3A38Z&sr=b&sp=r&sig=dTIgs41eJnjcU89aOFdmMmWrmPHqSDyWtMj1MxYIWm4%3D)
2026-03-29 22:01:52 [bca.uk] INFO: Found listing with ID: PE56%20LWD
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE56%2520LWD%27 HTTP/1.1" 200 None
2026-03-29 22:01:52 [bca.uk] INFO: Scrape type for PE56%20LWD: 1
2026-03-29 22:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 569e1cde-1a47-540d-9d22-90c30237a2e3 with identifier: PE56%20LWD
2026-03-29 22:01:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 569e1cde-1a47-540d-9d22-90c30237a2e3
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435147%27 HTTP/1.1" 200 None
2026-03-29 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435147 not downloaded yet
2026-03-29 22:01:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61bbffd0>
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68OTW%252F699388507%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388507/600 saved to cache
2026-03-29 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4
2026-03-29 22:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426120/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX68ORU/42812293?sv=2020-08-04&st=2026-03-29T22%3A01%3A38Z&se=2026-03-29T22%3A26%3A38Z&sr=b&sp=r&sig=dTIgs41eJnjcU89aOFdmMmWrmPHqSDyWtMj1MxYIWm4%3D)
2026-03-29 22:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435133/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435133>
2026-03-29 22:01:52 [bca.uk] INFO: Found listing with ID: SP12%20UBA
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP12%2520UBA%27 HTTP/1.1" 200 None
2026-03-29 22:01:52 [bca.uk] INFO: Scrape type for SP12%20UBA: 1
2026-03-29 22:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17812872-0c62-52de-9646-8110c3ee0253 with identifier: SP12%20UBA
2026-03-29 22:01:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 17812872-0c62-52de-9646-8110c3ee0253
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61bbf810>
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT64GVX%252F699392011%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392011/600 saved to cache
2026-03-29 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65250f67-b63f-5f19-a165-a7afa44cd815
2026-03-29 22:01:52 [bca.uk] INFO: Found listing with ID: RNZ%205340
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RNZ%25205340%27 HTTP/1.1" 200 None
2026-03-29 22:01:52 [bca.uk] INFO: Scrape type for RNZ%205340: 1
2026-03-29 22:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9599de9-498d-5a1e-accc-599bd100e89a with identifier: RNZ%205340
2026-03-29 22:01:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c9599de9-498d-5a1e-accc-599bd100e89a
2026-03-29 22:01:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c7ac10>
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX68ORU%252F699426159%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426159/600 saved to cache
2026-03-29 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0556e924-104a-5552-a701-fc5b5327996f
2026-03-29 22:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400494/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400494>
2026-03-29 22:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699432959/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432959>
2026-03-29 22:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400468/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64BWF/42812128?sv=2020-08-04&st=2026-03-29T22%3A01%3A41Z&se=2026-03-29T22%3A26%3A41Z&sr=b&sp=r&sig=MzwyyqM%2Fq9XpCMHPmp7VRaX08ubizr8jYVfx3e066Lo%3D)
2026-03-29 22:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NA04XFU/42812369?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=7XXhzPtvsDMZKwJi3NCUHNT0YaNfJtDfBNmw7ADL6OM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NA04%20XFU-GB>
2026-03-29 22:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY64YYK/42812362?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=rVxpK9Nu9k7RcTYnPo9WbYSk5dZ2Ab93q0jZLZNLD3o%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY64%20YYK-GB>
2026-03-29 22:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699432946/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432946>
2026-03-29 22:01:52 [bca.uk] INFO: Found listing with ID: BG13%20WCO
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG13%2520WCO%27 HTTP/1.1" 200 None
2026-03-29 22:01:52 [bca.uk] INFO: Scrape type for BG13%20WCO: 1
2026-03-29 22:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d11b73b-ecf9-57a3-a557-9234293fe7af with identifier: BG13%20WCO
2026-03-29 22:01:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1d11b73b-ecf9-57a3-a557-9234293fe7af
2026-03-29 22:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435140/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435140>
2026-03-29 22:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392026/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT64GVX/42811943?sv=2020-08-04&st=2026-03-29T22%3A01%3A40Z&se=2026-03-29T22%3A26%3A40Z&sr=b&sp=r&sig=cep50iJLm5T2T%2FJIF3KYJUQN262Xx397yLSJF4VsirI%3D)
2026-03-29 22:01:52 [bca.uk] INFO: Found listing with ID: DE14%20MHY
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE14%2520MHY%27 HTTP/1.1" 200 None
2026-03-29 22:01:52 [bca.uk] INFO: Scrape type for DE14%20MHY: 1
2026-03-29 22:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70ebff0d-7944-5d91-ab8e-f71690cfd864 with identifier: DE14%20MHY
2026-03-29 22:01:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 70ebff0d-7944-5d91-ab8e-f71690cfd864
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c4cfd0>
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX68ORU%252F699426120%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426120/600 saved to cache
2026-03-29 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0556e924-104a-5552-a701-fc5b5327996f
2026-03-29 22:01:52 [bca.uk] INFO: Found listing with ID: YA13%20XJE
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA13%2520XJE%27 HTTP/1.1" 200 None
2026-03-29 22:01:52 [bca.uk] INFO: Scrape type for YA13%20XJE: 1
2026-03-29 22:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56ffa4f0-fba8-5395-a6e0-5c3480fd2644 with identifier: YA13%20XJE
2026-03-29 22:01:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 56ffa4f0-fba8-5395-a6e0-5c3480fd2644
2026-03-29 22:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435117/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN62UZG/42812357?sv=2020-08-04&st=2026-03-29T22%3A01%3A45Z&se=2026-03-29T22%3A26%3A45Z&sr=b&sp=r&sig=X9pErQDsrXNy4qMwHp8m59UtcG5VKGVtuCOpQCnsZBk%3D)
2026-03-29 22:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699432980/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432980>
2026-03-29 22:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435125/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN62UZG/42812357?sv=2020-08-04&st=2026-03-29T22%3A01%3A45Z&se=2026-03-29T22%3A26%3A45Z&sr=b&sp=r&sig=X9pErQDsrXNy4qMwHp8m59UtcG5VKGVtuCOpQCnsZBk%3D)
2026-03-29 22:01:52 [bca.uk] INFO: Found listing with ID: PJ68%20NYD
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ68%2520NYD%27 HTTP/1.1" 200 None
2026-03-29 22:01:52 [bca.uk] INFO: Scrape type for PJ68%20NYD: 1
2026-03-29 22:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b59bed48-7f26-51b6-a928-99ee433fa2e5 with identifier: PJ68%20NYD
2026-03-29 22:01:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b59bed48-7f26-51b6-a928-99ee433fa2e5
2026-03-29 22:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400489/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64BWF/42812128?sv=2020-08-04&st=2026-03-29T22%3A01%3A41Z&se=2026-03-29T22%3A26%3A41Z&sr=b&sp=r&sig=MzwyyqM%2Fq9XpCMHPmp7VRaX08ubizr8jYVfx3e066Lo%3D)
2026-03-29 22:01:52 [bca.uk] INFO: Found listing with ID: OXZ%204088
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OXZ%25204088%27 HTTP/1.1" 200 None
2026-03-29 22:01:52 [bca.uk] INFO: Scrape type for OXZ%204088: 1
2026-03-29 22:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc361e13-3b83-5190-85ec-81054039e7f0 with identifier: OXZ%204088
2026-03-29 22:01:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cc361e13-3b83-5190-85ec-81054039e7f0
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620958d0>
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64BWF%252F699400468%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400468/600 saved to cache
2026-03-29 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c286c031-4c72-5d7f-8c06-04157dc85649
2026-03-29 22:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO67CJZ/42812295?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=f5P0DwslIG4nez3ramT%2BBglIeMphiUhV3LeShcWO2lA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435133/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN62UZG/42812357?sv=2020-08-04&st=2026-03-29T22%3A01%3A45Z&se=2026-03-29T22%3A26%3A45Z&sr=b&sp=r&sig=X9pErQDsrXNy4qMwHp8m59UtcG5VKGVtuCOpQCnsZBk%3D)
2026-03-29 22:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435147/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435147>
2026-03-29 22:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699432946/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN62UZG/42812357?sv=2020-08-04&st=2026-03-29T22%3A01%3A45Z&se=2026-03-29T22%3A26%3A45Z&sr=b&sp=r&sig=X9pErQDsrXNy4qMwHp8m59UtcG5VKGVtuCOpQCnsZBk%3D)
2026-03-29 22:01:52 [bca.uk] INFO: Found listing with ID: MM69%20SVE
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM69%2520SVE%27 HTTP/1.1" 200 None
2026-03-29 22:01:52 [bca.uk] INFO: Scrape type for MM69%20SVE: 2
2026-03-29 22:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cd4e224-c25f-56fd-8a13-77b1a6baa327 with identifier: MM69%20SVE
2026-03-29 22:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cd4e224-c25f-56fd-8a13-77b1a6baa327 with scrape type 2
2026-03-29 22:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cd4e224-c25f-56fd-8a13-77b1a6baa327 with scrape type 2
2026-03-29 22:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7cd4e224-c25f-56fd-8a13-77b1a6baa327, identifier: MM69%20SVE
2026-03-29 22:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08NWF/42812303?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=%2FmvSSUyiAYVN8KnXHHAVZPAhaX5NwULjoP6vZooLMQE%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7cd4e224-c25f-56fd-8a13-77b1a6baa327 with identifier: MM69%20SVE
2026-03-29 22:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7cd4e224-c25f-56fd-8a13-77b1a6baa327 with identifier: MM69%20SVE
2026-03-29 22:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7cd4e224-c25f-56fd-8a13-77b1a6baa327 with identifier: MM69%20SVE to the API
2026-03-29 22:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MM69%20SVE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7cd4e224-c25f-56fd-8a13-77b1a6baa327',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MM69 SVE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MM69%20SVE&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'FIESTA ACTIVE',
'odometer': 30493,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FORD FIESTA ACTIVE 1.0 E/B 100 X Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 X',
'vin': 'WF0JXXGAHJKS24565',
'year': 2020}
2026-03-29 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM69%2520SVE%27 HTTP/1.1" 200 None
2026-03-29 22:01:53 [bca.uk] INFO: Saving data for MM69%20SVE: {'auction_closing_time': 1774951200.0, 'created_time': 1774418747.59233, 'last_price_update_time': 1774821713.478237}
2026-03-29 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MM69%2520SVE') HTTP/1.1" 204 0
2026-03-29 22:01:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6207a550>
2026-03-29 22:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT64GVX%252F699392026%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392026/600 saved to cache
2026-03-29 22:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 65250f67-b63f-5f19-a165-a7afa44cd815
2026-03-29 22:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699432959/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN62UZG/42812357?sv=2020-08-04&st=2026-03-29T22%3A01%3A45Z&se=2026-03-29T22%3A26%3A45Z&sr=b&sp=r&sig=X9pErQDsrXNy4qMwHp8m59UtcG5VKGVtuCOpQCnsZBk%3D)
2026-03-29 22:01:53 [bca.uk] INFO: Found listing with ID: SN66%20TXZ
2026-03-29 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN66%2520TXZ%27 HTTP/1.1" 200 None
2026-03-29 22:01:53 [bca.uk] INFO: Scrape type for SN66%20TXZ: 2
2026-03-29 22:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09e16d97-cf19-589c-9507-63ba990dd971 with identifier: SN66%20TXZ
2026-03-29 22:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09e16d97-cf19-589c-9507-63ba990dd971 with scrape type 2
2026-03-29 22:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09e16d97-cf19-589c-9507-63ba990dd971 with scrape type 2
2026-03-29 22:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 09e16d97-cf19-589c-9507-63ba990dd971, identifier: SN66%20TXZ
2026-03-29 22:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 09e16d97-cf19-589c-9507-63ba990dd971 with identifier: SN66%20TXZ
2026-03-29 22:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:01:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=multicoloured HTTP/1.1" 200 None
2026-03-29 22:01:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 09e16d97-cf19-589c-9507-63ba990dd971 with identifier: SN66%20TXZ
2026-03-29 22:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 09e16d97-cf19-589c-9507-63ba990dd971 with identifier: SN66%20TXZ to the API
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 95,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SN66%20TXZ-GB',
'category': 'Car',
'color': 'multicoloured',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '09e16d97-cf19-589c-9507-63ba990dd971',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SN66 TXZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SN66%20TXZ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 47081,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'RENAULT CAPTUR 1.5 DCI 90 DYNAMIQUE S Hatchback',
'transmission': 'manual',
'trim': 'DCI 90 DYNAMIQUE S',
'vin': 'VF12RAJ1A56141327',
'year': 2016}
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN66%2520TXZ%27 HTTP/1.1" 200 None
2026-03-29 22:01:54 [bca.uk] INFO: Saving data for SN66%20TXZ: {'auction_closing_time': 1774951200.0, 'created_time': 1774696046.832708, 'last_price_update_time': 1774821714.300749}
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SN66%2520TXZ') HTTP/1.1" 204 0
2026-03-29 22:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435140/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN62UZG/42812357?sv=2020-08-04&st=2026-03-29T22%3A01%3A45Z&se=2026-03-29T22%3A26%3A45Z&sr=b&sp=r&sig=X9pErQDsrXNy4qMwHp8m59UtcG5VKGVtuCOpQCnsZBk%3D)
2026-03-29 22:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699432980/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN62UZG/42812357?sv=2020-08-04&st=2026-03-29T22%3A01%3A45Z&se=2026-03-29T22%3A26%3A45Z&sr=b&sp=r&sig=X9pErQDsrXNy4qMwHp8m59UtcG5VKGVtuCOpQCnsZBk%3D)
2026-03-29 22:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13WCO/42805858?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=GVmWRmuKtNOue8G4g7Ss9cceJ%2BHC2MT4CedJjlRFDBw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG13%20WCO-GB>
2026-03-29 22:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RNZ5340/42805981?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=EtkIifNkCHy5EOPPe2ywr7dpUF42QieQm0w8636Y6Eg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RNZ%205340-GB>
2026-03-29 22:01:54 [bca.uk] INFO: Found listing with ID: YT65%20OEM
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT65%2520OEM%27 HTTP/1.1" 200 None
2026-03-29 22:01:54 [bca.uk] INFO: Scrape type for YT65%20OEM: 1
2026-03-29 22:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c with identifier: YT65%20OEM
2026-03-29 22:01:54 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c86550>
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN62UZG%252F699435117%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435117/600 saved to cache
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f0b17972-5ab7-56c0-825d-14139cf5492c
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61703b90>
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN62UZG%252F699435125%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435125/600 saved to cache
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f0b17972-5ab7-56c0-825d-14139cf5492c
2026-03-29 22:01:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6185e050>
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64BWF%252F699400489%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400489/600 saved to cache
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c286c031-4c72-5d7f-8c06-04157dc85649
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617f9b50>
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_expert_report_file_f02b5473-7ed1-4b83-be44-f4c47e2b5479.pdf HTTP/1.1" 201 0
2026-03-29 22:01:54 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4452e7a2-008a-5460-ac69-330bdd58f5d4
2026-03-29 22:01:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4452e7a2-008a-5460-ac69-330bdd58f5d4, skipping ID generation
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4452e7a2-008a-5460-ac69-330bdd58f5d4
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEO67CJZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EO67CJZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6374ea50>
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN62UZG%252F699435133%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435133/600 saved to cache
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f0b17972-5ab7-56c0-825d-14139cf5492c
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6209a2d0>
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN62UZG%252F699432946%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699432946/600 saved to cache
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f0b17972-5ab7-56c0-825d-14139cf5492c
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6208b990>
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_expert_report_file_7f9656c0-a621-4b76-930f-633a4b119c43.pdf HTTP/1.1" 201 0
2026-03-29 22:01:54 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 55260bef-13ca-53e6-8438-967001fdad8a
2026-03-29 22:01:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55260bef-13ca-53e6-8438-967001fdad8a, skipping ID generation
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55260bef-13ca-53e6-8438-967001fdad8a
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDA08NWF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DA08NWF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA13XJE/42802351?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=wrT1d4szZ5uA5YPKww6Z19lcFj9BeYG1c3p6Yb3SGNs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YA13%20XJE-GB>
2026-03-29 22:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400494/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64BWF/42812128?sv=2020-08-04&st=2026-03-29T22%3A01%3A41Z&se=2026-03-29T22%3A26%3A41Z&sr=b&sp=r&sig=MzwyyqM%2Fq9XpCMHPmp7VRaX08ubizr8jYVfx3e066Lo%3D)
2026-03-29 22:01:54 [bca.uk] INFO: Found listing with ID: SN67%20YDS
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN67%2520YDS%27 HTTP/1.1" 200 None
2026-03-29 22:01:54 [bca.uk] INFO: Scrape type for SN67%20YDS: 2
2026-03-29 22:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6129c19d-98dc-528c-b6a0-32484248f08d with identifier: SN67%20YDS
2026-03-29 22:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6129c19d-98dc-528c-b6a0-32484248f08d with scrape type 2
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6129c19d-98dc-528c-b6a0-32484248f08d with scrape type 2
2026-03-29 22:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6129c19d-98dc-528c-b6a0-32484248f08d, identifier: SN67%20YDS
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015492%27 HTTP/1.1" 200 None
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015492 not downloaded yet
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427705%27 HTTP/1.1" 200 None
2026-03-29 22:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427705 not downloaded yet
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61831b50>
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN62UZG%252F699432959%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699432959/600 saved to cache
2026-03-29 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f0b17972-5ab7-56c0-825d-14139cf5492c
2026-03-29 22:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY64YYK/42812362?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=rVxpK9Nu9k7RcTYnPo9WbYSk5dZ2Ab93q0jZLZNLD3o%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6129c19d-98dc-528c-b6a0-32484248f08d with identifier: SN67%20YDS
2026-03-29 22:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6129c19d-98dc-528c-b6a0-32484248f08d with identifier: SN67%20YDS
2026-03-29 22:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6129c19d-98dc-528c-b6a0-32484248f08d with identifier: SN67%20YDS to the API
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 101,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SN67%20YDS-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6129c19d-98dc-528c-b6a0-32484248f08d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SN67 YDS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SN67%20YDS&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'MERCEDES-BENZ',
'model': 'C200 D',
'odometer': 44913,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C200 D 1.6 SPORT Saloon',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WDD2050372R300460',
'year': 2017}
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN67%2520YDS%27 HTTP/1.1" 200 None
2026-03-29 22:01:55 [bca.uk] INFO: Saving data for SN67%20YDS: {'auction_closing_time': 1775037600.0, 'created_time': 1774276040.702934, 'last_price_update_time': 1774821715.40148}
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SN67%2520YDS') HTTP/1.1" 204 0
2026-03-29 22:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NA04XFU/42812369?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=7XXhzPtvsDMZKwJi3NCUHNT0YaNfJtDfBNmw7ADL6OM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435147/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN62UZG/42812357?sv=2020-08-04&st=2026-03-29T22%3A01%3A45Z&se=2026-03-29T22%3A26%3A45Z&sr=b&sp=r&sig=X9pErQDsrXNy4qMwHp8m59UtcG5VKGVtuCOpQCnsZBk%3D)
2026-03-29 22:01:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OXZ4088/42811293?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=jx4hANQRRl%2Fe9r1hb7nkiHYagTnAV8smLgoPKET9d2I%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OXZ%204088-GB>
2026-03-29 22:01:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE14MHY/42792804?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=Y04ygmBotxtRA%2BypErzdd%2FsRMicCvzRTRUQOyWlrd8A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE14%20MHY-GB>
2026-03-29 22:01:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68NYD/42811062?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=8kkcU%2FFGIGGoXYEQH2MfinwpYza8ouVU7RXPAe1sMaY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ68%20NYD-GB>
2026-03-29 22:01:55 [bca.uk] INFO: Found listing with ID: SV10%20WYJ
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV10%2520WYJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:55 [bca.uk] INFO: Scrape type for SV10%20WYJ: 1
2026-03-29 22:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c49bd93f-51dc-5a81-b24e-4047e5f56934 with identifier: SV10%20WYJ
2026-03-29 22:01:55 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c49bd93f-51dc-5a81-b24e-4047e5f56934
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015519%27 HTTP/1.1" 200 None
2026-03-29 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015519 not downloaded yet
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427710%27 HTTP/1.1" 200 None
2026-03-29 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427710 not downloaded yet
2026-03-29 22:01:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP12UBA/42792329?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=ISncP7%2BN%2F05JJFCM2oZrwTcOivoa8wfp%2F0E42xLXB2E%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP12%20UBA-GB>
2026-03-29 22:01:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE56LWD/42794033?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=9X2VqNUXoy4G7cIyfNsOAU4psnCzDJcB0wbfEMmIfec%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PE56%20LWD-GB>
2026-03-29 22:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61967990>
2026-03-29 22:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN62UZG%252F699435140%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435140/600 saved to cache
2026-03-29 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f0b17972-5ab7-56c0-825d-14139cf5492c
2026-03-29 22:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63318d10>
2026-03-29 22:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN62UZG%252F699432980%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699432980/600 saved to cache
2026-03-29 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f0b17972-5ab7-56c0-825d-14139cf5492c
2026-03-29 22:01:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:01:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:01:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:01:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61bbd810>
2026-03-29 22:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64BWF%252F699400494%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400494/600 saved to cache
2026-03-29 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c286c031-4c72-5d7f-8c06-04157dc85649
2026-03-29 22:01:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU58OJT/42793659?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=OPkhM0299RrvBfUv4FQRs%2FBEpAArcl7lQriMmHfjtw4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NU58%20OJT-GB>
2026-03-29 22:01:55 [bca.uk] INFO: Found listing with ID: YP66%20YKK
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP66%2520YKK%27 HTTP/1.1" 200 None
2026-03-29 22:01:55 [bca.uk] INFO: Scrape type for YP66%20YKK: 0
2026-03-29 22:01:55 [bca.uk] INFO: Found listing with ID: LG65%20ZPF
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG65%2520ZPF%27 HTTP/1.1" 200 None
2026-03-29 22:01:55 [bca.uk] INFO: Scrape type for LG65%20ZPF: 2
2026-03-29 22:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af864b60-63a5-5238-8b52-757cd22bd15a with identifier: LG65%20ZPF
2026-03-29 22:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af864b60-63a5-5238-8b52-757cd22bd15a with scrape type 2
2026-03-29 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af864b60-63a5-5238-8b52-757cd22bd15a with scrape type 2
2026-03-29 22:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: af864b60-63a5-5238-8b52-757cd22bd15a, identifier: LG65%20ZPF
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015534%27 HTTP/1.1" 200 None
2026-03-29 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015534 not downloaded yet
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427718%27 HTTP/1.1" 200 None
2026-03-29 22:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427718 not downloaded yet
2026-03-29 22:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: af864b60-63a5-5238-8b52-757cd22bd15a with identifier: LG65%20ZPF
2026-03-29 22:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: af864b60-63a5-5238-8b52-757cd22bd15a with identifier: LG65%20ZPF
2026-03-29 22:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: af864b60-63a5-5238-8b52-757cd22bd15a with identifier: LG65%20ZPF to the API
2026-03-29 22:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LG65%20ZPF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'af864b60-63a5-5238-8b52-757cd22bd15a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LG65 ZPF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LG65%20ZPF&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 37595,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 70 STING Hatchback',
'transmission': 'manual',
'trim': '70 STING',
'vin': 'W0L0XEP08F4285128',
'year': 2015}
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG65%2520ZPF%27 HTTP/1.1" 200 None
2026-03-29 22:01:56 [bca.uk] INFO: Saving data for LG65%20ZPF: {'auction_closing_time': 1774951200.0, 'created_time': 1774354752.45167, 'last_price_update_time': 1774821716.272392}
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LG65%2520ZPF') HTTP/1.1" 204 0
2026-03-29 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV13PTO/42812438?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=wxjAtc4NkfyYaQyJmzZouqLPSiImkGC37KZelYNyL%2FI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GV13%20PTO-GB>
2026-03-29 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427699/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DA08NWF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA57YZF/42798629?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=jPyhLM%2BjiHCcR3WmQ%2FqXhkvGU%2Bz%2FH7BjFWROuOd%2FXoI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA57%20YZF-GB>
2026-03-29 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK59OSL/42811447?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=raIySGe0EosJvJxqdH%2BlY74CrIqyKMpBthmS20ACi0Y%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RK59%20OSL-GB>
2026-03-29 22:01:56 [bca.uk] INFO: Found listing with ID: AO68%20PXJ
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO68%2520PXJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:56 [bca.uk] INFO: Scrape type for AO68%20PXJ: 1
2026-03-29 22:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50c3f397-3666-5802-9240-95b43afdce21 with identifier: AO68%20PXJ
2026-03-29 22:01:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 50c3f397-3666-5802-9240-95b43afdce21
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015556%27 HTTP/1.1" 200 None
2026-03-29 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015556 not downloaded yet
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427733%27 HTTP/1.1" 200 None
2026-03-29 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427733 not downloaded yet
2026-03-29 22:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619c0890>
2026-03-29 22:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_expert_report_file_b26cc1b8-84d4-4a31-8225-05555cb487fc.pdf HTTP/1.1" 201 0
2026-03-29 22:01:56 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a7797c46-b28a-5526-a960-afcea68790a7
2026-03-29 22:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7797c46-b28a-5526-a960-afcea68790a7, skipping ID generation
2026-03-29 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7797c46-b28a-5526-a960-afcea68790a7
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFY64YYK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FY64YYK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a92c10>
2026-03-29 22:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_expert_report_file_569dfc3c-9c1e-4b83-9b61-d937e9d5297a.pdf HTTP/1.1" 201 0
2026-03-29 22:01:56 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e6199b36-64a9-5e19-9093-4273bab95743
2026-03-29 22:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6199b36-64a9-5e19-9093-4273bab95743, skipping ID generation
2026-03-29 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6199b36-64a9-5e19-9093-4273bab95743
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNA04XFU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NA04XFU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a758d0>
2026-03-29 22:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN62UZG%252F699435147%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435147/600 saved to cache
2026-03-29 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f0b17972-5ab7-56c0-825d-14139cf5492c
2026-03-29 22:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015468/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EO67CJZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:01:56 [bca.uk] INFO: Found listing with ID: FL68%20XDW
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL68%2520XDW%27 HTTP/1.1" 200 None
2026-03-29 22:01:56 [bca.uk] INFO: Scrape type for FL68%20XDW: 2
2026-03-29 22:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40309fa2-9094-503f-8b4a-447e76160edf with identifier: FL68%20XDW
2026-03-29 22:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40309fa2-9094-503f-8b4a-447e76160edf with scrape type 2
2026-03-29 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40309fa2-9094-503f-8b4a-447e76160edf with scrape type 2
2026-03-29 22:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 40309fa2-9094-503f-8b4a-447e76160edf, identifier: FL68%20XDW
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015567%27 HTTP/1.1" 200 None
2026-03-29 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015567 not downloaded yet
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427747%27 HTTP/1.1" 200 None
2026-03-29 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427747 not downloaded yet
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143760%27 HTTP/1.1" 200 None
2026-03-29 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143760 not downloaded yet
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699437920%27 HTTP/1.1" 200 None
2026-03-29 22:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437920 not downloaded yet
2026-03-29 22:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13WCO/42805858?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=GVmWRmuKtNOue8G4g7Ss9cceJ%2BHC2MT4CedJjlRFDBw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 40309fa2-9094-503f-8b4a-447e76160edf with identifier: FL68%20XDW
2026-03-29 22:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 40309fa2-9094-503f-8b4a-447e76160edf with identifier: FL68%20XDW
2026-03-29 22:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 40309fa2-9094-503f-8b4a-447e76160edf with identifier: FL68%20XDW to the API
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL68%20XDW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '40309fa2-9094-503f-8b4a-447e76160edf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL68 XDW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL68%20XDW&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 56184,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.5 DCI 115 TEKNA Hatchback',
'transmission': 'manual',
'trim': 'DCI 115 TEKNA',
'vin': 'SJNFAAJ11U2456355',
'year': 2018}
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL68%2520XDW%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [bca.uk] INFO: Saving data for FL68%20XDW: {'auction_closing_time': 1774951200.0, 'created_time': 1774523216.287621, 'last_price_update_time': 1774821717.082036}
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL68%2520XDW') HTTP/1.1" 204 0
2026-03-29 22:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RNZ5340/42805981?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=EtkIifNkCHy5EOPPe2ywr7dpUF42QieQm0w8636Y6Eg%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:57 [bca.uk] INFO: Found listing with ID: CV57%20TEJ
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV57%2520TEJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [bca.uk] INFO: Scrape type for CV57%20TEJ: 1
2026-03-29 22:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7b2db4c-1d87-55b8-87f5-02ef1f68478c with identifier: CV57%20TEJ
2026-03-29 22:01:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f7b2db4c-1d87-55b8-87f5-02ef1f68478c
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015585%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015585 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427763%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427763 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143767%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143767 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699437933%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437933 not downloaded yet
2026-03-29 22:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA13XJE/42802351?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=wrT1d4szZ5uA5YPKww6Z19lcFj9BeYG1c3p6Yb3SGNs%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68NYD/42811062?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=8kkcU%2FFGIGGoXYEQH2MfinwpYza8ouVU7RXPAe1sMaY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427705>
2026-03-29 22:01:57 [bca.uk] INFO: Found listing with ID: DA08%20JZG
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA08%2520JZG%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [bca.uk] INFO: Scrape type for DA08%20JZG: 1
2026-03-29 22:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26208658-b758-57c3-a5d7-6c7f010cb5ea with identifier: DA08%20JZG
2026-03-29 22:01:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 26208658-b758-57c3-a5d7-6c7f010cb5ea
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015599%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015599 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427814%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427814 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143776%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143776 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699437944%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437944 not downloaded yet
2026-03-29 22:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE56LWD/42794033?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=9X2VqNUXoy4G7cIyfNsOAU4psnCzDJcB0wbfEMmIfec%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE14MHY/42792804?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=Y04ygmBotxtRA%2BypErzdd%2FsRMicCvzRTRUQOyWlrd8A%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OXZ4088/42811293?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=jx4hANQRRl%2Fe9r1hb7nkiHYagTnAV8smLgoPKET9d2I%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a6f590>
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_expert_report_file_cb62933f-4c22-4540-8d18-61e218950062.pdf HTTP/1.1" 201 0
2026-03-29 22:01:57 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1d11b73b-ecf9-57a3-a557-9234293fe7af
2026-03-29 22:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d11b73b-ecf9-57a3-a557-9234293fe7af, skipping ID generation
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d11b73b-ecf9-57a3-a557-9234293fe7af
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBG13WCO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BG13WCO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620eea10>
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_expert_report_file_18241a4e-a2cd-4648-a57a-ef453b5e1275.pdf HTTP/1.1" 201 0
2026-03-29 22:01:57 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c9599de9-498d-5a1e-accc-599bd100e89a
2026-03-29 22:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9599de9-498d-5a1e-accc-599bd100e89a, skipping ID generation
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9599de9-498d-5a1e-accc-599bd100e89a
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRNZ5340-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RNZ5340-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP12UBA/42792329?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=ISncP7%2BN%2F05JJFCM2oZrwTcOivoa8wfp%2F0E42xLXB2E%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015492/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015492>
2026-03-29 22:01:57 [bca.uk] INFO: Found listing with ID: DF13%20AKO
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF13%2520AKO%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [bca.uk] INFO: Scrape type for DF13%20AKO: 1
2026-03-29 22:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3df409e5-2149-5e92-a209-97533ef34ba7 with identifier: DF13%20AKO
2026-03-29 22:01:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3df409e5-2149-5e92-a209-97533ef34ba7
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015725%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015725 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427837%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427837 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143782%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143782 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699437964%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437964 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249848%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249848 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253055%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253055 not downloaded yet
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61819fd0>
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_expert_report_file_58f5616f-cab5-4fb8-a52c-f5f1deb1bc53.pdf HTTP/1.1" 201 0
2026-03-29 22:01:57 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 56ffa4f0-fba8-5395-a6e0-5c3480fd2644
2026-03-29 22:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56ffa4f0-fba8-5395-a6e0-5c3480fd2644, skipping ID generation
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56ffa4f0-fba8-5395-a6e0-5c3480fd2644
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYA13XJE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YA13XJE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63512cd0>
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_expert_report_file_0199151f-68f7-4edb-991a-08b40cfe13f5.pdf HTTP/1.1" 201 0
2026-03-29 22:01:57 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b59bed48-7f26-51b6-a928-99ee433fa2e5
2026-03-29 22:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b59bed48-7f26-51b6-a928-99ee433fa2e5, skipping ID generation
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b59bed48-7f26-51b6-a928-99ee433fa2e5
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPJ68NYD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PJ68NYD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427699/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08NWF/42812303?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=%2FmvSSUyiAYVN8KnXHHAVZPAhaX5NwULjoP6vZooLMQE%3D)
2026-03-29 22:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015468/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO67CJZ/42812295?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=f5P0DwslIG4nez3ramT%2BBglIeMphiUhV3LeShcWO2lA%3D)
2026-03-29 22:01:57 [bca.uk] INFO: Found listing with ID: YP67%20WCD
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP67%2520WCD%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [bca.uk] INFO: Scrape type for YP67%20WCD: 0
2026-03-29 22:01:57 [bca.uk] INFO: Found listing with ID: LS68%20HJJ
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS68%2520HJJ%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [bca.uk] INFO: Scrape type for LS68%20HJJ: 1
2026-03-29 22:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a6c487-5362-53a3-b310-808d63b8f49d with identifier: LS68%20HJJ
2026-03-29 22:01:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b7a6c487-5362-53a3-b310-808d63b8f49d
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015768%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015768 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427850%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427850 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143793%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143793 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699437977%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437977 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249855%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249855 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253065%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253065 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253568%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253568 not downloaded yet
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073146%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073146 not downloaded yet
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6182fc50>
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_expert_report_file_14dd9d92-d510-4961-b53f-e56ac43ce31a.pdf HTTP/1.1" 201 0
2026-03-29 22:01:57 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 569e1cde-1a47-540d-9d22-90c30237a2e3
2026-03-29 22:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 569e1cde-1a47-540d-9d22-90c30237a2e3, skipping ID generation
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 569e1cde-1a47-540d-9d22-90c30237a2e3
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPE56LWD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PE56LWD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63645050>
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_expert_report_file_bf0a95a3-a138-4684-9e86-33ee03fedeb3.pdf HTTP/1.1" 201 0
2026-03-29 22:01:57 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 70ebff0d-7944-5d91-ab8e-f71690cfd864
2026-03-29 22:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70ebff0d-7944-5d91-ab8e-f71690cfd864, skipping ID generation
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70ebff0d-7944-5d91-ab8e-f71690cfd864
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDE14MHY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DE14MHY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6188ffd0>
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_expert_report_file_29e5f5e2-2101-42be-bf85-d32e27f49c96.pdf HTTP/1.1" 201 0
2026-03-29 22:01:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cc361e13-3b83-5190-85ec-81054039e7f0
2026-03-29 22:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc361e13-3b83-5190-85ec-81054039e7f0, skipping ID generation
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc361e13-3b83-5190-85ec-81054039e7f0
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOXZ4088-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OXZ4088-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437920/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437920>
2026-03-29 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437909/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NA04XFU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:01:58 [bca.uk] INFO: Found listing with ID: BG63%20RZR
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG63%2520RZR%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [bca.uk] INFO: Scrape type for BG63%20RZR: 1
2026-03-29 22:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c with identifier: BG63%20RZR
2026-03-29 22:01:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143809%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143809 not downloaded yet
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699438001%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699438001 not downloaded yet
2026-03-29 22:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU58OJT/42793659?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=OPkhM0299RrvBfUv4FQRs%2FBEpAArcl7lQriMmHfjtw4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV13PTO/42812438?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=wxjAtc4NkfyYaQyJmzZouqLPSiImkGC37KZelYNyL%2FI%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249864%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249864 not downloaded yet
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253070%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253070 not downloaded yet
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253574%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253574 not downloaded yet
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073156%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073156 not downloaded yet
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252765%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252765 not downloaded yet
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250226%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250226 not downloaded yet
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168679%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168679 not downloaded yet
2026-03-29 22:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63638e50>
2026-03-29 22:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_expert_report_file_929fdc8e-aacc-4022-a51d-243431387aec.pdf HTTP/1.1" 201 0
2026-03-29 22:01:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 17812872-0c62-52de-9646-8110c3ee0253
2026-03-29 22:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17812872-0c62-52de-9646-8110c3ee0253, skipping ID generation
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17812872-0c62-52de-9646-8110c3ee0253
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSP12UBA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SP12UBA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61544790>
2026-03-29 22:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08NWF%252F699427699%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427699/600 saved to cache
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55260bef-13ca-53e6-8438-967001fdad8a
2026-03-29 22:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63348510>
2026-03-29 22:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO67CJZ%252F699015468%252F600') HTTP/1.1" 204 0
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015468/600 saved to cache
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4452e7a2-008a-5460-ac69-330bdd58f5d4
2026-03-29 22:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK59OSL/42811447?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=raIySGe0EosJvJxqdH%2BlY74CrIqyKMpBthmS20ACi0Y%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA57YZF/42798629?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=jPyhLM%2BjiHCcR3WmQ%2FqXhkvGU%2Bz%2FH7BjFWROuOd%2FXoI%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08NWF/42812303?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=%2FmvSSUyiAYVN8KnXHHAVZPAhaX5NwULjoP6vZooLMQE%3D)
2026-03-29 22:01:58 [bca.uk] INFO: Found listing with ID: FP15%20FDU
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP15%2520FDU%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [bca.uk] INFO: Scrape type for FP15%20FDU: 1
2026-03-29 22:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44161369-70f8-5a2d-828f-f5cf81d7007d with identifier: FP15%20FDU
2026-03-29 22:01:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 44161369-70f8-5a2d-828f-f5cf81d7007d
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143832%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143832 not downloaded yet
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699438015%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699438015 not downloaded yet
2026-03-29 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143760/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143760>
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249874%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249874 not downloaded yet
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253077%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253077 not downloaded yet
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253579%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253579 not downloaded yet
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073170%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073170 not downloaded yet
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252770%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252770 not downloaded yet
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250232%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250232 not downloaded yet
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168684%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168684 not downloaded yet
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253253%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253253 not downloaded yet
2026-03-29 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143767/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143767>
2026-03-29 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427763/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427763>
2026-03-29 22:01:58 [bca.uk] INFO: Found listing with ID: MM14%20NXE
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM14%2520NXE%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [bca.uk] INFO: Scrape type for MM14%20NXE: 2
2026-03-29 22:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8812022e-2c81-54c5-9257-d256cd76a478 with identifier: MM14%20NXE
2026-03-29 22:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8812022e-2c81-54c5-9257-d256cd76a478 with scrape type 2
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8812022e-2c81-54c5-9257-d256cd76a478 with scrape type 2
2026-03-29 22:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8812022e-2c81-54c5-9257-d256cd76a478, identifier: MM14%20NXE
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143856%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143856 not downloaded yet
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699438032%27 HTTP/1.1" 200 None
2026-03-29 22:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699438032 not downloaded yet
2026-03-29 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437933/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437933>
2026-03-29 22:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015585/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015585>
2026-03-29 22:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8812022e-2c81-54c5-9257-d256cd76a478 with identifier: MM14%20NXE
2026-03-29 22:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8812022e-2c81-54c5-9257-d256cd76a478 with identifier: MM14%20NXE
2026-03-29 22:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8812022e-2c81-54c5-9257-d256cd76a478 with identifier: MM14%20NXE to the API
2026-03-29 22:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MM14%20NXE-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8812022e-2c81-54c5-9257-d256cd76a478',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MM14 NXE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MM14%20NXE&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'RENAULT',
'model': 'SCENIC',
'odometer': 39885,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'RENAULT SCENIC 1.5 DCI 110 DYNAMIQUE TOM TOM S/S MPV',
'transmission': 'manual',
'trim': 'DCI 110 DYNAMIQUE TOM TOM S/S',
'vin': 'VF1JZ14K650492134',
'year': 2014}
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM14%2520NXE%27 HTTP/1.1" 200 None
2026-03-29 22:01:59 [bca.uk] INFO: Saving data for MM14%20NXE: {'auction_closing_time': 1774951200.0, 'created_time': 1774479425.815408, 'last_price_update_time': 1774821719.300968}
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MM14%2520NXE') HTTP/1.1" 204 0
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249887%27 HTTP/1.1" 200 None
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249887 not downloaded yet
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253085%27 HTTP/1.1" 200 None
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253085 not downloaded yet
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253587%27 HTTP/1.1" 200 None
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253587 not downloaded yet
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073182%27 HTTP/1.1" 200 None
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073182 not downloaded yet
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252781%27 HTTP/1.1" 200 None
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252781 not downloaded yet
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250244%27 HTTP/1.1" 200 None
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250244 not downloaded yet
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168692%27 HTTP/1.1" 200 None
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168692 not downloaded yet
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253261%27 HTTP/1.1" 200 None
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253261 not downloaded yet
2026-03-29 22:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015492/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO67CJZ/42812295?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=f5P0DwslIG4nez3ramT%2BBglIeMphiUhV3LeShcWO2lA%3D)
2026-03-29 22:01:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253563/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YA13XJE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:01:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253051/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RNZ5340-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:01:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073139/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PJ68NYD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:01:59 [bca.uk] INFO: Found listing with ID: YW15%20NRU
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YW15%2520NRU%27 HTTP/1.1" 200 None
2026-03-29 22:01:59 [bca.uk] INFO: Scrape type for YW15%20NRU: 2
2026-03-29 22:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d631b39-8739-5305-90c2-2d03d8b8dce4 with identifier: YW15%20NRU
2026-03-29 22:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d631b39-8739-5305-90c2-2d03d8b8dce4 with scrape type 2
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d631b39-8739-5305-90c2-2d03d8b8dce4 with scrape type 2
2026-03-29 22:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3d631b39-8739-5305-90c2-2d03d8b8dce4, identifier: YW15%20NRU
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143871%27 HTTP/1.1" 200 None
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143871 not downloaded yet
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699438043%27 HTTP/1.1" 200 None
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699438043 not downloaded yet
2026-03-29 22:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6180a990>
2026-03-29 22:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_expert_report_file_09969caf-9f22-4f43-b12f-a83d8bb8437c.pdf HTTP/1.1" 201 0
2026-03-29 22:01:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ae5b05cb-e1db-52c3-a568-516b686268d9
2026-03-29 22:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae5b05cb-e1db-52c3-a568-516b686268d9, skipping ID generation
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae5b05cb-e1db-52c3-a568-516b686268d9
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNU58OJT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NU58OJT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637bf590>
2026-03-29 22:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_expert_report_file_7a6f4497-e5dc-4294-ad35-d4ce3eb545e0.pdf HTTP/1.1" 201 0
2026-03-29 22:01:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8c5d6f92-e516-5861-9e52-fa759468ecc2
2026-03-29 22:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c5d6f92-e516-5861-9e52-fa759468ecc2, skipping ID generation
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c5d6f92-e516-5861-9e52-fa759468ecc2
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGV13PTO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GV13PTO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618e1750>
2026-03-29 22:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_expert_report_file_6ef2c137-b17a-4f8e-845d-3bef0e0286a4.pdf HTTP/1.1" 201 0
2026-03-29 22:01:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item faae600b-2d2c-5cfb-9bd2-3ccad03ec918
2026-03-29 22:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: faae600b-2d2c-5cfb-9bd2-3ccad03ec918, skipping ID generation
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item faae600b-2d2c-5cfb-9bd2-3ccad03ec918
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRK59OSL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RK59OSL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618ff990>
2026-03-29 22:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_expert_report_file_565ecd74-7f34-4694-8ee5-bf0264f242d8.pdf HTTP/1.1" 201 0
2026-03-29 22:01:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d3ee94bc-ee6e-5446-95d3-63f1fb5a289c
2026-03-29 22:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3ee94bc-ee6e-5446-95d3-63f1fb5a289c, skipping ID generation
2026-03-29 22:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3ee94bc-ee6e-5446-95d3-63f1fb5a289c
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMA57YZF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MA57YZF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637bd7d0>
2026-03-29 22:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08NWF%252F699427705%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427705/600 saved to cache
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55260bef-13ca-53e6-8438-967001fdad8a
2026-03-29 22:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437909/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NA04XFU/42812369?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=7XXhzPtvsDMZKwJi3NCUHNT0YaNfJtDfBNmw7ADL6OM%3D)
2026-03-29 22:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437920/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NA04XFU/42812369?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=7XXhzPtvsDMZKwJi3NCUHNT0YaNfJtDfBNmw7ADL6OM%3D)
2026-03-29 22:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3d631b39-8739-5305-90c2-2d03d8b8dce4 with identifier: YW15%20NRU
2026-03-29 22:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3d631b39-8739-5305-90c2-2d03d8b8dce4 with identifier: YW15%20NRU
2026-03-29 22:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3d631b39-8739-5305-90c2-2d03d8b8dce4 with identifier: YW15%20NRU to the API
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YW15%20NRU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3d631b39-8739-5305-90c2-2d03d8b8dce4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YW15 NRU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YW15%20NRU&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 96753,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 100 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 ZETEC',
'vin': 'WF0DXXGAKDFD67995',
'year': 2015}
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YW15%2520NRU%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [bca.uk] INFO: Saving data for YW15%20NRU: {'auction_closing_time': 1774951200.0, 'created_time': 1774522971.46165, 'last_price_update_time': 1774821720.459105}
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YW15%2520NRU') HTTP/1.1" 204 0
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249906%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249906 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253097%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253097 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253600%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253600 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073190%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073190 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252795%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252795 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250253%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250253 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168695%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168695 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253270%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253270 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252647%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252647 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443638%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443638 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146338%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146338 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251921%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251921 not downloaded yet
2026-03-29 22:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143767/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY64YYK/42812362?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=rVxpK9Nu9k7RcTYnPo9WbYSk5dZ2Ab93q0jZLZNLD3o%3D)
2026-03-29 22:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699438015/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699438015>
2026-03-29 22:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168671/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OXZ4088-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143760/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY64YYK/42812362?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=rVxpK9Nu9k7RcTYnPo9WbYSk5dZ2Ab93q0jZLZNLD3o%3D)
2026-03-29 22:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250214/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DE14MHY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249922%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249922 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253108%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253108 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253610%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253610 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073201%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073201 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252802%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252802 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250261%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250261 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168700%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168700 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253277%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253277 not downloaded yet
2026-03-29 22:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427763/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08NWF/42812303?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=%2FmvSSUyiAYVN8KnXHHAVZPAhaX5NwULjoP6vZooLMQE%3D)
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252650%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252650 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443643%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443643 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146346%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146346 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251926%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251926 not downloaded yet
2026-03-29 22:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143832/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143832>
2026-03-29 22:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP15FDU/42801305?sv=2020-08-04&st=2026-03-29T22%3A02%3A00Z&se=2026-03-29T22%3A27%3A00Z&sr=b&sp=r&sig=qsAOXXKR%2BqDtTaoMn2AGi%2FhSg4YERZitp0%2FlGIFHrdA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FP15%20FDU-GB>
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249944%27 HTTP/1.1" 200 None
2026-03-29 22:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249944 not downloaded yet
2026-03-29 22:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253119%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253119 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253622%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253622 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073215%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073215 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252817%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252817 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250280%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250280 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168704%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168704 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253290%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253290 not downloaded yet
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69972750>
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO67CJZ%252F699015492%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015492/600 saved to cache
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4452e7a2-008a-5460-ac69-330bdd58f5d4
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6334a090>
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNA04XFU%252F699437909%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437909/600 saved to cache
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6199b36-64a9-5e19-9093-4273bab95743
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac612011d0>
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNA04XFU%252F699437920%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437920/600 saved to cache
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6199b36-64a9-5e19-9093-4273bab95743
2026-03-29 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437933/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NA04XFU/42812369?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=7XXhzPtvsDMZKwJi3NCUHNT0YaNfJtDfBNmw7ADL6OM%3D)
2026-03-29 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073139/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68NYD/42811062?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=8kkcU%2FFGIGGoXYEQH2MfinwpYza8ouVU7RXPAe1sMaY%3D)
2026-03-29 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253051/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RNZ5340/42805981?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=EtkIifNkCHy5EOPPe2ywr7dpUF42QieQm0w8636Y6Eg%3D)
2026-03-29 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253563/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA13XJE/42802351?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=wrT1d4szZ5uA5YPKww6Z19lcFj9BeYG1c3p6Yb3SGNs%3D)
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252658%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252658 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443649%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443649 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146355%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146355 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251933%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251933 not downloaded yet
2026-03-29 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015585/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO67CJZ/42812295?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=f5P0DwslIG4nez3ramT%2BBglIeMphiUhV3LeShcWO2lA%3D)
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249964%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249964 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253134%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253134 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253640%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253640 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073224%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073224 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252836%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252836 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250296%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250296 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168707%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168707 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253306%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253306 not downloaded yet
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61187310>
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY64YYK%252F699143767%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143767/600 saved to cache
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7797c46-b28a-5526-a960-afcea68790a7
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637ee910>
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY64YYK%252F699143760%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143760/600 saved to cache
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7797c46-b28a-5526-a960-afcea68790a7
2026-03-29 22:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699438032/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699438032>
2026-03-29 22:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146331/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RK59OSL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251917/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MA57YZF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252662%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252662 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443659%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443659 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146362%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146362 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251940%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251940 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253657%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253657 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073233%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073233 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252851%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252851 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250311%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250311 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168711%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168711 not downloaded yet
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253321%27 HTTP/1.1" 200 None
2026-03-29 22:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253321 not downloaded yet
2026-03-29 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168671/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OXZ4088/42811293?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=jx4hANQRRl%2Fe9r1hb7nkiHYagTnAV8smLgoPKET9d2I%3D)
2026-03-29 22:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250214/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE14MHY/42792804?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=Y04ygmBotxtRA%2BypErzdd%2FsRMicCvzRTRUQOyWlrd8A%3D)
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252668%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252668 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443663%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443663 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146367%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146367 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251947%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251947 not downloaded yet
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61160bd0>
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08NWF%252F699427763%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427763/600 saved to cache
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55260bef-13ca-53e6-8438-967001fdad8a
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611d1150>
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNA04XFU%252F699437933%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437933/600 saved to cache
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6199b36-64a9-5e19-9093-4273bab95743
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62263c10>
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68NYD%252F699073139%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073139/600 saved to cache
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b59bed48-7f26-51b6-a928-99ee433fa2e5
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61199810>
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRNZ5340%252F699253051%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253051/600 saved to cache
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9599de9-498d-5a1e-accc-599bd100e89a
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611f5710>
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA13XJE%252F699253563%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253563/600 saved to cache
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56ffa4f0-fba8-5395-a6e0-5c3480fd2644
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611d1f50>
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO67CJZ%252F699015585%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015585/600 saved to cache
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4452e7a2-008a-5460-ac69-330bdd58f5d4
2026-03-29 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250261/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250261>
2026-03-29 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168700/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168700>
2026-03-29 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699438015/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NA04XFU/42812369?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=7XXhzPtvsDMZKwJi3NCUHNT0YaNfJtDfBNmw7ADL6OM%3D)
2026-03-29 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143832/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY64YYK/42812362?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=rVxpK9Nu9k7RcTYnPo9WbYSk5dZ2Ab93q0jZLZNLD3o%3D)
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252871%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252871 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250330%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250330 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168716%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168716 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253336%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253336 not downloaded yet
2026-03-29 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253277/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253277>
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252679%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252679 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443671%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443671 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146377%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146377 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251957%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251957 not downloaded yet
2026-03-29 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168704/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168704>
2026-03-29 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253290/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253290>
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253354%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253354 not downloaded yet
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac60ff9890>
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOXZ4088%252F699168671%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168671/600 saved to cache
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc361e13-3b83-5190-85ec-81054039e7f0
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69bf0b10>
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE14MHY%252F699250214%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250214/600 saved to cache
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70ebff0d-7944-5d91-ab8e-f71690cfd864
2026-03-29 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251917/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA57YZF/42798629?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=jPyhLM%2BjiHCcR3WmQ%2FqXhkvGU%2Bz%2FH7BjFWROuOd%2FXoI%3D)
2026-03-29 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250280/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250280>
2026-03-29 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073215/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073215>
2026-03-29 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252817/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252817>
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252688%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252688 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443678%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443678 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146390%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146390 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251972%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251972 not downloaded yet
2026-03-29 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP15FDU/42801305?sv=2020-08-04&st=2026-03-29T22%3A02%3A00Z&se=2026-03-29T22%3A27%3A00Z&sr=b&sp=r&sig=qsAOXXKR%2BqDtTaoMn2AGi%2FhSg4YERZitp0%2FlGIFHrdA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146331/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK59OSL/42811447?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=raIySGe0EosJvJxqdH%2BlY74CrIqyKMpBthmS20ACi0Y%3D)
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252710%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252710 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443685%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443685 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146405%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146405 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251985%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251985 not downloaded yet
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61021390>
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNA04XFU%252F699438015%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699438015/600 saved to cache
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e6199b36-64a9-5e19-9093-4273bab95743
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61023510>
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY64YYK%252F699143832%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143832/600 saved to cache
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7797c46-b28a-5526-a960-afcea68790a7
2026-03-29 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699438032/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NA04XFU/42812369?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=7XXhzPtvsDMZKwJi3NCUHNT0YaNfJtDfBNmw7ADL6OM%3D)
2026-03-29 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251940/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251940>
2026-03-29 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250261/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE14MHY/42792804?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=Y04ygmBotxtRA%2BypErzdd%2FsRMicCvzRTRUQOyWlrd8A%3D)
2026-03-29 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253321/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253321>
2026-03-29 22:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146362/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146362>
2026-03-29 22:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168700/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OXZ4088/42811293?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=jx4hANQRRl%2Fe9r1hb7nkiHYagTnAV8smLgoPKET9d2I%3D)
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252730%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252730 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443694%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443694 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146421%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146421 not downloaded yet
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251999%27 HTTP/1.1" 200 None
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251999 not downloaded yet
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61052050>
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA57YZF%252F699251917%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251917/600 saved to cache
2026-03-29 22:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3ee94bc-ee6e-5446-95d3-63f1fb5a289c
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620ffa50>
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_expert_report_file_39575c8a-a70f-4666-aa58-ccc030edc58a.pdf HTTP/1.1" 201 0
2026-03-29 22:02:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 44161369-70f8-5a2d-828f-f5cf81d7007d
2026-03-29 22:02:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44161369-70f8-5a2d-828f-f5cf81d7007d, skipping ID generation
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44161369-70f8-5a2d-828f-f5cf81d7007d
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFP15FDU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FP15FDU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616877d0>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK59OSL%252F699146331%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146331/600 saved to cache
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item faae600b-2d2c-5cfb-9bd2-3ccad03ec918
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253277/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP12UBA/42792329?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=ISncP7%2BN%2F05JJFCM2oZrwTcOivoa8wfp%2F0E42xLXB2E%3D)
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253290/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP12UBA/42792329?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=ISncP7%2BN%2F05JJFCM2oZrwTcOivoa8wfp%2F0E42xLXB2E%3D)
2026-03-29 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168711/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168711>
2026-03-29 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251957/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251957>
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250922%27 HTTP/1.1" 200 None
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250922 not downloaded yet
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252817/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE56LWD/42794033?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=9X2VqNUXoy4G7cIyfNsOAU4psnCzDJcB0wbfEMmIfec%3D)
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168704/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OXZ4088/42811293?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=jx4hANQRRl%2Fe9r1hb7nkiHYagTnAV8smLgoPKET9d2I%3D)
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073215/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68NYD/42811062?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=8kkcU%2FFGIGGoXYEQH2MfinwpYza8ouVU7RXPAe1sMaY%3D)
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250931%27 HTTP/1.1" 200 None
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250931 not downloaded yet
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636a7350>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNA04XFU%252F699438032%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699438032/600 saved to cache
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e6199b36-64a9-5e19-9093-4273bab95743
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620ecbd0>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE14MHY%252F699250261%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250261/600 saved to cache
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70ebff0d-7944-5d91-ab8e-f71690cfd864
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610b5890>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOXZ4088%252F699168700%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168700/600 saved to cache
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc361e13-3b83-5190-85ec-81054039e7f0
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146362/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK59OSL/42811447?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=raIySGe0EosJvJxqdH%2BlY74CrIqyKMpBthmS20ACi0Y%3D)
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251940/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA57YZF/42798629?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=jPyhLM%2BjiHCcR3WmQ%2FqXhkvGU%2Bz%2FH7BjFWROuOd%2FXoI%3D)
2026-03-29 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443678/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443678>
2026-03-29 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251972/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251972>
2026-03-29 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251985/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251985>
2026-03-29 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146390>
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250939%27 HTTP/1.1" 200 None
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250939 not downloaded yet
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253321/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP12UBA/42792329?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=ISncP7%2BN%2F05JJFCM2oZrwTcOivoa8wfp%2F0E42xLXB2E%3D)
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250950%27 HTTP/1.1" 200 None
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250950 not downloaded yet
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615394d0>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP12UBA%252F699253277%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253277/600 saved to cache
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17812872-0c62-52de-9646-8110c3ee0253
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616ada50>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP12UBA%252F699253290%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253290/600 saved to cache
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17812872-0c62-52de-9646-8110c3ee0253
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637a7ed0>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE56LWD%252F699252817%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252817/600 saved to cache
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 569e1cde-1a47-540d-9d22-90c30237a2e3
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636721d0>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOXZ4088%252F699168704%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168704/600 saved to cache
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc361e13-3b83-5190-85ec-81054039e7f0
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616dd7d0>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68NYD%252F699073215%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073215/600 saved to cache
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b59bed48-7f26-51b6-a928-99ee433fa2e5
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250955%27 HTTP/1.1" 200 None
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250955 not downloaded yet
2026-03-29 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146421/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146421>
2026-03-29 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251999/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251999>
2026-03-29 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250915/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FP15FDU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146405/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146405>
2026-03-29 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443694/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443694>
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251957/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA57YZF/42798629?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=jPyhLM%2BjiHCcR3WmQ%2FqXhkvGU%2Bz%2FH7BjFWROuOd%2FXoI%3D)
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168711/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OXZ4088/42811293?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=jx4hANQRRl%2Fe9r1hb7nkiHYagTnAV8smLgoPKET9d2I%3D)
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250971%27 HTTP/1.1" 200 None
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250971 not downloaded yet
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250993%27 HTTP/1.1" 200 None
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250993 not downloaded yet
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63671350>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK59OSL%252F699146362%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146362/600 saved to cache
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item faae600b-2d2c-5cfb-9bd2-3ccad03ec918
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617f7d10>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA57YZF%252F699251940%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251940/600 saved to cache
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3ee94bc-ee6e-5446-95d3-63f1fb5a289c
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac622475d0>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP12UBA%252F699253321%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253321/600 saved to cache
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17812872-0c62-52de-9646-8110c3ee0253
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146390/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK59OSL/42811447?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=raIySGe0EosJvJxqdH%2BlY74CrIqyKMpBthmS20ACi0Y%3D)
2026-03-29 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252730/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252730>
2026-03-29 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250922/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250922>
2026-03-29 22:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250931/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250931>
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251013%27 HTTP/1.1" 200 None
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251013 not downloaded yet
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251985/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA57YZF/42798629?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=jPyhLM%2BjiHCcR3WmQ%2FqXhkvGU%2Bz%2FH7BjFWROuOd%2FXoI%3D)
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251972/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA57YZF/42798629?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=jPyhLM%2BjiHCcR3WmQ%2FqXhkvGU%2Bz%2FH7BjFWROuOd%2FXoI%3D)
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443678/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV13PTO/42812438?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=wxjAtc4NkfyYaQyJmzZouqLPSiImkGC37KZelYNyL%2FI%3D)
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699251029%27 HTTP/1.1" 200 None
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251029 not downloaded yet
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611d6b50>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA57YZF%252F699251957%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251957/600 saved to cache
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3ee94bc-ee6e-5446-95d3-63f1fb5a289c
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637a4850>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOXZ4088%252F699168711%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168711/600 saved to cache
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc361e13-3b83-5190-85ec-81054039e7f0
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250915/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP15FDU/42801305?sv=2020-08-04&st=2026-03-29T22%3A02%3A00Z&se=2026-03-29T22%3A27%3A00Z&sr=b&sp=r&sig=qsAOXXKR%2BqDtTaoMn2AGi%2FhSg4YERZitp0%2FlGIFHrdA%3D)
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443694/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV13PTO/42812438?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=wxjAtc4NkfyYaQyJmzZouqLPSiImkGC37KZelYNyL%2FI%3D)
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146405/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK59OSL/42811447?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=raIySGe0EosJvJxqdH%2BlY74CrIqyKMpBthmS20ACi0Y%3D)
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251999/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA57YZF/42798629?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=jPyhLM%2BjiHCcR3WmQ%2FqXhkvGU%2Bz%2FH7BjFWROuOd%2FXoI%3D)
2026-03-29 22:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146421/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK59OSL/42811447?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=raIySGe0EosJvJxqdH%2BlY74CrIqyKMpBthmS20ACi0Y%3D)
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620ec390>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK59OSL%252F699146390%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146390/600 saved to cache
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item faae600b-2d2c-5cfb-9bd2-3ccad03ec918
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611706d0>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA57YZF%252F699251985%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251985/600 saved to cache
2026-03-29 22:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3ee94bc-ee6e-5446-95d3-63f1fb5a289c
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61924050>
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA57YZF%252F699251972%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251972/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3ee94bc-ee6e-5446-95d3-63f1fb5a289c
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac697a5190>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV13PTO%252F699443678%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443678/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c5d6f92-e516-5861-9e52-fa759468ecc2
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250280/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE14MHY/42792804?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=Y04ygmBotxtRA%2BypErzdd%2FsRMicCvzRTRUQOyWlrd8A%3D)
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250955/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250955>
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443685/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443685>
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250922/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP15FDU/42801305?sv=2020-08-04&st=2026-03-29T22%3A02%3A00Z&se=2026-03-29T22%3A27%3A00Z&sr=b&sp=r&sig=qsAOXXKR%2BqDtTaoMn2AGi%2FhSg4YERZitp0%2FlGIFHrdA%3D)
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250931/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP15FDU/42801305?sv=2020-08-04&st=2026-03-29T22%3A02%3A00Z&se=2026-03-29T22%3A27%3A00Z&sr=b&sp=r&sig=qsAOXXKR%2BqDtTaoMn2AGi%2FhSg4YERZitp0%2FlGIFHrdA%3D)
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250950/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250950>
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250993/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250993>
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252730/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU58OJT/42793659?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=OPkhM0299RrvBfUv4FQRs%2FBEpAArcl7lQriMmHfjtw4%3D)
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610761d0>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP15FDU%252F699250915%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250915/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44161369-70f8-5a2d-828f-f5cf81d7007d
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61972c50>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV13PTO%252F699443694%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443694/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c5d6f92-e516-5861-9e52-fa759468ecc2
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61747510>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK59OSL%252F699146405%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146405/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item faae600b-2d2c-5cfb-9bd2-3ccad03ec918
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b2f50>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA57YZF%252F699251999%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251999/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3ee94bc-ee6e-5446-95d3-63f1fb5a289c
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b1290>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK59OSL%252F699146421%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146421/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item faae600b-2d2c-5cfb-9bd2-3ccad03ec918
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699251013/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251013>
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250939/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250939>
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250971/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250971>
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252688/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252688>
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253354/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253354>
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699251029/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251029>
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252710/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252710>
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63549210>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE14MHY%252F699250280%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250280/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70ebff0d-7944-5d91-ab8e-f71690cfd864
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6354bd90>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP15FDU%252F699250922%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250922/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44161369-70f8-5a2d-828f-f5cf81d7007d
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61935150>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP15FDU%252F699250931%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250931/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44161369-70f8-5a2d-828f-f5cf81d7007d
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636eb250>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU58OJT%252F699252730%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252730/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ae5b05cb-e1db-52c3-a568-516b686268d9
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250955/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP15FDU/42801305?sv=2020-08-04&st=2026-03-29T22%3A02%3A00Z&se=2026-03-29T22%3A27%3A00Z&sr=b&sp=r&sig=qsAOXXKR%2BqDtTaoMn2AGi%2FhSg4YERZitp0%2FlGIFHrdA%3D)
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250950/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP15FDU/42801305?sv=2020-08-04&st=2026-03-29T22%3A02%3A00Z&se=2026-03-29T22%3A27%3A00Z&sr=b&sp=r&sig=qsAOXXKR%2BqDtTaoMn2AGi%2FhSg4YERZitp0%2FlGIFHrdA%3D)
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443671/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443671>
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252679/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252679>
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253336/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253336>
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250993/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP15FDU/42801305?sv=2020-08-04&st=2026-03-29T22%3A02%3A00Z&se=2026-03-29T22%3A27%3A00Z&sr=b&sp=r&sig=qsAOXXKR%2BqDtTaoMn2AGi%2FhSg4YERZitp0%2FlGIFHrdA%3D)
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443685/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV13PTO/42812438?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=wxjAtc4NkfyYaQyJmzZouqLPSiImkGC37KZelYNyL%2FI%3D)
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250939/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP15FDU/42801305?sv=2020-08-04&st=2026-03-29T22%3A02%3A00Z&se=2026-03-29T22%3A27%3A00Z&sr=b&sp=r&sig=qsAOXXKR%2BqDtTaoMn2AGi%2FhSg4YERZitp0%2FlGIFHrdA%3D)
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168716/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168716>
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250971/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP15FDU/42801305?sv=2020-08-04&st=2026-03-29T22%3A02%3A00Z&se=2026-03-29T22%3A27%3A00Z&sr=b&sp=r&sig=qsAOXXKR%2BqDtTaoMn2AGi%2FhSg4YERZitp0%2FlGIFHrdA%3D)
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253354/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP12UBA/42792329?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=ISncP7%2BN%2F05JJFCM2oZrwTcOivoa8wfp%2F0E42xLXB2E%3D)
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252688/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU58OJT/42793659?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=OPkhM0299RrvBfUv4FQRs%2FBEpAArcl7lQriMmHfjtw4%3D)
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252710/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU58OJT/42793659?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=OPkhM0299RrvBfUv4FQRs%2FBEpAArcl7lQriMmHfjtw4%3D)
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699251029/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP15FDU/42801305?sv=2020-08-04&st=2026-03-29T22%3A02%3A00Z&se=2026-03-29T22%3A27%3A00Z&sr=b&sp=r&sig=qsAOXXKR%2BqDtTaoMn2AGi%2FhSg4YERZitp0%2FlGIFHrdA%3D)
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616baf90>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP15FDU%252F699250955%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250955/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44161369-70f8-5a2d-828f-f5cf81d7007d
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146377/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146377>
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250330/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250330>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636715d0>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP15FDU%252F699250950%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250950/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44161369-70f8-5a2d-828f-f5cf81d7007d
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699251013/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP15FDU/42801305?sv=2020-08-04&st=2026-03-29T22%3A02%3A00Z&se=2026-03-29T22%3A27%3A00Z&sr=b&sp=r&sig=qsAOXXKR%2BqDtTaoMn2AGi%2FhSg4YERZitp0%2FlGIFHrdA%3D)
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252871/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252871>
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252679/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU58OJT/42793659?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=OPkhM0299RrvBfUv4FQRs%2FBEpAArcl7lQriMmHfjtw4%3D)
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253336/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP12UBA/42792329?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=ISncP7%2BN%2F05JJFCM2oZrwTcOivoa8wfp%2F0E42xLXB2E%3D)
2026-03-29 22:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443671/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV13PTO/42812438?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=wxjAtc4NkfyYaQyJmzZouqLPSiImkGC37KZelYNyL%2FI%3D)
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251947/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251947>
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617f4fd0>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP15FDU%252F699250993%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250993/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44161369-70f8-5a2d-828f-f5cf81d7007d
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6107dc50>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV13PTO%252F699443685%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443685/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c5d6f92-e516-5861-9e52-fa759468ecc2
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63672d10>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP15FDU%252F699250939%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250939/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44161369-70f8-5a2d-828f-f5cf81d7007d
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146367/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146367>
2026-03-29 22:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443663/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443663>
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610850d0>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP15FDU%252F699250971%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250971/600 saved to cache
2026-03-29 22:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44161369-70f8-5a2d-828f-f5cf81d7007d
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618cd190>
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP12UBA%252F699253354%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253354/600 saved to cache
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17812872-0c62-52de-9646-8110c3ee0253
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611ba850>
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU58OJT%252F699252688%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252688/600 saved to cache
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae5b05cb-e1db-52c3-a568-516b686268d9
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620ff290>
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU58OJT%252F699252710%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252710/600 saved to cache
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ae5b05cb-e1db-52c3-a568-516b686268d9
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611ba8d0>
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP15FDU%252F699251029%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699251029/600 saved to cache
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44161369-70f8-5a2d-828f-f5cf81d7007d
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611b9ed0>
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP15FDU%252F699251013%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699251013/600 saved to cache
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44161369-70f8-5a2d-828f-f5cf81d7007d
2026-03-29 22:02:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44161369-70f8-5a2d-828f-f5cf81d7007d, skipping ID generation
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44161369-70f8-5a2d-828f-f5cf81d7007d sending to next pipeline
2026-03-29 22:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 44161369-70f8-5a2d-828f-f5cf81d7007d, identifier: FP15%20FDU
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6867a4d0>
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU58OJT%252F699252679%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252679/600 saved to cache
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae5b05cb-e1db-52c3-a568-516b686268d9
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637a5790>
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP12UBA%252F699253336%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253336/600 saved to cache
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17812872-0c62-52de-9646-8110c3ee0253
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61844a10>
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV13PTO%252F699443671%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443671/600 saved to cache
2026-03-29 22:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c5d6f92-e516-5861-9e52-fa759468ecc2
2026-03-29 22:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 44161369-70f8-5a2d-828f-f5cf81d7007d with identifier: FP15%20FDU
2026-03-29 22:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 44161369-70f8-5a2d-828f-f5cf81d7007d with identifier: FP15%20FDU
2026-03-29 22:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 44161369-70f8-5a2d-828f-f5cf81d7007d with identifier: FP15%20FDU to the API
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699251013/600>
{'auction_title': '',
'c_o_2_emission_value': 92,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_expert_report_file_39575c8a-a70f-4666-aa58-ccc030edc58a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FP15%20FDU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '44161369-70f8-5a2d-828f-f5cf81d7007d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FP15 FDU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FP15%20FDU&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'TOYOTA',
'model': 'AURIS TOURING',
'odometer': 254475,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40046,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250915/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39611,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250922/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40309,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250931/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41162,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250939/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34376,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250950/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32767,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250955/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94341,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250971/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78995,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699250993/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96157,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699251013/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44161369-70f8-5a2d-828f-f5cf81d7007d/44161369-70f8-5a2d-828f-f5cf81d7007d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83268,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP15FDU/699251029/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'TOYOTA AURIS TOURING 1.8 VVTI HYBRID EXCEL Estate',
'transmission': 'automatic',
'trim': 'VVTI HYBRID EXCEL',
'vin': 'SB1ZS3JE90E157594',
'year': 2015}
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP15%2520FDU%27 HTTP/1.1" 200 None
2026-03-29 22:02:06 [bca.uk] INFO: Saving data for FP15%20FDU: {'created_time': 1774821726.389006, 'last_price_update_time': 1774821726.389019, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FP15%2520FDU') HTTP/1.1" 204 0
2026-03-29 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252668/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252668>
2026-03-29 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250311/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250311>
2026-03-29 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252851/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252851>
2026-03-29 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073233/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073233>
2026-03-29 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253657/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253657>
2026-03-29 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146377/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK59OSL/42811447?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=raIySGe0EosJvJxqdH%2BlY74CrIqyKMpBthmS20ACi0Y%3D)
2026-03-29 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168716/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OXZ4088/42811293?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=jx4hANQRRl%2Fe9r1hb7nkiHYagTnAV8smLgoPKET9d2I%3D)
2026-03-29 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250330/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE14MHY/42792804?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=Y04ygmBotxtRA%2BypErzdd%2FsRMicCvzRTRUQOyWlrd8A%3D)
2026-03-29 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253306/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253306>
2026-03-29 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443659/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443659>
2026-03-29 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252662/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252662>
2026-03-29 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251947/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA57YZF/42798629?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=jPyhLM%2BjiHCcR3WmQ%2FqXhkvGU%2Bz%2FH7BjFWROuOd%2FXoI%3D)
2026-03-29 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168707/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168707>
2026-03-29 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443663/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV13PTO/42812438?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=wxjAtc4NkfyYaQyJmzZouqLPSiImkGC37KZelYNyL%2FI%3D)
2026-03-29 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146367/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK59OSL/42811447?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=raIySGe0EosJvJxqdH%2BlY74CrIqyKMpBthmS20ACi0Y%3D)
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61844a50>
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK59OSL%252F699146377%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146377/600 saved to cache
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item faae600b-2d2c-5cfb-9bd2-3ccad03ec918
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61835950>
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOXZ4088%252F699168716%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168716/600 saved to cache
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc361e13-3b83-5190-85ec-81054039e7f0
2026-03-29 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252871/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE56LWD/42794033?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=9X2VqNUXoy4G7cIyfNsOAU4psnCzDJcB0wbfEMmIfec%3D)
2026-03-29 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250296/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250296>
2026-03-29 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252836/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252836>
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637c6710>
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE14MHY%252F699250330%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250330/600 saved to cache
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70ebff0d-7944-5d91-ab8e-f71690cfd864
2026-03-29 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252851/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE56LWD/42794033?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=9X2VqNUXoy4G7cIyfNsOAU4psnCzDJcB0wbfEMmIfec%3D)
2026-03-29 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250311/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE14MHY/42792804?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=Y04ygmBotxtRA%2BypErzdd%2FsRMicCvzRTRUQOyWlrd8A%3D)
2026-03-29 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073233/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68NYD/42811062?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=8kkcU%2FFGIGGoXYEQH2MfinwpYza8ouVU7RXPAe1sMaY%3D)
2026-03-29 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253657/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA13XJE/42802351?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=wrT1d4szZ5uA5YPKww6Z19lcFj9BeYG1c3p6Yb3SGNs%3D)
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61adce90>
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA57YZF%252F699251947%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251947/600 saved to cache
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3ee94bc-ee6e-5446-95d3-63f1fb5a289c
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611e2d10>
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV13PTO%252F699443663%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443663/600 saved to cache
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c5d6f92-e516-5861-9e52-fa759468ecc2
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61085090>
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK59OSL%252F699146367%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146367/600 saved to cache
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item faae600b-2d2c-5cfb-9bd2-3ccad03ec918
2026-03-29 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443659/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV13PTO/42812438?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=wxjAtc4NkfyYaQyJmzZouqLPSiImkGC37KZelYNyL%2FI%3D)
2026-03-29 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073224/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073224>
2026-03-29 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253306/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP12UBA/42792329?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=ISncP7%2BN%2F05JJFCM2oZrwTcOivoa8wfp%2F0E42xLXB2E%3D)
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61846010>
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE56LWD%252F699252871%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252871/600 saved to cache
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 569e1cde-1a47-540d-9d22-90c30237a2e3
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61844f50>
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE56LWD%252F699252851%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252851/600 saved to cache
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 569e1cde-1a47-540d-9d22-90c30237a2e3
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6217ae10>
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE14MHY%252F699250311%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250311/600 saved to cache
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70ebff0d-7944-5d91-ab8e-f71690cfd864
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617e7210>
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68NYD%252F699073233%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073233/600 saved to cache
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b59bed48-7f26-51b6-a928-99ee433fa2e5
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610b68d0>
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA13XJE%252F699253657%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253657/600 saved to cache
2026-03-29 22:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 56ffa4f0-fba8-5395-a6e0-5c3480fd2644
2026-03-29 22:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252662/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU58OJT/42793659?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=OPkhM0299RrvBfUv4FQRs%2FBEpAArcl7lQriMmHfjtw4%3D)
2026-03-29 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253640/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253640>
2026-03-29 22:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253134/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253134>
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168707/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OXZ4088/42811293?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=jx4hANQRRl%2Fe9r1hb7nkiHYagTnAV8smLgoPKET9d2I%3D)
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac77452590>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV13PTO%252F699443659%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443659/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c5d6f92-e516-5861-9e52-fa759468ecc2
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611716d0>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP12UBA%252F699253306%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253306/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17812872-0c62-52de-9646-8110c3ee0253
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252668/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU58OJT/42793659?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=OPkhM0299RrvBfUv4FQRs%2FBEpAArcl7lQriMmHfjtw4%3D)
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249964/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249964>
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251933/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251933>
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443649/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443649>
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146355/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146355>
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250296/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE14MHY/42792804?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=Y04ygmBotxtRA%2BypErzdd%2FsRMicCvzRTRUQOyWlrd8A%3D)
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c7b150>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU58OJT%252F699252662%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252662/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae5b05cb-e1db-52c3-a568-516b686268d9
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616ad590>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOXZ4088%252F699168707%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168707/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc361e13-3b83-5190-85ec-81054039e7f0
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252658/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252658>
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252836/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE56LWD/42794033?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=9X2VqNUXoy4G7cIyfNsOAU4psnCzDJcB0wbfEMmIfec%3D)
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249944/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249944>
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253119/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253119>
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253622/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253622>
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253640/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA13XJE/42802351?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=wrT1d4szZ5uA5YPKww6Z19lcFj9BeYG1c3p6Yb3SGNs%3D)
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253134/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RNZ5340/42805981?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=EtkIifNkCHy5EOPPe2ywr7dpUF42QieQm0w8636Y6Eg%3D)
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073224/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68NYD/42811062?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=8kkcU%2FFGIGGoXYEQH2MfinwpYza8ouVU7RXPAe1sMaY%3D)
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6179ef50>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU58OJT%252F699252668%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252668/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae5b05cb-e1db-52c3-a568-516b686268d9
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69bb7310>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE14MHY%252F699250296%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250296/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70ebff0d-7944-5d91-ab8e-f71690cfd864
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251933/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA57YZF/42798629?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=jPyhLM%2BjiHCcR3WmQ%2FqXhkvGU%2Bz%2FH7BjFWROuOd%2FXoI%3D)
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146355/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK59OSL/42811447?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=raIySGe0EosJvJxqdH%2BlY74CrIqyKMpBthmS20ACi0Y%3D)
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443649/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV13PTO/42812438?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=wxjAtc4NkfyYaQyJmzZouqLPSiImkGC37KZelYNyL%2FI%3D)
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252650/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252650>
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443643/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443643>
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251926/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251926>
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146346/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146346>
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62137c10>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE56LWD%252F699252836%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252836/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 569e1cde-1a47-540d-9d22-90c30237a2e3
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252658/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU58OJT/42793659?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=OPkhM0299RrvBfUv4FQRs%2FBEpAArcl7lQriMmHfjtw4%3D)
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253610/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253610>
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073201/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073201>
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252802/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252802>
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637b7f10>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA13XJE%252F699253640%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253640/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 56ffa4f0-fba8-5395-a6e0-5c3480fd2644
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616afc90>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRNZ5340%252F699253134%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253134/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9599de9-498d-5a1e-accc-599bd100e89a
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6184f910>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68NYD%252F699073224%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073224/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b59bed48-7f26-51b6-a928-99ee433fa2e5
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249964/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13WCO/42805858?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=GVmWRmuKtNOue8G4g7Ss9cceJ%2BHC2MT4CedJjlRFDBw%3D)
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249944/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13WCO/42805858?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=GVmWRmuKtNOue8G4g7Ss9cceJ%2BHC2MT4CedJjlRFDBw%3D)
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253119/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RNZ5340/42805981?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=EtkIifNkCHy5EOPPe2ywr7dpUF42QieQm0w8636Y6Eg%3D)
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253622/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA13XJE/42802351?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=wrT1d4szZ5uA5YPKww6Z19lcFj9BeYG1c3p6Yb3SGNs%3D)
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61170050>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA57YZF%252F699251933%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251933/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3ee94bc-ee6e-5446-95d3-63f1fb5a289c
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61202210>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK59OSL%252F699146355%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146355/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item faae600b-2d2c-5cfb-9bd2-3ccad03ec918
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620a92d0>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV13PTO%252F699443649%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443649/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c5d6f92-e516-5861-9e52-fa759468ecc2
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251926/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA57YZF/42798629?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=jPyhLM%2BjiHCcR3WmQ%2FqXhkvGU%2Bz%2FH7BjFWROuOd%2FXoI%3D)
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146346/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK59OSL/42811447?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=raIySGe0EosJvJxqdH%2BlY74CrIqyKMpBthmS20ACi0Y%3D)
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443643/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV13PTO/42812438?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=wxjAtc4NkfyYaQyJmzZouqLPSiImkGC37KZelYNyL%2FI%3D)
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253108/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253108>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62096310>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU58OJT%252F699252658%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252658/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae5b05cb-e1db-52c3-a568-516b686268d9
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617e54d0>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13WCO%252F699249964%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249964/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d11b73b-ecf9-57a3-a557-9234293fe7af
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61187510>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13WCO%252F699249944%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249944/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d11b73b-ecf9-57a3-a557-9234293fe7af
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617e6ed0>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRNZ5340%252F699253119%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253119/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9599de9-498d-5a1e-accc-599bd100e89a
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6209c950>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA13XJE%252F699253622%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253622/600 saved to cache
2026-03-29 22:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 56ffa4f0-fba8-5395-a6e0-5c3480fd2644
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252650/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU58OJT/42793659?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=OPkhM0299RrvBfUv4FQRs%2FBEpAArcl7lQriMmHfjtw4%3D)
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251921/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251921>
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249922/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249922>
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146338/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146338>
2026-03-29 22:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252802/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE56LWD/42794033?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=9X2VqNUXoy4G7cIyfNsOAU4psnCzDJcB0wbfEMmIfec%3D)
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443638/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443638>
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252647/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252647>
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253270/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253270>
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250253/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250253>
2026-03-29 22:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168695/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168695>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6179d990>
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA57YZF%252F699251926%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251926/600 saved to cache
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3ee94bc-ee6e-5446-95d3-63f1fb5a289c
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61ade450>
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK59OSL%252F699146346%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146346/600 saved to cache
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item faae600b-2d2c-5cfb-9bd2-3ccad03ec918
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6179e7d0>
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV13PTO%252F699443643%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443643/600 saved to cache
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c5d6f92-e516-5861-9e52-fa759468ecc2
2026-03-29 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073201/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68NYD/42811062?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=8kkcU%2FFGIGGoXYEQH2MfinwpYza8ouVU7RXPAe1sMaY%3D)
2026-03-29 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253610/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA13XJE/42802351?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=wrT1d4szZ5uA5YPKww6Z19lcFj9BeYG1c3p6Yb3SGNs%3D)
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61add490>
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU58OJT%252F699252650%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252650/600 saved to cache
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae5b05cb-e1db-52c3-a568-516b686268d9
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62105b50>
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE56LWD%252F699252802%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252802/600 saved to cache
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 569e1cde-1a47-540d-9d22-90c30237a2e3
2026-03-29 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146338/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK59OSL/42811447?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=raIySGe0EosJvJxqdH%2BlY74CrIqyKMpBthmS20ACi0Y%3D)
2026-03-29 22:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073190/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073190>
2026-03-29 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249922/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13WCO/42805858?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=GVmWRmuKtNOue8G4g7Ss9cceJ%2BHC2MT4CedJjlRFDBw%3D)
2026-03-29 22:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253600/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253600>
2026-03-29 22:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252795/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252795>
2026-03-29 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61adf750>
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68NYD%252F699073201%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073201/600 saved to cache
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b59bed48-7f26-51b6-a928-99ee433fa2e5
2026-03-29 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251921/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA57YZF/42798629?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=jPyhLM%2BjiHCcR3WmQ%2FqXhkvGU%2Bz%2FH7BjFWROuOd%2FXoI%3D)
2026-03-29 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253108/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RNZ5340/42805981?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=EtkIifNkCHy5EOPPe2ywr7dpUF42QieQm0w8636Y6Eg%3D)
2026-03-29 22:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253097/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253097>
2026-03-29 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6102fe90>
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA13XJE%252F699253610%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253610/600 saved to cache
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 56ffa4f0-fba8-5395-a6e0-5c3480fd2644
2026-03-29 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252647/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU58OJT/42793659?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=OPkhM0299RrvBfUv4FQRs%2FBEpAArcl7lQriMmHfjtw4%3D)
2026-03-29 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250253/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE14MHY/42792804?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=Y04ygmBotxtRA%2BypErzdd%2FsRMicCvzRTRUQOyWlrd8A%3D)
2026-03-29 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253270/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP12UBA/42792329?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=ISncP7%2BN%2F05JJFCM2oZrwTcOivoa8wfp%2F0E42xLXB2E%3D)
2026-03-29 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443638/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV13PTO/42812438?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=wxjAtc4NkfyYaQyJmzZouqLPSiImkGC37KZelYNyL%2FI%3D)
2026-03-29 22:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168695/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OXZ4088/42811293?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=jx4hANQRRl%2Fe9r1hb7nkiHYagTnAV8smLgoPKET9d2I%3D)
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac60ff8c50>
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK59OSL%252F699146338%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146338/600 saved to cache
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item faae600b-2d2c-5cfb-9bd2-3ccad03ec918
2026-03-29 22:02:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: faae600b-2d2c-5cfb-9bd2-3ccad03ec918, skipping ID generation
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item faae600b-2d2c-5cfb-9bd2-3ccad03ec918 sending to next pipeline
2026-03-29 22:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: faae600b-2d2c-5cfb-9bd2-3ccad03ec918, identifier: RK59%20OSL
2026-03-29 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618334d0>
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13WCO%252F699249922%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249922/600 saved to cache
2026-03-29 22:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d11b73b-ecf9-57a3-a557-9234293fe7af
2026-03-29 22:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: faae600b-2d2c-5cfb-9bd2-3ccad03ec918 with identifier: RK59%20OSL
2026-03-29 22:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: faae600b-2d2c-5cfb-9bd2-3ccad03ec918 with identifier: RK59%20OSL
2026-03-29 22:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: faae600b-2d2c-5cfb-9bd2-3ccad03ec918 with identifier: RK59%20OSL to the API
2026-03-29 22:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146338/600>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_expert_report_file_6ef2c137-b17a-4f8e-845d-3bef0e0286a4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RK59%20OSL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'faae600b-2d2c-5cfb-9bd2-3ccad03ec918',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RK59 OSL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RK59%20OSL&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MINI',
'model': 'ONE',
'odometer': 50202,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51355,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146331/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48024,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146338/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45797,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146346/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48309,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146355/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45719,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146362/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42249,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146367/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100613,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146377/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49100,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146390/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90167,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146405/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faae600b-2d2c-5cfb-9bd2-3ccad03ec918/faae600b-2d2c-5cfb-9bd2-3ccad03ec918_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86125,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK59OSL/699146421/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'MINI ONE 1.4 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWME32090TM63672',
'year': 2009}
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK59%2520OSL%27 HTTP/1.1" 200 None
2026-03-29 22:02:09 [bca.uk] INFO: Saving data for RK59%20OSL: {'created_time': 1774821729.144191, 'last_price_update_time': 1774821729.144201, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RK59%2520OSL') HTTP/1.1" 204 0
2026-03-29 22:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249906/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249906>
2026-03-29 22:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252642/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NU58OJT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443633/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GV13PTO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252795/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE56LWD/42794033?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=9X2VqNUXoy4G7cIyfNsOAU4psnCzDJcB0wbfEMmIfec%3D)
2026-03-29 22:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143871/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143871>
2026-03-29 22:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699438043/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699438043>
2026-03-29 22:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073190/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68NYD/42811062?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=8kkcU%2FFGIGGoXYEQH2MfinwpYza8ouVU7RXPAe1sMaY%3D)
2026-03-29 22:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253600/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA13XJE/42802351?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=wrT1d4szZ5uA5YPKww6Z19lcFj9BeYG1c3p6Yb3SGNs%3D)
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6102dd50>
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA57YZF%252F699251921%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251921/600 saved to cache
2026-03-29 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3ee94bc-ee6e-5446-95d3-63f1fb5a289c
2026-03-29 22:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3ee94bc-ee6e-5446-95d3-63f1fb5a289c, skipping ID generation
2026-03-29 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3ee94bc-ee6e-5446-95d3-63f1fb5a289c sending to next pipeline
2026-03-29 22:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d3ee94bc-ee6e-5446-95d3-63f1fb5a289c, identifier: MA57%20YZF
2026-03-29 22:02:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611b9150>
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRNZ5340%252F699253108%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253108/600 saved to cache
2026-03-29 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9599de9-498d-5a1e-accc-599bd100e89a
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618e1690>
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU58OJT%252F699252647%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252647/600 saved to cache
2026-03-29 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae5b05cb-e1db-52c3-a568-516b686268d9
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63759310>
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE14MHY%252F699250253%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250253/600 saved to cache
2026-03-29 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70ebff0d-7944-5d91-ab8e-f71690cfd864
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61006590>
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP12UBA%252F699253270%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253270/600 saved to cache
2026-03-29 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17812872-0c62-52de-9646-8110c3ee0253
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6223f390>
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV13PTO%252F699443638%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443638/600 saved to cache
2026-03-29 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c5d6f92-e516-5861-9e52-fa759468ecc2
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69bf1250>
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOXZ4088%252F699168695%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168695/600 saved to cache
2026-03-29 22:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc361e13-3b83-5190-85ec-81054039e7f0
2026-03-29 22:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d3ee94bc-ee6e-5446-95d3-63f1fb5a289c with identifier: MA57%20YZF
2026-03-29 22:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d3ee94bc-ee6e-5446-95d3-63f1fb5a289c with identifier: MA57%20YZF
2026-03-29 22:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d3ee94bc-ee6e-5446-95d3-63f1fb5a289c with identifier: MA57%20YZF to the API
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251921/600>
{'auction_title': '',
'c_o_2_emission_value': 163,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_expert_report_file_565ecd74-7f34-4694-8ee5-bf0264f242d8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA57%20YZF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd3ee94bc-ee6e-5446-95d3-63f1fb5a289c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA57 YZF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MA57%20YZF&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'TOYOTA',
'model': 'AURIS',
'odometer': 92182,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37138,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251917/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38363,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251921/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39345,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251926/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38352,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251933/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34082,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251940/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34162,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251947/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109225,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251957/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70545,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251972/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83251,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251985/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ee94bc-ee6e-5446-95d3-63f1fb5a289c/d3ee94bc-ee6e-5446-95d3-63f1fb5a289c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99510,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA57YZF/699251999/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'TOYOTA AURIS 1.4 VVTI T2 Hatchback',
'transmission': 'manual',
'trim': 'VVTI T2',
'vin': 'JTNKM56E901003434',
'year': 2007}
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA57%2520YZF%27 HTTP/1.1" 200 None
2026-03-29 22:02:09 [bca.uk] INFO: Saving data for MA57%20YZF: {'created_time': 1774821729.921524, 'last_price_update_time': 1774821729.921536, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MA57%2520YZF') HTTP/1.1" 204 0
2026-03-29 22:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253587/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253587>
2026-03-29 22:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252781/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252781>
2026-03-29 22:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253085/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253085>
2026-03-29 22:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073182/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073182>
2026-03-29 22:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250244/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250244>
2026-03-29 22:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253261/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253261>
2026-03-29 22:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168692/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168692>
2026-03-29 22:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253097/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RNZ5340/42805981?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=EtkIifNkCHy5EOPPe2ywr7dpUF42QieQm0w8636Y6Eg%3D)
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69bb4710>
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE56LWD%252F699252795%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252795/600 saved to cache
2026-03-29 22:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 569e1cde-1a47-540d-9d22-90c30237a2e3
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610b6e90>
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68NYD%252F699073190%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073190/600 saved to cache
2026-03-29 22:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b59bed48-7f26-51b6-a928-99ee433fa2e5
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62136e90>
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA13XJE%252F699253600%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253600/600 saved to cache
2026-03-29 22:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 56ffa4f0-fba8-5395-a6e0-5c3480fd2644
2026-03-29 22:02:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac77451fd0>
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRNZ5340%252F699253097%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253097/600 saved to cache
2026-03-29 22:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9599de9-498d-5a1e-accc-599bd100e89a
2026-03-29 22:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249887/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249887>
2026-03-29 22:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143856/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143856>
2026-03-29 22:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253253/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253253>
2026-03-29 22:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443633/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV13PTO/42812438?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=wxjAtc4NkfyYaQyJmzZouqLPSiImkGC37KZelYNyL%2FI%3D)
2026-03-29 22:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699438043/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NA04XFU/42812369?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=7XXhzPtvsDMZKwJi3NCUHNT0YaNfJtDfBNmw7ADL6OM%3D)
2026-03-29 22:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252642/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU58OJT/42793659?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=OPkhM0299RrvBfUv4FQRs%2FBEpAArcl7lQriMmHfjtw4%3D)
2026-03-29 22:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143871/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY64YYK/42812362?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=rVxpK9Nu9k7RcTYnPo9WbYSk5dZ2Ab93q0jZLZNLD3o%3D)
2026-03-29 22:02:10 [scrapy.extensions.logstats] INFO: Crawled 57 pages (at 29 pages/min), scraped 81 items (at 69 items/min)
2026-03-29 22:02:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-29 22:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249906/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13WCO/42805858?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=GVmWRmuKtNOue8G4g7Ss9cceJ%2BHC2MT4CedJjlRFDBw%3D)
2026-03-29 22:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253261/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP12UBA/42792329?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=ISncP7%2BN%2F05JJFCM2oZrwTcOivoa8wfp%2F0E42xLXB2E%3D)
2026-03-29 22:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253085/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RNZ5340/42805981?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=EtkIifNkCHy5EOPPe2ywr7dpUF42QieQm0w8636Y6Eg%3D)
2026-03-29 22:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250244/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE14MHY/42792804?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=Y04ygmBotxtRA%2BypErzdd%2FsRMicCvzRTRUQOyWlrd8A%3D)
2026-03-29 22:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252781/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE56LWD/42794033?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=9X2VqNUXoy4G7cIyfNsOAU4psnCzDJcB0wbfEMmIfec%3D)
2026-03-29 22:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073182/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68NYD/42811062?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=8kkcU%2FFGIGGoXYEQH2MfinwpYza8ouVU7RXPAe1sMaY%3D)
2026-03-29 22:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168692/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OXZ4088/42811293?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=jx4hANQRRl%2Fe9r1hb7nkiHYagTnAV8smLgoPKET9d2I%3D)
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61609310>
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV13PTO%252F699443633%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443633/600 saved to cache
2026-03-29 22:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c5d6f92-e516-5861-9e52-fa759468ecc2
2026-03-29 22:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c5d6f92-e516-5861-9e52-fa759468ecc2, skipping ID generation
2026-03-29 22:02:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c5d6f92-e516-5861-9e52-fa759468ecc2 sending to next pipeline
2026-03-29 22:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8c5d6f92-e516-5861-9e52-fa759468ecc2, identifier: GV13%20PTO
2026-03-29 22:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8c5d6f92-e516-5861-9e52-fa759468ecc2 with identifier: GV13%20PTO
2026-03-29 22:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8c5d6f92-e516-5861-9e52-fa759468ecc2 with identifier: GV13%20PTO
2026-03-29 22:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8c5d6f92-e516-5861-9e52-fa759468ecc2 with identifier: GV13%20PTO to the API
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443633/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_expert_report_file_7a6f4497-e5dc-4294-ad35-d4ce3eb545e0.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GV13%20PTO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8c5d6f92-e516-5861-9e52-fa759468ecc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GV13 PTO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GV13%20PTO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'SUZUKI',
'model': 'SX4',
'odometer': 52854,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38501,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443633/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39017,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443638/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38266,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443643/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37160,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443649/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34012,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443659/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34419,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443663/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98166,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443671/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89164,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443678/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94895,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443685/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c5d6f92-e516-5861-9e52-fa759468ecc2/8c5d6f92-e516-5861-9e52-fa759468ecc2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75024,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV13PTO/699443694/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'SUZUKI SX4 2.0 DDIS SZ5 4X4 Hatchback',
'transmission': 'manual',
'trim': 'DDIS SZ5 4X4',
'vin': 'TSMEYB91S00650514',
'year': 2013}
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV13%2520PTO%27 HTTP/1.1" 200 None
2026-03-29 22:02:10 [bca.uk] INFO: Saving data for GV13%20PTO: {'created_time': 1774821730.761041, 'last_price_update_time': 1774821730.76105, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GV13%2520PTO') HTTP/1.1" 204 0
2026-03-29 22:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168684/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168684>
2026-03-29 22:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253253/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP12UBA/42792329?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=ISncP7%2BN%2F05JJFCM2oZrwTcOivoa8wfp%2F0E42xLXB2E%3D)
2026-03-29 22:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250232/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250232>
2026-03-29 22:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252770/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252770>
2026-03-29 22:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073170/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073170>
2026-03-29 22:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253587/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA13XJE/42802351?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=wrT1d4szZ5uA5YPKww6Z19lcFj9BeYG1c3p6Yb3SGNs%3D)
2026-03-29 22:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249887/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13WCO/42805858?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=GVmWRmuKtNOue8G4g7Ss9cceJ%2BHC2MT4CedJjlRFDBw%3D)
2026-03-29 22:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143856/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY64YYK/42812362?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=rVxpK9Nu9k7RcTYnPo9WbYSk5dZ2Ab93q0jZLZNLD3o%3D)
2026-03-29 22:02:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6221d910>
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNA04XFU%252F699438043%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699438043/600 saved to cache
2026-03-29 22:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e6199b36-64a9-5e19-9093-4273bab95743
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a45d90>
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU58OJT%252F699252642%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252642/600 saved to cache
2026-03-29 22:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae5b05cb-e1db-52c3-a568-516b686268d9
2026-03-29 22:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae5b05cb-e1db-52c3-a568-516b686268d9, skipping ID generation
2026-03-29 22:02:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae5b05cb-e1db-52c3-a568-516b686268d9 sending to next pipeline
2026-03-29 22:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ae5b05cb-e1db-52c3-a568-516b686268d9, identifier: NU58%20OJT
2026-03-29 22:02:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b2790>
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY64YYK%252F699143871%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143871/600 saved to cache
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7797c46-b28a-5526-a960-afcea68790a7
2026-03-29 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61045d10>
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13WCO%252F699249906%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249906/600 saved to cache
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d11b73b-ecf9-57a3-a557-9234293fe7af
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63663b90>
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP12UBA%252F699253261%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253261/600 saved to cache
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17812872-0c62-52de-9646-8110c3ee0253
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a46f90>
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRNZ5340%252F699253085%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253085/600 saved to cache
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9599de9-498d-5a1e-accc-599bd100e89a
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61046b50>
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE14MHY%252F699250244%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250244/600 saved to cache
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70ebff0d-7944-5d91-ab8e-f71690cfd864
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620976d0>
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE56LWD%252F699252781%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252781/600 saved to cache
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 569e1cde-1a47-540d-9d22-90c30237a2e3
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61021050>
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68NYD%252F699073182%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073182/600 saved to cache
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b59bed48-7f26-51b6-a928-99ee433fa2e5
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a45f50>
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOXZ4088%252F699168692%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168692/600 saved to cache
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc361e13-3b83-5190-85ec-81054039e7f0
2026-03-29 22:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ae5b05cb-e1db-52c3-a568-516b686268d9 with identifier: NU58%20OJT
2026-03-29 22:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ae5b05cb-e1db-52c3-a568-516b686268d9 with identifier: NU58%20OJT
2026-03-29 22:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ae5b05cb-e1db-52c3-a568-516b686268d9 with identifier: NU58%20OJT to the API
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252642/600>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_expert_report_file_09969caf-9f22-4f43-b12f-a83d8bb8437c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NU58%20OJT-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ae5b05cb-e1db-52c3-a568-516b686268d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NU58 OJT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NU58%20OJT&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'BMW',
'model': '520D',
'odometer': 180300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40395,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252642/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38400,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252647/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41034,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252650/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41939,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252658/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36716,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252662/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34011,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252668/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92320,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252679/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80048,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252688/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95527,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252710/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5b05cb-e1db-52c3-a568-516b686268d9/ae5b05cb-e1db-52c3-a568-516b686268d9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81273,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU58OJT/699252730/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'BMW 520D 2.0 177 M SPORT TOURING Estate',
'transmission': 'automatic',
'trim': '177 M SPORT TOURING',
'vin': 'WBAPX32020C186192',
'year': 2008}
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU58%2520OJT%27 HTTP/1.1" 200 None
2026-03-29 22:02:11 [bca.uk] INFO: Saving data for NU58%20OJT: {'created_time': 1774821731.721526, 'last_price_update_time': 1774821731.721537, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NU58%2520OJT') HTTP/1.1" 204 0
2026-03-29 22:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249874/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249874>
2026-03-29 22:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168679/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168679>
2026-03-29 22:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252765/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252765>
2026-03-29 22:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253242/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SP12UBA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253579/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253579>
2026-03-29 22:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253077/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253077>
2026-03-29 22:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250226/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250226>
2026-03-29 22:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073156/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073156>
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61685b50>
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP12UBA%252F699253253%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253253/600 saved to cache
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17812872-0c62-52de-9646-8110c3ee0253
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632f0f50>
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA13XJE%252F699253587%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253587/600 saved to cache
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 56ffa4f0-fba8-5395-a6e0-5c3480fd2644
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617f50d0>
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13WCO%252F699249887%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249887/600 saved to cache
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d11b73b-ecf9-57a3-a557-9234293fe7af
2026-03-29 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632f0590>
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY64YYK%252F699143856%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143856/600 saved to cache
2026-03-29 22:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7797c46-b28a-5526-a960-afcea68790a7
2026-03-29 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168684/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OXZ4088/42811293?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=jx4hANQRRl%2Fe9r1hb7nkiHYagTnAV8smLgoPKET9d2I%3D)
2026-03-29 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252770/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE56LWD/42794033?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=9X2VqNUXoy4G7cIyfNsOAU4psnCzDJcB0wbfEMmIfec%3D)
2026-03-29 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250232/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE14MHY/42792804?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=Y04ygmBotxtRA%2BypErzdd%2FsRMicCvzRTRUQOyWlrd8A%3D)
2026-03-29 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253574/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253574>
2026-03-29 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249864/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249864>
2026-03-29 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699438001/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699438001>
2026-03-29 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253070/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253070>
2026-03-29 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073170/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68NYD/42811062?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=8kkcU%2FFGIGGoXYEQH2MfinwpYza8ouVU7RXPAe1sMaY%3D)
2026-03-29 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253242/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP12UBA/42792329?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=ISncP7%2BN%2F05JJFCM2oZrwTcOivoa8wfp%2F0E42xLXB2E%3D)
2026-03-29 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073156/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68NYD/42811062?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=8kkcU%2FFGIGGoXYEQH2MfinwpYza8ouVU7RXPAe1sMaY%3D)
2026-03-29 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253077/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RNZ5340/42805981?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=EtkIifNkCHy5EOPPe2ywr7dpUF42QieQm0w8636Y6Eg%3D)
2026-03-29 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252765/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE56LWD/42794033?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=9X2VqNUXoy4G7cIyfNsOAU4psnCzDJcB0wbfEMmIfec%3D)
2026-03-29 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249874/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13WCO/42805858?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=GVmWRmuKtNOue8G4g7Ss9cceJ%2BHC2MT4CedJjlRFDBw%3D)
2026-03-29 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250226/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE14MHY/42792804?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=Y04ygmBotxtRA%2BypErzdd%2FsRMicCvzRTRUQOyWlrd8A%3D)
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615a2b50>
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOXZ4088%252F699168684%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168684/600 saved to cache
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc361e13-3b83-5190-85ec-81054039e7f0
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6117f950>
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE56LWD%252F699252770%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252770/600 saved to cache
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 569e1cde-1a47-540d-9d22-90c30237a2e3
2026-03-29 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253070/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RNZ5340/42805981?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=EtkIifNkCHy5EOPPe2ywr7dpUF42QieQm0w8636Y6Eg%3D)
2026-03-29 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143809/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143809>
2026-03-29 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252757/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PE56LWD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG63RZR/42795085?sv=2020-08-04&st=2026-03-29T22%3A02%3A12Z&se=2026-03-29T22%3A27%3A12Z&sr=b&sp=r&sig=z41fVlHE5GW0%2FHMd9juQKD7zO7vEwLy4SxIpPJt68iA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG63%20RZR-GB>
2026-03-29 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253579/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA13XJE/42802351?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=wrT1d4szZ5uA5YPKww6Z19lcFj9BeYG1c3p6Yb3SGNs%3D)
2026-03-29 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168679/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OXZ4088/42811293?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=jx4hANQRRl%2Fe9r1hb7nkiHYagTnAV8smLgoPKET9d2I%3D)
2026-03-29 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249864/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13WCO/42805858?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=GVmWRmuKtNOue8G4g7Ss9cceJ%2BHC2MT4CedJjlRFDBw%3D)
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636f4550>
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE14MHY%252F699250232%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250232/600 saved to cache
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70ebff0d-7944-5d91-ab8e-f71690cfd864
2026-03-29 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699438001/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NA04XFU/42812369?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=7XXhzPtvsDMZKwJi3NCUHNT0YaNfJtDfBNmw7ADL6OM%3D)
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61925190>
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68NYD%252F699073170%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073170/600 saved to cache
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b59bed48-7f26-51b6-a928-99ee433fa2e5
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62130b50>
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP12UBA%252F699253242%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253242/600 saved to cache
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17812872-0c62-52de-9646-8110c3ee0253
2026-03-29 22:02:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17812872-0c62-52de-9646-8110c3ee0253, skipping ID generation
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17812872-0c62-52de-9646-8110c3ee0253 sending to next pipeline
2026-03-29 22:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 17812872-0c62-52de-9646-8110c3ee0253, identifier: SP12%20UBA
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615a2d50>
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68NYD%252F699073156%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073156/600 saved to cache
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b59bed48-7f26-51b6-a928-99ee433fa2e5
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621bbfd0>
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRNZ5340%252F699253077%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253077/600 saved to cache
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9599de9-498d-5a1e-accc-599bd100e89a
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6106d5d0>
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE56LWD%252F699252765%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252765/600 saved to cache
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 569e1cde-1a47-540d-9d22-90c30237a2e3
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615edc90>
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13WCO%252F699249874%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249874/600 saved to cache
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d11b73b-ecf9-57a3-a557-9234293fe7af
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6209aa10>
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE14MHY%252F699250226%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250226/600 saved to cache
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70ebff0d-7944-5d91-ab8e-f71690cfd864
2026-03-29 22:02:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70ebff0d-7944-5d91-ab8e-f71690cfd864, skipping ID generation
2026-03-29 22:02:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70ebff0d-7944-5d91-ab8e-f71690cfd864 sending to next pipeline
2026-03-29 22:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 70ebff0d-7944-5d91-ab8e-f71690cfd864, identifier: DE14%20MHY
2026-03-29 22:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253574/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA13XJE/42802351?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=wrT1d4szZ5uA5YPKww6Z19lcFj9BeYG1c3p6Yb3SGNs%3D)
2026-03-29 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143793/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143793>
2026-03-29 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437977/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437977>
2026-03-29 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249855/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249855>
2026-03-29 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253568/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253568>
2026-03-29 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253065/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253065>
2026-03-29 22:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073146/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073146>
2026-03-29 22:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 17812872-0c62-52de-9646-8110c3ee0253 with identifier: SP12%20UBA
2026-03-29 22:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 17812872-0c62-52de-9646-8110c3ee0253 with identifier: SP12%20UBA
2026-03-29 22:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 17812872-0c62-52de-9646-8110c3ee0253 with identifier: SP12%20UBA to the API
2026-03-29 22:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253242/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_expert_report_file_929fdc8e-aacc-4022-a51d-243431387aec.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP12%20UBA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '17812872-0c62-52de-9646-8110c3ee0253',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP12 UBA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP12%20UBA&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SEAT',
'model': 'IBIZA',
'odometer': 112760,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39116,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253242/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38393,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253253/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253261/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253270/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36258,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253277/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33830,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253290/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111756,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253306/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89776,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253321/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100415,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253336/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17812872-0c62-52de-9646-8110c3ee0253/17812872-0c62-52de-9646-8110c3ee0253_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83602,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP12UBA/699253354/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'SEAT IBIZA 1.4 SE COPA Hatchback',
'transmission': 'manual',
'trim': 'SE COPA',
'vin': 'VSSZZZ6JZCR048292',
'year': 2012}
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP12%2520UBA%27 HTTP/1.1" 200 None
2026-03-29 22:02:13 [bca.uk] INFO: Saving data for SP12%20UBA: {'created_time': 1774821733.218164, 'last_price_update_time': 1774821733.218177, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP12%2520UBA') HTTP/1.1" 204 0
2026-03-29 22:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 70ebff0d-7944-5d91-ab8e-f71690cfd864 with identifier: DE14%20MHY
2026-03-29 22:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 70ebff0d-7944-5d91-ab8e-f71690cfd864 with identifier: DE14%20MHY
2026-03-29 22:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 70ebff0d-7944-5d91-ab8e-f71690cfd864 with identifier: DE14%20MHY to the API
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250226/600>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_expert_report_file_bf0a95a3-a138-4684-9e86-33ee03fedeb3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE14%20MHY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.7L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '70ebff0d-7944-5d91-ab8e-f71690cfd864',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DE14 MHY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DE14%20MHY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'MOKKA',
'odometer': 88749,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39411,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250214/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40360,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250226/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40135,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250232/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40756,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250244/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37751,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250253/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37221,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250261/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92893,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250280/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68802,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250296/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83824,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250311/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ebff0d-7944-5d91-ab8e-f71690cfd864/70ebff0d-7944-5d91-ab8e-f71690cfd864_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97365,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE14MHY/699250330/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL MOKKA 1.7 CDTI 130 TECH LINE 2WD S/S StationWagon',
'transmission': 'manual',
'trim': 'CDTI 130 TECH LINE 2WD S/S',
'vin': 'W0LJC7ELXEB640055',
'year': 2014}
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE14%2520MHY%27 HTTP/1.1" 200 None
2026-03-29 22:02:13 [bca.uk] INFO: Saving data for DE14%20MHY: {'created_time': 1774821733.727649, 'last_price_update_time': 1774821733.72766, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DE14%2520MHY') HTTP/1.1" 204 0
2026-03-29 22:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427850/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427850>
2026-03-29 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62107d90>
2026-03-29 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRNZ5340%252F699253070%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253070/600 saved to cache
2026-03-29 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9599de9-498d-5a1e-accc-599bd100e89a
2026-03-29 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63632a90>
2026-03-29 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA13XJE%252F699253579%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253579/600 saved to cache
2026-03-29 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56ffa4f0-fba8-5395-a6e0-5c3480fd2644
2026-03-29 22:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61012b90>
2026-03-29 22:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOXZ4088%252F699168679%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168679/600 saved to cache
2026-03-29 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc361e13-3b83-5190-85ec-81054039e7f0
2026-03-29 22:02:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc361e13-3b83-5190-85ec-81054039e7f0, skipping ID generation
2026-03-29 22:02:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc361e13-3b83-5190-85ec-81054039e7f0 sending to next pipeline
2026-03-29 22:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cc361e13-3b83-5190-85ec-81054039e7f0, identifier: OXZ%204088
2026-03-29 22:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636321d0>
2026-03-29 22:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13WCO%252F699249864%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249864/600 saved to cache
2026-03-29 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d11b73b-ecf9-57a3-a557-9234293fe7af
2026-03-29 22:02:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62179710>
2026-03-29 22:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNA04XFU%252F699438001%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699438001/600 saved to cache
2026-03-29 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e6199b36-64a9-5e19-9093-4273bab95743
2026-03-29 22:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cc361e13-3b83-5190-85ec-81054039e7f0 with identifier: OXZ%204088
2026-03-29 22:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cc361e13-3b83-5190-85ec-81054039e7f0 with identifier: OXZ%204088
2026-03-29 22:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cc361e13-3b83-5190-85ec-81054039e7f0 with identifier: OXZ%204088 to the API
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168679/600>
{'auction_title': '',
'c_o_2_emission_value': 567,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_expert_report_file_29e5f5e2-2101-42be-bf85-d32e27f49c96.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OXZ%204088-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cc361e13-3b83-5190-85ec-81054039e7f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OXZ 4088',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OXZ%204088&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'DACIA',
'model': 'DUSTER',
'odometer': 42243,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40893,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168671/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40430,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168679/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40771,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168684/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41688,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168692/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37169,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168695/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35570,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168700/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96507,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168704/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77786,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168707/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100267,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168711/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc361e13-3b83-5190-85ec-81054039e7f0/cc361e13-3b83-5190-85ec-81054039e7f0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79700,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OXZ4088/699168716/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'DACIA DUSTER 1.0 TCE 100 COMFORT StationWagon',
'transmission': 'manual',
'trim': 'TCE 100 COMFORT',
'vin': 'VF1HJD20665490538',
'year': 2020}
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OXZ%25204088%27 HTTP/1.1" 200 None
2026-03-29 22:02:14 [bca.uk] INFO: Saving data for OXZ%204088: {'created_time': 1774821734.473525, 'last_price_update_time': 1774821734.473535, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OXZ%25204088') HTTP/1.1" 204 0
2026-03-29 22:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252757/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE56LWD/42794033?sv=2020-08-04&st=2026-03-29T22%3A01%3A55Z&se=2026-03-29T22%3A26%3A55Z&sr=b&sp=r&sig=9X2VqNUXoy4G7cIyfNsOAU4psnCzDJcB0wbfEMmIfec%3D)
2026-03-29 22:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015768/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015768>
2026-03-29 22:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253055/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253055>
2026-03-29 22:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249848/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249848>
2026-03-29 22:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LS68HJJ/42810310?sv=2020-08-04&st=2026-03-29T22%3A02%3A13Z&se=2026-03-29T22%3A27%3A13Z&sr=b&sp=r&sig=Jq%2BrvM3TzBPhUwiGQQKCTNJs%2FBAWZ7OqMKoc7RuV%2Buw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LS68%20HJJ-GB>
2026-03-29 22:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63726790>
2026-03-29 22:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA13XJE%252F699253574%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253574/600 saved to cache
2026-03-29 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56ffa4f0-fba8-5395-a6e0-5c3480fd2644
2026-03-29 22:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437964/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437964>
2026-03-29 22:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143809/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY64YYK/42812362?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=rVxpK9Nu9k7RcTYnPo9WbYSk5dZ2Ab93q0jZLZNLD3o%3D)
2026-03-29 22:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG63RZR/42795085?sv=2020-08-04&st=2026-03-29T22%3A02%3A12Z&se=2026-03-29T22%3A27%3A12Z&sr=b&sp=r&sig=z41fVlHE5GW0%2FHMd9juQKD7zO7vEwLy4SxIpPJt68iA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61846a50>
2026-03-29 22:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPE56LWD%252F699252757%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252757/600 saved to cache
2026-03-29 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 569e1cde-1a47-540d-9d22-90c30237a2e3
2026-03-29 22:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 569e1cde-1a47-540d-9d22-90c30237a2e3, skipping ID generation
2026-03-29 22:02:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 569e1cde-1a47-540d-9d22-90c30237a2e3 sending to next pipeline
2026-03-29 22:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 569e1cde-1a47-540d-9d22-90c30237a2e3, identifier: PE56%20LWD
2026-03-29 22:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 569e1cde-1a47-540d-9d22-90c30237a2e3 with identifier: PE56%20LWD
2026-03-29 22:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 569e1cde-1a47-540d-9d22-90c30237a2e3 with identifier: PE56%20LWD
2026-03-29 22:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 569e1cde-1a47-540d-9d22-90c30237a2e3 with identifier: PE56%20LWD to the API
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252757/600>
{'auction_title': '',
'c_o_2_emission_value': 221,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_expert_report_file_14dd9d92-d510-4961-b53f-e56ac43ce31a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PE56%20LWD-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '569e1cde-1a47-540d-9d22-90c30237a2e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PE56 LWD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PE56%20LWD&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SAAB',
'model': '9-3',
'odometer': 81314,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40647,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252757/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39957,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252765/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39196,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252770/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40109,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252781/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36524,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252795/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34580,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252802/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89895,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252817/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82515,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252836/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93366,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252851/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569e1cde-1a47-540d-9d22-90c30237a2e3/569e1cde-1a47-540d-9d22-90c30237a2e3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71972,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PE56LWD/699252871/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'SAAB 9-3 2.0 1.8T VECTOR SPORT Saloon',
'transmission': 'automatic',
'trim': '1.8T VECTOR SPORT',
'vin': 'YS3FF49F871007332',
'year': 2006}
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE56%2520LWD%27 HTTP/1.1" 200 None
2026-03-29 22:02:15 [bca.uk] INFO: Saving data for PE56%20LWD: {'created_time': 1774821735.112283, 'last_price_update_time': 1774821735.112293, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PE56%2520LWD') HTTP/1.1" 204 0
2026-03-29 22:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437977/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NA04XFU/42812369?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=7XXhzPtvsDMZKwJi3NCUHNT0YaNfJtDfBNmw7ADL6OM%3D)
2026-03-29 22:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249855/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13WCO/42805858?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=GVmWRmuKtNOue8G4g7Ss9cceJ%2BHC2MT4CedJjlRFDBw%3D)
2026-03-29 22:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253065/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RNZ5340/42805981?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=EtkIifNkCHy5EOPPe2ywr7dpUF42QieQm0w8636Y6Eg%3D)
2026-03-29 22:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427850/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08NWF/42812303?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=%2FmvSSUyiAYVN8KnXHHAVZPAhaX5NwULjoP6vZooLMQE%3D)
2026-03-29 22:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143782>
2026-03-29 22:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253568/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA13XJE/42802351?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=wrT1d4szZ5uA5YPKww6Z19lcFj9BeYG1c3p6Yb3SGNs%3D)
2026-03-29 22:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073146/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ68NYD/42811062?sv=2020-08-04&st=2026-03-29T22%3A01%3A54Z&se=2026-03-29T22%3A26%3A54Z&sr=b&sp=r&sig=8kkcU%2FFGIGGoXYEQH2MfinwpYza8ouVU7RXPAe1sMaY%3D)
2026-03-29 22:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143793/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY64YYK/42812362?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=rVxpK9Nu9k7RcTYnPo9WbYSk5dZ2Ab93q0jZLZNLD3o%3D)
2026-03-29 22:02:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6354a050>
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY64YYK%252F699143809%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143809/600 saved to cache
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7797c46-b28a-5526-a960-afcea68790a7
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618466d0>
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_expert_report_file_574b293f-f1f4-4b84-a0c9-cbd9ad227359.pdf HTTP/1.1" 201 0
2026-03-29 22:02:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c
2026-03-29 22:02:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c, skipping ID generation
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBG63RZR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BG63RZR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253055/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RNZ5340/42805981?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=EtkIifNkCHy5EOPPe2ywr7dpUF42QieQm0w8636Y6Eg%3D)
2026-03-29 22:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437964/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NA04XFU/42812369?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=7XXhzPtvsDMZKwJi3NCUHNT0YaNfJtDfBNmw7ADL6OM%3D)
2026-03-29 22:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015725/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015725>
2026-03-29 22:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427837/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427837>
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249861%27 HTTP/1.1" 200 None
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249861 not downloaded yet
2026-03-29 22:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015768/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO67CJZ/42812295?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=f5P0DwslIG4nez3ramT%2BBglIeMphiUhV3LeShcWO2lA%3D)
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61000490>
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNA04XFU%252F699437977%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437977/600 saved to cache
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6199b36-64a9-5e19-9093-4273bab95743
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61934150>
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13WCO%252F699249855%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249855/600 saved to cache
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d11b73b-ecf9-57a3-a557-9234293fe7af
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618cef90>
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRNZ5340%252F699253065%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253065/600 saved to cache
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9599de9-498d-5a1e-accc-599bd100e89a
2026-03-29 22:02:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a531d0>
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08NWF%252F699427850%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427850/600 saved to cache
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55260bef-13ca-53e6-8438-967001fdad8a
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618ce910>
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA13XJE%252F699253568%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253568/600 saved to cache
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56ffa4f0-fba8-5395-a6e0-5c3480fd2644
2026-03-29 22:02:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56ffa4f0-fba8-5395-a6e0-5c3480fd2644, skipping ID generation
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56ffa4f0-fba8-5395-a6e0-5c3480fd2644 sending to next pipeline
2026-03-29 22:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 56ffa4f0-fba8-5395-a6e0-5c3480fd2644, identifier: YA13%20XJE
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61000650>
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ68NYD%252F699073146%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073146/600 saved to cache
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b59bed48-7f26-51b6-a928-99ee433fa2e5
2026-03-29 22:02:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b59bed48-7f26-51b6-a928-99ee433fa2e5, skipping ID generation
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b59bed48-7f26-51b6-a928-99ee433fa2e5 sending to next pipeline
2026-03-29 22:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b59bed48-7f26-51b6-a928-99ee433fa2e5, identifier: PJ68%20NYD
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61643590>
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY64YYK%252F699143793%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143793/600 saved to cache
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7797c46-b28a-5526-a960-afcea68790a7
2026-03-29 22:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249848/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13WCO/42805858?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=GVmWRmuKtNOue8G4g7Ss9cceJ%2BHC2MT4CedJjlRFDBw%3D)
2026-03-29 22:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF13AKO/42806090?sv=2020-08-04&st=2026-03-29T22%3A02%3A15Z&se=2026-03-29T22%3A27%3A15Z&sr=b&sp=r&sig=ESg3nxrsu2ZrjolRg7a9LM5RG04CyS%2FU1fJxP3w6KTM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DF13%20AKO-GB>
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249871%27 HTTP/1.1" 200 None
2026-03-29 22:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249871 not downloaded yet
2026-03-29 22:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 56ffa4f0-fba8-5395-a6e0-5c3480fd2644 with identifier: YA13%20XJE
2026-03-29 22:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 56ffa4f0-fba8-5395-a6e0-5c3480fd2644 with identifier: YA13%20XJE
2026-03-29 22:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 56ffa4f0-fba8-5395-a6e0-5c3480fd2644 with identifier: YA13%20XJE to the API
2026-03-29 22:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253568/600>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_expert_report_file_58f5616f-cab5-4fb8-a52c-f5f1deb1bc53.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YA13%20XJE-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '56ffa4f0-fba8-5395-a6e0-5c3480fd2644',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YA13 XJE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YA13%20XJE&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '208',
'odometer': 89233,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40098,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253563/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39271,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253568/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39285,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253574/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40249,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253579/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36418,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253587/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35038,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253600/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93811,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253610/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72021,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253622/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95077,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253640/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ffa4f0-fba8-5395-a6e0-5c3480fd2644/56ffa4f0-fba8-5395-a6e0-5c3480fd2644_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90218,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA13XJE/699253657/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'PEUGEOT 208 1.2 VTI ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'VTI ACTIVE',
'vin': 'VF3CCHMZ0DW051882',
'year': 2013}
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA13%2520XJE%27 HTTP/1.1" 200 None
2026-03-29 22:02:16 [bca.uk] INFO: Saving data for YA13%20XJE: {'created_time': 1774821736.138918, 'last_price_update_time': 1774821736.138928, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YA13%2520XJE') HTTP/1.1" 204 0
2026-03-29 22:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b59bed48-7f26-51b6-a928-99ee433fa2e5 with identifier: PJ68%20NYD
2026-03-29 22:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b59bed48-7f26-51b6-a928-99ee433fa2e5 with identifier: PJ68%20NYD
2026-03-29 22:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b59bed48-7f26-51b6-a928-99ee433fa2e5 with identifier: PJ68%20NYD to the API
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073146/600>
{'auction_title': '',
'c_o_2_emission_value': 95,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_expert_report_file_0199151f-68f7-4edb-991a-08b40cfe13f5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ68%20NYD-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b59bed48-7f26-51b6-a928-99ee433fa2e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ68 NYD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ68%20NYD&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '108',
'odometer': 39891,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39713,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073139/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40457,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073146/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40407,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073156/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39383,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073170/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39642,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073182/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40446,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073190/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86994,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073201/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65525,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073215/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91184,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073224/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59bed48-7f26-51b6-a928-99ee433fa2e5/b59bed48-7f26-51b6-a928-99ee433fa2e5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80671,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ68NYD/699073233/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'PEUGEOT 108 1.0 72 COLLECTION 2-TRONIC Hatchback',
'transmission': 'automatic',
'trim': '72 COLLECTION 2-TRONIC',
'vin': 'VF3PSCFBDJR190159',
'year': 2018}
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ68%2520NYD%27 HTTP/1.1" 200 None
2026-03-29 22:02:16 [bca.uk] INFO: Saving data for PJ68%20NYD: {'created_time': 1774821736.529567, 'last_price_update_time': 1774821736.529578, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ68%2520NYD') HTTP/1.1" 204 0
2026-03-29 22:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143776/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143776>
2026-03-29 22:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437944/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437944>
2026-03-29 22:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249842/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BG13WCO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY64YYK/42812362?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=rVxpK9Nu9k7RcTYnPo9WbYSk5dZ2Ab93q0jZLZNLD3o%3D)
2026-03-29 22:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427814/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427814>
2026-03-29 22:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LS68HJJ/42810310?sv=2020-08-04&st=2026-03-29T22%3A02%3A13Z&se=2026-03-29T22%3A27%3A13Z&sr=b&sp=r&sig=Jq%2BrvM3TzBPhUwiGQQKCTNJs%2FBAWZ7OqMKoc7RuV%2Buw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249881%27 HTTP/1.1" 200 None
2026-03-29 22:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249881 not downloaded yet
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249893%27 HTTP/1.1" 200 None
2026-03-29 22:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249893 not downloaded yet
2026-03-29 22:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63558390>
2026-03-29 22:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRNZ5340%252F699253055%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253055/600 saved to cache
2026-03-29 22:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9599de9-498d-5a1e-accc-599bd100e89a
2026-03-29 22:02:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9599de9-498d-5a1e-accc-599bd100e89a, skipping ID generation
2026-03-29 22:02:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9599de9-498d-5a1e-accc-599bd100e89a sending to next pipeline
2026-03-29 22:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c9599de9-498d-5a1e-accc-599bd100e89a, identifier: RNZ%205340
2026-03-29 22:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637b7990>
2026-03-29 22:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNA04XFU%252F699437964%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437964/600 saved to cache
2026-03-29 22:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6199b36-64a9-5e19-9093-4273bab95743
2026-03-29 22:02:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617f7250>
2026-03-29 22:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO67CJZ%252F699015768%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015768/600 saved to cache
2026-03-29 22:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4452e7a2-008a-5460-ac69-330bdd58f5d4
2026-03-29 22:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6165b6d0>
2026-03-29 22:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13WCO%252F699249848%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249848/600 saved to cache
2026-03-29 22:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d11b73b-ecf9-57a3-a557-9234293fe7af
2026-03-29 22:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c9599de9-498d-5a1e-accc-599bd100e89a with identifier: RNZ%205340
2026-03-29 22:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c9599de9-498d-5a1e-accc-599bd100e89a with identifier: RNZ%205340
2026-03-29 22:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c9599de9-498d-5a1e-accc-599bd100e89a with identifier: RNZ%205340 to the API
2026-03-29 22:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253055/600>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_expert_report_file_18241a4e-a2cd-4648-a57a-ef453b5e1275.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RNZ%205340-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c9599de9-498d-5a1e-accc-599bd100e89a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RNZ 5340',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RNZ%205340&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'BMW',
'model': 'X5',
'odometer': 110256,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38220,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253051/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39903,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253055/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40011,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253065/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39903,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253070/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37384,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253077/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36789,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253085/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92125,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253097/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253108/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89489,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253119/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9599de9-498d-5a1e-accc-599bd100e89a/c9599de9-498d-5a1e-accc-599bd100e89a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95443,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RNZ5340/699253134/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'BMW X5 3.0 XDRIVE 30D SE StationWagon',
'transmission': 'manual',
'trim': 'XDRIVE 30D SE',
'vin': 'WBAZW42020L797079',
'year': 2012}
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RNZ%25205340%27 HTTP/1.1" 200 None
2026-03-29 22:02:17 [bca.uk] INFO: Saving data for RNZ%205340: {'created_time': 1774821737.231048, 'last_price_update_time': 1774821737.231058, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RNZ%25205340') HTTP/1.1" 204 0
2026-03-29 22:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015599/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015599>
2026-03-29 22:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08JZG/42806569?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=2TNlaH2PyUx3Xfy6VowyugT5leG%2BJYec3CIT%2Br9zpPk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA08%20JZG-GB>
2026-03-29 22:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CV57TEJ/42805996?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=67Vzg1XLX0UcO7UFrfohvMyEDom9YGJFCvRWdFdKraA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CV57%20TEJ-GB>
2026-03-29 22:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249854/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BG63RZR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015567/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015567>
2026-03-29 22:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427747/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427747>
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249902%27 HTTP/1.1" 200 None
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249902 not downloaded yet
2026-03-29 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015725/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO67CJZ/42812295?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=f5P0DwslIG4nez3ramT%2BBglIeMphiUhV3LeShcWO2lA%3D)
2026-03-29 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427837/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08NWF/42812303?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=%2FmvSSUyiAYVN8KnXHHAVZPAhaX5NwULjoP6vZooLMQE%3D)
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249919%27 HTTP/1.1" 200 None
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249919 not downloaded yet
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69adbfd0>
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY64YYK%252F699143782%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143782/600 saved to cache
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7797c46-b28a-5526-a960-afcea68790a7
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6355b810>
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_expert_report_file_b7abc85e-2fd4-40eb-b7d0-92a7f876faff.pdf HTTP/1.1" 201 0
2026-03-29 22:02:17 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b7a6c487-5362-53a3-b310-808d63b8f49d
2026-03-29 22:02:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7a6c487-5362-53a3-b310-808d63b8f49d, skipping ID generation
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7a6c487-5362-53a3-b310-808d63b8f49d
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLS68HJJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LS68HJJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249938%27 HTTP/1.1" 200 None
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249938 not downloaded yet
2026-03-29 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249842/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG13WCO/42805858?sv=2020-08-04&st=2026-03-29T22%3A01%3A53Z&se=2026-03-29T22%3A26%3A53Z&sr=b&sp=r&sig=GVmWRmuKtNOue8G4g7Ss9cceJ%2BHC2MT4CedJjlRFDBw%3D)
2026-03-29 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437944/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NA04XFU/42812369?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=7XXhzPtvsDMZKwJi3NCUHNT0YaNfJtDfBNmw7ADL6OM%3D)
2026-03-29 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143776/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY64YYK/42812362?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=rVxpK9Nu9k7RcTYnPo9WbYSk5dZ2Ab93q0jZLZNLD3o%3D)
2026-03-29 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427814/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08NWF/42812303?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=%2FmvSSUyiAYVN8KnXHHAVZPAhaX5NwULjoP6vZooLMQE%3D)
2026-03-29 22:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249861/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249861>
2026-03-29 22:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249871/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249871>
2026-03-29 22:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143750/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FY64YYK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104977%27 HTTP/1.1" 200 None
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104977 not downloaded yet
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249955%27 HTTP/1.1" 200 None
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249955 not downloaded yet
2026-03-29 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF13AKO/42806090?sv=2020-08-04&st=2026-03-29T22%3A02%3A15Z&se=2026-03-29T22%3A27%3A15Z&sr=b&sp=r&sig=ESg3nxrsu2ZrjolRg7a9LM5RG04CyS%2FU1fJxP3w6KTM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104987%27 HTTP/1.1" 200 None
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104987 not downloaded yet
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699249979%27 HTTP/1.1" 200 None
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249979 not downloaded yet
2026-03-29 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63699890>
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO67CJZ%252F699015725%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015725/600 saved to cache
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4452e7a2-008a-5460-ac69-330bdd58f5d4
2026-03-29 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6360f010>
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08NWF%252F699427837%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427837/600 saved to cache
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55260bef-13ca-53e6-8438-967001fdad8a
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698104996%27 HTTP/1.1" 200 None
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104996 not downloaded yet
2026-03-29 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249854/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG63RZR/42795085?sv=2020-08-04&st=2026-03-29T22%3A02%3A12Z&se=2026-03-29T22%3A27%3A12Z&sr=b&sp=r&sig=z41fVlHE5GW0%2FHMd9juQKD7zO7vEwLy4SxIpPJt68iA%3D)
2026-03-29 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015567/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO67CJZ/42812295?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=f5P0DwslIG4nez3ramT%2BBglIeMphiUhV3LeShcWO2lA%3D)
2026-03-29 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427747/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08NWF/42812303?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=%2FmvSSUyiAYVN8KnXHHAVZPAhaX5NwULjoP6vZooLMQE%3D)
2026-03-29 22:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249893/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249893>
2026-03-29 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015599/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO67CJZ/42812295?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=f5P0DwslIG4nez3ramT%2BBglIeMphiUhV3LeShcWO2lA%3D)
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698105013%27 HTTP/1.1" 200 None
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698105013 not downloaded yet
2026-03-29 22:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08JZG/42806569?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=2TNlaH2PyUx3Xfy6VowyugT5leG%2BJYec3CIT%2Br9zpPk%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249881>
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698105025%27 HTTP/1.1" 200 None
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698105025 not downloaded yet
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a1c810>
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG13WCO%252F699249842%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249842/600 saved to cache
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d11b73b-ecf9-57a3-a557-9234293fe7af
2026-03-29 22:02:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d11b73b-ecf9-57a3-a557-9234293fe7af, skipping ID generation
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d11b73b-ecf9-57a3-a557-9234293fe7af sending to next pipeline
2026-03-29 22:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1d11b73b-ecf9-57a3-a557-9234293fe7af, identifier: BG13%20WCO
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63558b50>
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNA04XFU%252F699437944%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437944/600 saved to cache
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6199b36-64a9-5e19-9093-4273bab95743
2026-03-29 22:02:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6199b36-64a9-5e19-9093-4273bab95743, skipping ID generation
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6199b36-64a9-5e19-9093-4273bab95743 sending to next pipeline
2026-03-29 22:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e6199b36-64a9-5e19-9093-4273bab95743, identifier: NA04%20XFU
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6165aa90>
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY64YYK%252F699143776%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143776/600 saved to cache
2026-03-29 22:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7797c46-b28a-5526-a960-afcea68790a7
2026-03-29 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62107290>
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08NWF%252F699427814%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427814/600 saved to cache
2026-03-29 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55260bef-13ca-53e6-8438-967001fdad8a
2026-03-29 22:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61574bd0>
2026-03-29 22:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_expert_report_file_a5f0d13a-d8c5-43ea-a8d6-9e36fd6cb886.pdf HTTP/1.1" 201 0
2026-03-29 22:02:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3df409e5-2149-5e92-a209-97533ef34ba7
2026-03-29 22:02:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3df409e5-2149-5e92-a209-97533ef34ba7, skipping ID generation
2026-03-29 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3df409e5-2149-5e92-a209-97533ef34ba7
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDF13AKO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DF13AKO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CV57TEJ/42805996?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=67Vzg1XLX0UcO7UFrfohvMyEDom9YGJFCvRWdFdKraA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1d11b73b-ecf9-57a3-a557-9234293fe7af with identifier: BG13%20WCO
2026-03-29 22:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1d11b73b-ecf9-57a3-a557-9234293fe7af with identifier: BG13%20WCO
2026-03-29 22:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1d11b73b-ecf9-57a3-a557-9234293fe7af with identifier: BG13%20WCO to the API
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249842/600>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_expert_report_file_cb62933f-4c22-4540-8d18-61e218950062.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG13%20WCO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1d11b73b-ecf9-57a3-a557-9234293fe7af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG13 WCO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BG13%20WCO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 100824,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36848,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249842/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36932,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249848/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36548,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249855/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37475,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249864/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35148,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249874/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34124,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249887/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87533,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249906/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58441,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249922/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75118,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249944/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d11b73b-ecf9-57a3-a557-9234293fe7af/1d11b73b-ecf9-57a3-a557-9234293fe7af_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99972,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG13WCO/699249964/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 94 VISIA Hatchback',
'transmission': 'manual',
'trim': '94 VISIA',
'vin': 'SJNFBAF15U6394425',
'year': 2013}
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG13%2520WCO%27 HTTP/1.1" 200 None
2026-03-29 22:02:18 [bca.uk] INFO: Saving data for BG13%20WCO: {'created_time': 1774821738.461847, 'last_price_update_time': 1774821738.461856, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BG13%2520WCO') HTTP/1.1" 204 0
2026-03-29 22:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e6199b36-64a9-5e19-9093-4273bab95743 with identifier: NA04%20XFU
2026-03-29 22:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e6199b36-64a9-5e19-9093-4273bab95743 with identifier: NA04%20XFU
2026-03-29 22:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e6199b36-64a9-5e19-9093-4273bab95743 with identifier: NA04%20XFU to the API
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437944/600>
{'auction_title': '',
'c_o_2_emission_value': 161,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_expert_report_file_569dfc3c-9c1e-4b83-9b61-d937e9d5297a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NA04%20XFU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e6199b36-64a9-5e19-9093-4273bab95743',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NA04 XFU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NA04%20XFU&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'CITROEN',
'model': 'C3',
'odometer': 53099,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39883,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437909/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39375,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437920/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37637,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437933/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36856,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437944/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35752,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437964/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35956,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699437977/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87028,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699438001/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65521,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699438015/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79350,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699438032/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6199b36-64a9-5e19-9093-4273bab95743/e6199b36-64a9-5e19-9093-4273bab95743_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65096,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NA04XFU/699438043/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'CITROEN C3 1.4 SX Hatchback',
'transmission': 'automatic',
'trim': 'SX',
'vin': 'VF7FCKFVE26974045',
'year': 2004}
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA04%2520XFU%27 HTTP/1.1" 200 None
2026-03-29 22:02:18 [bca.uk] INFO: Saving data for NA04%20XFU: {'created_time': 1774821738.855906, 'last_price_update_time': 1774821738.855917, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NA04%2520XFU') HTTP/1.1" 204 0
2026-03-29 22:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249871/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG63RZR/42795085?sv=2020-08-04&st=2026-03-29T22%3A02%3A12Z&se=2026-03-29T22%3A27%3A12Z&sr=b&sp=r&sig=z41fVlHE5GW0%2FHMd9juQKD7zO7vEwLy4SxIpPJt68iA%3D)
2026-03-29 22:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143750/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY64YYK/42812362?sv=2020-08-04&st=2026-03-29T22%3A01%3A52Z&se=2026-03-29T22%3A26%3A52Z&sr=b&sp=r&sig=rVxpK9Nu9k7RcTYnPo9WbYSk5dZ2Ab93q0jZLZNLD3o%3D)
2026-03-29 22:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249861/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG63RZR/42795085?sv=2020-08-04&st=2026-03-29T22%3A02%3A12Z&se=2026-03-29T22%3A27%3A12Z&sr=b&sp=r&sig=z41fVlHE5GW0%2FHMd9juQKD7zO7vEwLy4SxIpPJt68iA%3D)
2026-03-29 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249938/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249938>
2026-03-29 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698104965/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LS68HJJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698105044%27 HTTP/1.1" 200 None
2026-03-29 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698105044 not downloaded yet
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250249%27 HTTP/1.1" 200 None
2026-03-29 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250249 not downloaded yet
2026-03-29 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249902/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249902>
2026-03-29 22:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249919/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249919>
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698105063%27 HTTP/1.1" 200 None
2026-03-29 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698105063 not downloaded yet
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250260%27 HTTP/1.1" 200 None
2026-03-29 22:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250260 not downloaded yet
2026-03-29 22:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617ee3d0>
2026-03-29 22:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG63RZR%252F699249854%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249854/600 saved to cache
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61574950>
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO67CJZ%252F699015567%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015567/600 saved to cache
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4452e7a2-008a-5460-ac69-330bdd58f5d4
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac684a7bd0>
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08NWF%252F699427747%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427747/600 saved to cache
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55260bef-13ca-53e6-8438-967001fdad8a
2026-03-29 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63558350>
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO67CJZ%252F699015599%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015599/600 saved to cache
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4452e7a2-008a-5460-ac69-330bdd58f5d4
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637d3210>
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_expert_report_file_ea7eb70f-6a29-498a-92ec-e640ec29916d.pdf HTTP/1.1" 201 0
2026-03-29 22:02:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 26208658-b758-57c3-a5d7-6c7f010cb5ea
2026-03-29 22:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26208658-b758-57c3-a5d7-6c7f010cb5ea, skipping ID generation
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26208658-b758-57c3-a5d7-6c7f010cb5ea
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDA08JZG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DA08JZG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6365ce90>
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_expert_report_file_583b7c9f-0d55-4084-b2ab-451ade212fd3.pdf HTTP/1.1" 201 0
2026-03-29 22:02:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f7b2db4c-1d87-55b8-87f5-02ef1f68478c
2026-03-29 22:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7b2db4c-1d87-55b8-87f5-02ef1f68478c, skipping ID generation
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7b2db4c-1d87-55b8-87f5-02ef1f68478c
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCV57TEJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CV57TEJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698105084%27 HTTP/1.1" 200 None
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698105084 not downloaded yet
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250267%27 HTTP/1.1" 200 None
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250267 not downloaded yet
2026-03-29 22:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249893/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG63RZR/42795085?sv=2020-08-04&st=2026-03-29T22%3A02%3A12Z&se=2026-03-29T22%3A27%3A12Z&sr=b&sp=r&sig=z41fVlHE5GW0%2FHMd9juQKD7zO7vEwLy4SxIpPJt68iA%3D)
2026-03-29 22:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249881/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG63RZR/42795085?sv=2020-08-04&st=2026-03-29T22%3A02%3A12Z&se=2026-03-29T22%3A27%3A12Z&sr=b&sp=r&sig=z41fVlHE5GW0%2FHMd9juQKD7zO7vEwLy4SxIpPJt68iA%3D)
2026-03-29 22:02:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249955/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249955>
2026-03-29 22:02:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698104996/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104996>
2026-03-29 22:02:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249979/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699249979>
2026-03-29 22:02:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698104977/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104977>
2026-03-29 22:02:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105013/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698105013>
2026-03-29 22:02:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698104987/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698104987>
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250131%27 HTTP/1.1" 200 None
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250131 not downloaded yet
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250085%27 HTTP/1.1" 200 None
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250085 not downloaded yet
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698105100%27 HTTP/1.1" 200 None
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698105100 not downloaded yet
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250274%27 HTTP/1.1" 200 None
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250274 not downloaded yet
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63698550>
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG63RZR%252F699249871%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249871/600 saved to cache
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620aac50>
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY64YYK%252F699143750%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143750/600 saved to cache
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7797c46-b28a-5526-a960-afcea68790a7
2026-03-29 22:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7797c46-b28a-5526-a960-afcea68790a7, skipping ID generation
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7797c46-b28a-5526-a960-afcea68790a7 sending to next pipeline
2026-03-29 22:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a7797c46-b28a-5526-a960-afcea68790a7, identifier: FY64%20YYK
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637d1050>
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG63RZR%252F699249861%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249861/600 saved to cache
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250139%27 HTTP/1.1" 200 None
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250139 not downloaded yet
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250092%27 HTTP/1.1" 200 None
2026-03-29 22:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250092 not downloaded yet
2026-03-29 22:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a7797c46-b28a-5526-a960-afcea68790a7 with identifier: FY64%20YYK
2026-03-29 22:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a7797c46-b28a-5526-a960-afcea68790a7 with identifier: FY64%20YYK
2026-03-29 22:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a7797c46-b28a-5526-a960-afcea68790a7 with identifier: FY64%20YYK to the API
2026-03-29 22:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143750/600>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_expert_report_file_b26cc1b8-84d4-4a31-8225-05555cb487fc.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY64%20YYK-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a7797c46-b28a-5526-a960-afcea68790a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY64 YYK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FY64%20YYK&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 151818,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49597,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143750/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46481,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143760/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45999,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143767/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48061,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143776/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45967,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143782/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42600,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143793/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94302,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143809/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65683,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143832/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75969,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143856/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7797c46-b28a-5526-a960-afcea68790a7/a7797c46-b28a-5526-a960-afcea68790a7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75674,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY64YYK/699143871/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'NISSAN X-TRAIL 1.6 DCI 130 N-TEC (7ST) XTRONIC StationWagon',
'transmission': 'automatic',
'trim': 'DCI 130 N-TEC (7ST) XTRONIC',
'vin': 'JN1JCAT32U0004690',
'year': 2014}
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY64%2520YYK%27 HTTP/1.1" 200 None
2026-03-29 22:02:20 [bca.uk] INFO: Saving data for FY64%20YYK: {'created_time': 1774821740.107421, 'last_price_update_time': 1774821740.107432, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FY64%2520YYK') HTTP/1.1" 204 0
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250287%27 HTTP/1.1" 200 None
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250287 not downloaded yet
2026-03-29 22:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698104965/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LS68HJJ/42810310?sv=2020-08-04&st=2026-03-29T22%3A02%3A13Z&se=2026-03-29T22%3A27%3A13Z&sr=b&sp=r&sig=Jq%2BrvM3TzBPhUwiGQQKCTNJs%2FBAWZ7OqMKoc7RuV%2Buw%3D)
2026-03-29 22:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249902/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG63RZR/42795085?sv=2020-08-04&st=2026-03-29T22%3A02%3A12Z&se=2026-03-29T22%3A27%3A12Z&sr=b&sp=r&sig=z41fVlHE5GW0%2FHMd9juQKD7zO7vEwLy4SxIpPJt68iA%3D)
2026-03-29 22:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105025/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698105025>
2026-03-29 22:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427733/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427733>
2026-03-29 22:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015556/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015556>
2026-03-29 22:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250241/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DF13AKO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250144%27 HTTP/1.1" 200 None
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250144 not downloaded yet
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250098%27 HTTP/1.1" 200 None
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250098 not downloaded yet
2026-03-29 22:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249919/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG63RZR/42795085?sv=2020-08-04&st=2026-03-29T22%3A02%3A12Z&se=2026-03-29T22%3A27%3A12Z&sr=b&sp=r&sig=z41fVlHE5GW0%2FHMd9juQKD7zO7vEwLy4SxIpPJt68iA%3D)
2026-03-29 22:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249938/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG63RZR/42795085?sv=2020-08-04&st=2026-03-29T22%3A02%3A12Z&se=2026-03-29T22%3A27%3A12Z&sr=b&sp=r&sig=z41fVlHE5GW0%2FHMd9juQKD7zO7vEwLy4SxIpPJt68iA%3D)
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250301%27 HTTP/1.1" 200 None
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250301 not downloaded yet
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250153%27 HTTP/1.1" 200 None
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250153 not downloaded yet
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250105%27 HTTP/1.1" 200 None
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250105 not downloaded yet
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63698a50>
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG63RZR%252F699249893%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249893/600 saved to cache
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6179d910>
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG63RZR%252F699249881%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249881/600 saved to cache
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250318%27 HTTP/1.1" 200 None
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250318 not downloaded yet
2026-03-29 22:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698104987/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LS68HJJ/42810310?sv=2020-08-04&st=2026-03-29T22%3A02%3A13Z&se=2026-03-29T22%3A27%3A13Z&sr=b&sp=r&sig=Jq%2BrvM3TzBPhUwiGQQKCTNJs%2FBAWZ7OqMKoc7RuV%2Buw%3D)
2026-03-29 22:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105013/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LS68HJJ/42810310?sv=2020-08-04&st=2026-03-29T22%3A02%3A13Z&se=2026-03-29T22%3A27%3A13Z&sr=b&sp=r&sig=Jq%2BrvM3TzBPhUwiGQQKCTNJs%2FBAWZ7OqMKoc7RuV%2Buw%3D)
2026-03-29 22:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698104996/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LS68HJJ/42810310?sv=2020-08-04&st=2026-03-29T22%3A02%3A13Z&se=2026-03-29T22%3A27%3A13Z&sr=b&sp=r&sig=Jq%2BrvM3TzBPhUwiGQQKCTNJs%2FBAWZ7OqMKoc7RuV%2Buw%3D)
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250158%27 HTTP/1.1" 200 None
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250158 not downloaded yet
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250110%27 HTTP/1.1" 200 None
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250110 not downloaded yet
2026-03-29 22:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698104977/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LS68HJJ/42810310?sv=2020-08-04&st=2026-03-29T22%3A02%3A13Z&se=2026-03-29T22%3A27%3A13Z&sr=b&sp=r&sig=Jq%2BrvM3TzBPhUwiGQQKCTNJs%2FBAWZ7OqMKoc7RuV%2Buw%3D)
2026-03-29 22:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249955/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG63RZR/42795085?sv=2020-08-04&st=2026-03-29T22%3A02%3A12Z&se=2026-03-29T22%3A27%3A12Z&sr=b&sp=r&sig=z41fVlHE5GW0%2FHMd9juQKD7zO7vEwLy4SxIpPJt68iA%3D)
2026-03-29 22:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249979/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BG63RZR/42795085?sv=2020-08-04&st=2026-03-29T22%3A02%3A12Z&se=2026-03-29T22%3A27%3A12Z&sr=b&sp=r&sig=z41fVlHE5GW0%2FHMd9juQKD7zO7vEwLy4SxIpPJt68iA%3D)
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250333%27 HTTP/1.1" 200 None
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250333 not downloaded yet
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61681e50>
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLS68HJJ%252F698104965%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698104965/600 saved to cache
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7a6c487-5362-53a3-b310-808d63b8f49d
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616bae90>
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG63RZR%252F699249902%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249902/600 saved to cache
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63699bd0>
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG63RZR%252F699249919%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249919/600 saved to cache
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637d3150>
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG63RZR%252F699249938%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249938/600 saved to cache
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c
2026-03-29 22:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105084/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698105084>
2026-03-29 22:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250267/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250267>
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250173%27 HTTP/1.1" 200 None
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250173 not downloaded yet
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250124%27 HTTP/1.1" 200 None
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250124 not downloaded yet
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250355%27 HTTP/1.1" 200 None
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250355 not downloaded yet
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250188%27 HTTP/1.1" 200 None
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250188 not downloaded yet
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250137%27 HTTP/1.1" 200 None
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250137 not downloaded yet
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6172fe50>
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLS68HJJ%252F698104987%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698104987/600 saved to cache
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7a6c487-5362-53a3-b310-808d63b8f49d
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61010b90>
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLS68HJJ%252F698105013%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105013/600 saved to cache
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7a6c487-5362-53a3-b310-808d63b8f49d
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac7743b350>
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLS68HJJ%252F698104996%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698104996/600 saved to cache
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7a6c487-5362-53a3-b310-808d63b8f49d
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611bbad0>
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLS68HJJ%252F698104977%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698104977/600 saved to cache
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7a6c487-5362-53a3-b310-808d63b8f49d
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637a42d0>
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG63RZR%252F699249955%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249955/600 saved to cache
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611b9ed0>
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBG63RZR%252F699249979%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249979/600 saved to cache
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c
2026-03-29 22:02:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c, skipping ID generation
2026-03-29 22:02:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c sending to next pipeline
2026-03-29 22:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c, identifier: BG63%20RZR
2026-03-29 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250241/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF13AKO/42806090?sv=2020-08-04&st=2026-03-29T22%3A02%3A15Z&se=2026-03-29T22%3A27%3A15Z&sr=b&sp=r&sig=ESg3nxrsu2ZrjolRg7a9LM5RG04CyS%2FU1fJxP3w6KTM%3D)
2026-03-29 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015556/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO67CJZ/42812295?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=f5P0DwslIG4nez3ramT%2BBglIeMphiUhV3LeShcWO2lA%3D)
2026-03-29 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427733/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08NWF/42812303?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=%2FmvSSUyiAYVN8KnXHHAVZPAhaX5NwULjoP6vZooLMQE%3D)
2026-03-29 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105025/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LS68HJJ/42810310?sv=2020-08-04&st=2026-03-29T22%3A02%3A13Z&se=2026-03-29T22%3A27%3A13Z&sr=b&sp=r&sig=Jq%2BrvM3TzBPhUwiGQQKCTNJs%2FBAWZ7OqMKoc7RuV%2Buw%3D)
2026-03-29 22:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c with identifier: BG63%20RZR
2026-03-29 22:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c with identifier: BG63%20RZR
2026-03-29 22:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c with identifier: BG63%20RZR to the API
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249979/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_expert_report_file_574b293f-f1f4-4b84-a0c9-cbd9ad227359.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG63%20RZR-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG63 RZR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BG63%20RZR&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'TOYOTA',
'model': 'AYGO',
'odometer': 54143,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38163,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249854/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38566,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249861/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38242,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249871/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39408,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249881/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36531,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249893/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36217,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249902/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70610,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249919/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65474,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249938/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67465,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249955/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c/e0a0ec56-0cad-5c46-9d3c-e9eadd5b778c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80178,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BG63RZR/699249979/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'TOYOTA AYGO 1.0 VVT-I ACTIVE PLUS Hatchback',
'transmission': 'manual',
'trim': 'VVT-I ACTIVE PLUS',
'vin': 'JTDKG10C70N738188',
'year': 2013}
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG63%2520RZR%27 HTTP/1.1" 200 None
2026-03-29 22:02:21 [bca.uk] INFO: Saving data for BG63%20RZR: {'created_time': 1774821741.415184, 'last_price_update_time': 1774821741.415195, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BG63%2520RZR') HTTP/1.1" 204 0
2026-03-29 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250092/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250092>
2026-03-29 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250139/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250139>
2026-03-29 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250098/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250098>
2026-03-29 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250144/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250144>
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250207%27 HTTP/1.1" 200 None
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250207 not downloaded yet
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250155%27 HTTP/1.1" 200 None
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250155 not downloaded yet
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250225%27 HTTP/1.1" 200 None
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250225 not downloaded yet
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250168%27 HTTP/1.1" 200 None
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250168 not downloaded yet
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636bfc50>
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF13AKO%252F699250241%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250241/600 saved to cache
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3df409e5-2149-5e92-a209-97533ef34ba7
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6365e750>
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO67CJZ%252F699015556%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015556/600 saved to cache
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4452e7a2-008a-5460-ac69-330bdd58f5d4
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63576990>
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08NWF%252F699427733%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427733/600 saved to cache
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55260bef-13ca-53e6-8438-967001fdad8a
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61641590>
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLS68HJJ%252F698105025%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105025/600 saved to cache
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7a6c487-5362-53a3-b310-808d63b8f49d
2026-03-29 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250301/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250301>
2026-03-29 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250105/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250105>
2026-03-29 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250153/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250153>
2026-03-29 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250318/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250318>
2026-03-29 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250267/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF13AKO/42806090?sv=2020-08-04&st=2026-03-29T22%3A02%3A15Z&se=2026-03-29T22%3A27%3A15Z&sr=b&sp=r&sig=ESg3nxrsu2ZrjolRg7a9LM5RG04CyS%2FU1fJxP3w6KTM%3D)
2026-03-29 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250287/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250287>
2026-03-29 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250274/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250274>
2026-03-29 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105084/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LS68HJJ/42810310?sv=2020-08-04&st=2026-03-29T22%3A02%3A13Z&se=2026-03-29T22%3A27%3A13Z&sr=b&sp=r&sig=Jq%2BrvM3TzBPhUwiGQQKCTNJs%2FBAWZ7OqMKoc7RuV%2Buw%3D)
2026-03-29 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250173/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250173>
2026-03-29 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250139/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08JZG/42806569?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=2TNlaH2PyUx3Xfy6VowyugT5leG%2BJYec3CIT%2Br9zpPk%3D)
2026-03-29 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250098/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CV57TEJ/42805996?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=67Vzg1XLX0UcO7UFrfohvMyEDom9YGJFCvRWdFdKraA%3D)
2026-03-29 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250355/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250355>
2026-03-29 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250124/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250124>
2026-03-29 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250144/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08JZG/42806569?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=2TNlaH2PyUx3Xfy6VowyugT5leG%2BJYec3CIT%2Br9zpPk%3D)
2026-03-29 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250092/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CV57TEJ/42805996?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=67Vzg1XLX0UcO7UFrfohvMyEDom9YGJFCvRWdFdKraA%3D)
2026-03-29 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250333/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250333>
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636f7e90>
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF13AKO%252F699250267%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250267/600 saved to cache
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3df409e5-2149-5e92-a209-97533ef34ba7
2026-03-29 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250274/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF13AKO/42806090?sv=2020-08-04&st=2026-03-29T22%3A02%3A15Z&se=2026-03-29T22%3A27%3A15Z&sr=b&sp=r&sig=ESg3nxrsu2ZrjolRg7a9LM5RG04CyS%2FU1fJxP3w6KTM%3D)
2026-03-29 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250318/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF13AKO/42806090?sv=2020-08-04&st=2026-03-29T22%3A02%3A15Z&se=2026-03-29T22%3A27%3A15Z&sr=b&sp=r&sig=ESg3nxrsu2ZrjolRg7a9LM5RG04CyS%2FU1fJxP3w6KTM%3D)
2026-03-29 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250287/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF13AKO/42806090?sv=2020-08-04&st=2026-03-29T22%3A02%3A15Z&se=2026-03-29T22%3A27%3A15Z&sr=b&sp=r&sig=ESg3nxrsu2ZrjolRg7a9LM5RG04CyS%2FU1fJxP3w6KTM%3D)
2026-03-29 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250105/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CV57TEJ/42805996?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=67Vzg1XLX0UcO7UFrfohvMyEDom9YGJFCvRWdFdKraA%3D)
2026-03-29 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250153/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08JZG/42806569?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=2TNlaH2PyUx3Xfy6VowyugT5leG%2BJYec3CIT%2Br9zpPk%3D)
2026-03-29 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250168/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250168>
2026-03-29 22:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250225/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250225>
2026-03-29 22:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250301/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF13AKO/42806090?sv=2020-08-04&st=2026-03-29T22%3A02%3A15Z&se=2026-03-29T22%3A27%3A15Z&sr=b&sp=r&sig=ESg3nxrsu2ZrjolRg7a9LM5RG04CyS%2FU1fJxP3w6KTM%3D)
2026-03-29 22:02:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61afcfd0>
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLS68HJJ%252F698105084%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105084/600 saved to cache
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7a6c487-5362-53a3-b310-808d63b8f49d
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63574e90>
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08JZG%252F699250139%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250139/600 saved to cache
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26208658-b758-57c3-a5d7-6c7f010cb5ea
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac60fef0d0>
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCV57TEJ%252F699250098%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250098/600 saved to cache
2026-03-29 22:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f7b2db4c-1d87-55b8-87f5-02ef1f68478c
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636be950>
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08JZG%252F699250144%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250144/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26208658-b758-57c3-a5d7-6c7f010cb5ea
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac60fed050>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCV57TEJ%252F699250092%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250092/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f7b2db4c-1d87-55b8-87f5-02ef1f68478c
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250155/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250155>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250137/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250137>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250207/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250207>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250188/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250188>
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250173/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08JZG/42806569?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=2TNlaH2PyUx3Xfy6VowyugT5leG%2BJYec3CIT%2Br9zpPk%3D)
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250355/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF13AKO/42806090?sv=2020-08-04&st=2026-03-29T22%3A02%3A15Z&se=2026-03-29T22%3A27%3A15Z&sr=b&sp=r&sig=ESg3nxrsu2ZrjolRg7a9LM5RG04CyS%2FU1fJxP3w6KTM%3D)
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250124/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CV57TEJ/42805996?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=67Vzg1XLX0UcO7UFrfohvMyEDom9YGJFCvRWdFdKraA%3D)
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250333/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF13AKO/42806090?sv=2020-08-04&st=2026-03-29T22%3A02%3A15Z&se=2026-03-29T22%3A27%3A15Z&sr=b&sp=r&sig=ESg3nxrsu2ZrjolRg7a9LM5RG04CyS%2FU1fJxP3w6KTM%3D)
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618ce910>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF13AKO%252F699250274%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250274/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3df409e5-2149-5e92-a209-97533ef34ba7
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61714f10>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF13AKO%252F699250318%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250318/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3df409e5-2149-5e92-a209-97533ef34ba7
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618f4790>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF13AKO%252F699250287%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250287/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3df409e5-2149-5e92-a209-97533ef34ba7
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6117fd10>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCV57TEJ%252F699250105%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250105/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f7b2db4c-1d87-55b8-87f5-02ef1f68478c
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618f5e90>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08JZG%252F699250153%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250153/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26208658-b758-57c3-a5d7-6c7f010cb5ea
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618334d0>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF13AKO%252F699250301%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250301/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3df409e5-2149-5e92-a209-97533ef34ba7
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250110/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250110>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105100/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698105100>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250158/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250158>
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250168/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CV57TEJ/42805996?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=67Vzg1XLX0UcO7UFrfohvMyEDom9YGJFCvRWdFdKraA%3D)
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6a861410>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08JZG%252F699250173%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250173/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26208658-b758-57c3-a5d7-6c7f010cb5ea
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6184c3d0>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF13AKO%252F699250355%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250355/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3df409e5-2149-5e92-a209-97533ef34ba7
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62106f90>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCV57TEJ%252F699250124%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250124/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f7b2db4c-1d87-55b8-87f5-02ef1f68478c
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6184ea50>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF13AKO%252F699250333%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250333/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3df409e5-2149-5e92-a209-97533ef34ba7
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250131/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250131>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250085/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250085>
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250188/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08JZG/42806569?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=2TNlaH2PyUx3Xfy6VowyugT5leG%2BJYec3CIT%2Br9zpPk%3D)
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250076/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CV57TEJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250225/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08JZG/42806569?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=2TNlaH2PyUx3Xfy6VowyugT5leG%2BJYec3CIT%2Br9zpPk%3D)
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250137/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CV57TEJ/42805996?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=67Vzg1XLX0UcO7UFrfohvMyEDom9YGJFCvRWdFdKraA%3D)
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250207/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08JZG/42806569?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=2TNlaH2PyUx3Xfy6VowyugT5leG%2BJYec3CIT%2Br9zpPk%3D)
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637eae50>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCV57TEJ%252F699250168%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250168/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f7b2db4c-1d87-55b8-87f5-02ef1f68478c
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250249/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250249>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105063/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698105063>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250260/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250260>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250122/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DA08JZG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250155/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CV57TEJ/42805996?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=67Vzg1XLX0UcO7UFrfohvMyEDom9YGJFCvRWdFdKraA%3D)
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637eb990>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08JZG%252F699250188%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250188/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26208658-b758-57c3-a5d7-6c7f010cb5ea
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250158/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08JZG/42806569?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=2TNlaH2PyUx3Xfy6VowyugT5leG%2BJYec3CIT%2Br9zpPk%3D)
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250110/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CV57TEJ/42805996?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=67Vzg1XLX0UcO7UFrfohvMyEDom9YGJFCvRWdFdKraA%3D)
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250085/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CV57TEJ/42805996?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=67Vzg1XLX0UcO7UFrfohvMyEDom9YGJFCvRWdFdKraA%3D)
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250076/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CV57TEJ/42805996?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=67Vzg1XLX0UcO7UFrfohvMyEDom9YGJFCvRWdFdKraA%3D)
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250131/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08JZG/42806569?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=2TNlaH2PyUx3Xfy6VowyugT5leG%2BJYec3CIT%2Br9zpPk%3D)
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105100/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LS68HJJ/42810310?sv=2020-08-04&st=2026-03-29T22%3A02%3A13Z&se=2026-03-29T22%3A27%3A13Z&sr=b&sp=r&sig=Jq%2BrvM3TzBPhUwiGQQKCTNJs%2FBAWZ7OqMKoc7RuV%2Buw%3D)
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61746350>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08JZG%252F699250225%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250225/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 26208658-b758-57c3-a5d7-6c7f010cb5ea
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6115d590>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCV57TEJ%252F699250137%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250137/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f7b2db4c-1d87-55b8-87f5-02ef1f68478c
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61714c50>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08JZG%252F699250207%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250207/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 26208658-b758-57c3-a5d7-6c7f010cb5ea
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105044/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698105044>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO68PXJ/42810644?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=AjrHe%2FZzg02A19bIAPXt9iYd3%2FKnTUKNfDQ2oVTOXpo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO68%20PXJ-GB>
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250260/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF13AKO/42806090?sv=2020-08-04&st=2026-03-29T22%3A02%3A15Z&se=2026-03-29T22%3A27%3A15Z&sr=b&sp=r&sig=ESg3nxrsu2ZrjolRg7a9LM5RG04CyS%2FU1fJxP3w6KTM%3D)
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427710/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427710>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015534/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015534>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427718/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427718>
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105063/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LS68HJJ/42810310?sv=2020-08-04&st=2026-03-29T22%3A02%3A13Z&se=2026-03-29T22%3A27%3A13Z&sr=b&sp=r&sig=Jq%2BrvM3TzBPhUwiGQQKCTNJs%2FBAWZ7OqMKoc7RuV%2Buw%3D)
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250249/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DF13AKO/42806090?sv=2020-08-04&st=2026-03-29T22%3A02%3A15Z&se=2026-03-29T22%3A27%3A15Z&sr=b&sp=r&sig=ESg3nxrsu2ZrjolRg7a9LM5RG04CyS%2FU1fJxP3w6KTM%3D)
2026-03-29 22:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250122/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08JZG/42806569?sv=2020-08-04&st=2026-03-29T22%3A02%3A16Z&se=2026-03-29T22%3A27%3A16Z&sr=b&sp=r&sig=2TNlaH2PyUx3Xfy6VowyugT5leG%2BJYec3CIT%2Br9zpPk%3D)
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015519/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015519>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400498/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400498>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392030/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392030>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT65OEM/42801591?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=C86xu7kOSIOpI5tq1qwr9sVc1ocdKllXBj4HnJhS92A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YT65%20OEM-GB>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV10WYJ/42812387?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=rKDmdlJ%2FaZkUq5BixfEsoLqiph02L2tEANiTYwZbhJk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV10%20WYJ-GB>
2026-03-29 22:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10GHA/42812411?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=2se60G1wBkZioFdObKgvGGniCfo4KXU1Bg2UVTzdQU8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK10%20GHA-GB>
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616858d0>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCV57TEJ%252F699250155%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250155/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f7b2db4c-1d87-55b8-87f5-02ef1f68478c
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619738d0>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08JZG%252F699250158%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250158/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26208658-b758-57c3-a5d7-6c7f010cb5ea
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a53a10>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCV57TEJ%252F699250110%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250110/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f7b2db4c-1d87-55b8-87f5-02ef1f68478c
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61972f90>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCV57TEJ%252F699250085%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250085/600 saved to cache
2026-03-29 22:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f7b2db4c-1d87-55b8-87f5-02ef1f68478c
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61972bd0>
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCV57TEJ%252F699250076%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250076/600 saved to cache
2026-03-29 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7b2db4c-1d87-55b8-87f5-02ef1f68478c
2026-03-29 22:02:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7b2db4c-1d87-55b8-87f5-02ef1f68478c, skipping ID generation
2026-03-29 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7b2db4c-1d87-55b8-87f5-02ef1f68478c sending to next pipeline
2026-03-29 22:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f7b2db4c-1d87-55b8-87f5-02ef1f68478c, identifier: CV57%20TEJ
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619361d0>
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08JZG%252F699250131%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250131/600 saved to cache
2026-03-29 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26208658-b758-57c3-a5d7-6c7f010cb5ea
2026-03-29 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6209c650>
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLS68HJJ%252F698105100%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105100/600 saved to cache
2026-03-29 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7a6c487-5362-53a3-b310-808d63b8f49d
2026-03-29 22:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f7b2db4c-1d87-55b8-87f5-02ef1f68478c with identifier: CV57%20TEJ
2026-03-29 22:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f7b2db4c-1d87-55b8-87f5-02ef1f68478c with identifier: CV57%20TEJ
2026-03-29 22:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f7b2db4c-1d87-55b8-87f5-02ef1f68478c with identifier: CV57%20TEJ to the API
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250076/600>
{'auction_title': '',
'c_o_2_emission_value': 291,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_expert_report_file_583b7c9f-0d55-4084-b2ab-451ade212fd3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CV57%20TEJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '5.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f7b2db4c-1d87-55b8-87f5-02ef1f68478c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CV57 TEJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CV57%20TEJ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MERCEDES-BENZ',
'model': 'SL500',
'odometer': 104205,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39818,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250076/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38329,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250085/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38422,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250092/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39301,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250098/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34792,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250105/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32067,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250110/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99748,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250124/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88096,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250137/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101133,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250155/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b2db4c-1d87-55b8-87f5-02ef1f68478c/f7b2db4c-1d87-55b8-87f5-02ef1f68478c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83194,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CV57TEJ/699250168/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ SL500 5.5 (388-7) Convertible',
'transmission': 'manual',
'trim': '(388-7)',
'vin': 'WDB2304712F136627',
'year': 2007}
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV57%2520TEJ%27 HTTP/1.1" 200 None
2026-03-29 22:02:23 [bca.uk] INFO: Saving data for CV57%20TEJ: {'created_time': 1774821743.739197, 'last_price_update_time': 1774821743.739211, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CV57%2520TEJ') HTTP/1.1" 204 0
2026-03-29 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427718/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08NWF/42812303?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=%2FmvSSUyiAYVN8KnXHHAVZPAhaX5NwULjoP6vZooLMQE%3D)
2026-03-29 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427710/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA08NWF/42812303?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=%2FmvSSUyiAYVN8KnXHHAVZPAhaX5NwULjoP6vZooLMQE%3D)
2026-03-29 22:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015534/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO67CJZ/42812295?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=f5P0DwslIG4nez3ramT%2BBglIeMphiUhV3LeShcWO2lA%3D)
2026-03-29 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400484/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400484>
2026-03-29 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ65LKG/42812434?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=lkM6um%2B1esbhyvKPoMr1jepS1nwt47zijrcJLhXCRmQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ65%20LKG-GB>
2026-03-29 22:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB06FEG/42812331?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=WNOGcgO%2BJ9WOUiCo3Sdczttz%2B4KwooVxdySbYY3XIt4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LB06%20FEG-GB>
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6375ad50>
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF13AKO%252F699250260%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250260/600 saved to cache
2026-03-29 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3df409e5-2149-5e92-a209-97533ef34ba7
2026-03-29 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618c4e90>
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLS68HJJ%252F698105063%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105063/600 saved to cache
2026-03-29 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7a6c487-5362-53a3-b310-808d63b8f49d
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61007390>
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDF13AKO%252F699250249%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250249/600 saved to cache
2026-03-29 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3df409e5-2149-5e92-a209-97533ef34ba7
2026-03-29 22:02:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3df409e5-2149-5e92-a209-97533ef34ba7, skipping ID generation
2026-03-29 22:02:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3df409e5-2149-5e92-a209-97533ef34ba7 sending to next pipeline
2026-03-29 22:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3df409e5-2149-5e92-a209-97533ef34ba7, identifier: DF13%20AKO
2026-03-29 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61006410>
2026-03-29 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08JZG%252F699250122%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250122/600 saved to cache
2026-03-29 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26208658-b758-57c3-a5d7-6c7f010cb5ea
2026-03-29 22:02:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26208658-b758-57c3-a5d7-6c7f010cb5ea, skipping ID generation
2026-03-29 22:02:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26208658-b758-57c3-a5d7-6c7f010cb5ea sending to next pipeline
2026-03-29 22:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 26208658-b758-57c3-a5d7-6c7f010cb5ea, identifier: DA08%20JZG
2026-03-29 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105044/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LS68HJJ/42810310?sv=2020-08-04&st=2026-03-29T22%3A02%3A13Z&se=2026-03-29T22%3A27%3A13Z&sr=b&sp=r&sig=Jq%2BrvM3TzBPhUwiGQQKCTNJs%2FBAWZ7OqMKoc7RuV%2Buw%3D)
2026-03-29 22:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3df409e5-2149-5e92-a209-97533ef34ba7 with identifier: DF13%20AKO
2026-03-29 22:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3df409e5-2149-5e92-a209-97533ef34ba7 with identifier: DF13%20AKO
2026-03-29 22:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3df409e5-2149-5e92-a209-97533ef34ba7 with identifier: DF13%20AKO to the API
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250249/600>
{'auction_title': '',
'c_o_2_emission_value': 263,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_expert_report_file_a5f0d13a-d8c5-43ea-a8d6-9e36fd6cb886.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DF13%20AKO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '4.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3df409e5-2149-5e92-a209-97533ef34ba7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DF13 AKO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DF13%20AKO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'BMW',
'model': 'M3',
'odometer': 88435,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36433,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250241/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36330,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250249/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35096,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250260/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35370,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250267/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33601,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250274/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31805,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250287/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71463,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250301/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55121,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250318/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88363,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250333/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df409e5-2149-5e92-a209-97533ef34ba7/3df409e5-2149-5e92-a209-97533ef34ba7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89164,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DF13AKO/699250355/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'BMW M3 4.0 V8 LTD.EDITION 500 DCT Coupe',
'transmission': 'automatic',
'trim': 'V8 LTD.EDITION 500 DCT',
'vin': 'WBSKG92000J530445',
'year': 2013}
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF13%2520AKO%27 HTTP/1.1" 200 None
2026-03-29 22:02:24 [bca.uk] INFO: Saving data for DF13%20AKO: {'created_time': 1774821744.526336, 'last_price_update_time': 1774821744.526347, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DF13%2520AKO') HTTP/1.1" 204 0
2026-03-29 22:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 26208658-b758-57c3-a5d7-6c7f010cb5ea with identifier: DA08%20JZG
2026-03-29 22:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 26208658-b758-57c3-a5d7-6c7f010cb5ea with identifier: DA08%20JZG
2026-03-29 22:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 26208658-b758-57c3-a5d7-6c7f010cb5ea with identifier: DA08%20JZG to the API
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250122/600>
{'auction_title': '',
'c_o_2_emission_value': 256,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_expert_report_file_ea7eb70f-6a29-498a-92ec-e640ec29916d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA08%20JZG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '4.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '26208658-b758-57c3-a5d7-6c7f010cb5ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DA08 JZG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DA08%20JZG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'AUDI',
'model': 'S5',
'odometer': 94782,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37262,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250122/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37088,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250131/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36263,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250139/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37872,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250144/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30925,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250153/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29738,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250158/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95241,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250173/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56799,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250188/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97145,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250207/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26208658-b758-57c3-a5d7-6c7f010cb5ea/26208658-b758-57c3-a5d7-6c7f010cb5ea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80621,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08JZG/699250225/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'AUDI S5 4.2 QUATTRO T/TRONIC Coupe',
'transmission': 'manual',
'trim': 'QUATTRO T/TRONIC',
'vin': 'WAUZZZ8T88A044699',
'year': 2008}
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA08%2520JZG%27 HTTP/1.1" 200 None
2026-03-29 22:02:24 [bca.uk] INFO: Saving data for DA08%20JZG: {'created_time': 1774821744.942115, 'last_price_update_time': 1774821744.942127, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DA08%2520JZG') HTTP/1.1" 204 0
2026-03-29 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO68PXJ/42810644?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=AjrHe%2FZzg02A19bIAPXt9iYd3%2FKnTUKNfDQ2oVTOXpo%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015519/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO67CJZ/42812295?sv=2020-08-04&st=2026-03-29T22%3A01%3A50Z&se=2026-03-29T22%3A26%3A50Z&sr=b&sp=r&sig=f5P0DwslIG4nez3ramT%2BBglIeMphiUhV3LeShcWO2lA%3D)
2026-03-29 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400498/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64BWF/42812128?sv=2020-08-04&st=2026-03-29T22%3A01%3A41Z&se=2026-03-29T22%3A26%3A41Z&sr=b&sp=r&sig=MzwyyqM%2Fq9XpCMHPmp7VRaX08ubizr8jYVfx3e066Lo%3D)
2026-03-29 22:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392030/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT64GVX/42811943?sv=2020-08-04&st=2026-03-29T22%3A01%3A40Z&se=2026-03-29T22%3A26%3A40Z&sr=b&sp=r&sig=cep50iJLm5T2T%2FJIF3KYJUQN262Xx397yLSJF4VsirI%3D)
2026-03-29 22:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632f2c50>
2026-03-29 22:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08NWF%252F699427718%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427718/600 saved to cache
2026-03-29 22:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55260bef-13ca-53e6-8438-967001fdad8a
2026-03-29 22:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61095210>
2026-03-29 22:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA08NWF%252F699427710%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427710/600 saved to cache
2026-03-29 22:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55260bef-13ca-53e6-8438-967001fdad8a
2026-03-29 22:02:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55260bef-13ca-53e6-8438-967001fdad8a, skipping ID generation
2026-03-29 22:02:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55260bef-13ca-53e6-8438-967001fdad8a sending to next pipeline
2026-03-29 22:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 55260bef-13ca-53e6-8438-967001fdad8a, identifier: DA08%20NWF
2026-03-29 22:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61168210>
2026-03-29 22:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO67CJZ%252F699015534%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015534/600 saved to cache
2026-03-29 22:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4452e7a2-008a-5460-ac69-330bdd58f5d4
2026-03-29 22:02:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617e4290>
2026-03-29 22:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLS68HJJ%252F698105044%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105044/600 saved to cache
2026-03-29 22:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7a6c487-5362-53a3-b310-808d63b8f49d
2026-03-29 22:02:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7a6c487-5362-53a3-b310-808d63b8f49d, skipping ID generation
2026-03-29 22:02:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7a6c487-5362-53a3-b310-808d63b8f49d sending to next pipeline
2026-03-29 22:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b7a6c487-5362-53a3-b310-808d63b8f49d, identifier: LS68%20HJJ
2026-03-29 22:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10GHA/42812411?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=2se60G1wBkZioFdObKgvGGniCfo4KXU1Bg2UVTzdQU8%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT65OEM/42801591?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=C86xu7kOSIOpI5tq1qwr9sVc1ocdKllXBj4HnJhS92A%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 55260bef-13ca-53e6-8438-967001fdad8a with identifier: DA08%20NWF
2026-03-29 22:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 55260bef-13ca-53e6-8438-967001fdad8a with identifier: DA08%20NWF
2026-03-29 22:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 55260bef-13ca-53e6-8438-967001fdad8a with identifier: DA08%20NWF to the API
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427710/600>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_expert_report_file_7f9656c0-a621-4b76-930f-633a4b119c43.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA08%20NWF-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '55260bef-13ca-53e6-8438-967001fdad8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DA08 NWF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DA08%20NWF&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 97575,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39790,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427699/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37205,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427710/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36892,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427718/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33944,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427733/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33580,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427747/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73355,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427763/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53307,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427814/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76289,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427837/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55260bef-13ca-53e6-8438-967001fdad8a/55260bef-13ca-53e6-8438-967001fdad8a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63571,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA08NWF/699427850/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 CLUB 16V Hatchback',
'transmission': 'automatic',
'trim': 'CLUB 16V',
'vin': 'W0L0SDL0886151623',
'year': 2008}
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA08%2520NWF%27 HTTP/1.1" 200 None
2026-03-29 22:02:25 [bca.uk] INFO: Saving data for DA08%20NWF: {'created_time': 1774821745.675853, 'last_price_update_time': 1774821745.675864, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DA08%2520NWF') HTTP/1.1" 204 0
2026-03-29 22:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b7a6c487-5362-53a3-b310-808d63b8f49d with identifier: LS68%20HJJ
2026-03-29 22:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b7a6c487-5362-53a3-b310-808d63b8f49d with identifier: LS68%20HJJ
2026-03-29 22:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b7a6c487-5362-53a3-b310-808d63b8f49d with identifier: LS68%20HJJ to the API
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105044/600>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_expert_report_file_b7abc85e-2fd4-40eb-b7d0-92a7f876faff.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LS68%20HJJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b7a6c487-5362-53a3-b310-808d63b8f49d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LS68 HJJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LS68%20HJJ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'C200 EQ-B',
'odometer': 48158,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49978,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698104965/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48607,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698104977/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48399,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698104987/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45441,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698104996/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44326,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105013/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44921,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105025/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97975,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105044/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64359,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105063/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84177,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105084/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a6c487-5362-53a3-b310-808d63b8f49d/b7a6c487-5362-53a3-b310-808d63b8f49d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81818,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LS68HJJ/698105100/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C200 EQ-B 1.5 AMG LINE 9G Estate',
'transmission': 'manual',
'trim': 'AMG LINE 9G',
'vin': 'WDD2052772F805344',
'year': 2018}
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS68%2520HJJ%27 HTTP/1.1" 200 None
2026-03-29 22:02:26 [bca.uk] INFO: Saving data for LS68%20HJJ: {'created_time': 1774821746.072037, 'last_price_update_time': 1774821746.072048, 'auction_closing_time': 1775124000.0}
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LS68%2520HJJ') HTTP/1.1" 204 0
2026-03-29 22:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699432935/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432935>
2026-03-29 22:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392022/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392022>
2026-03-29 22:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400484/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64BWF/42812128?sv=2020-08-04&st=2026-03-29T22%3A01%3A41Z&se=2026-03-29T22%3A26%3A41Z&sr=b&sp=r&sig=MzwyyqM%2Fq9XpCMHPmp7VRaX08ubizr8jYVfx3e066Lo%3D)
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6224c890>
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_expert_report_file_8c0011af-a016-423f-a4f7-0b40473bb7a2.pdf HTTP/1.1" 201 0
2026-03-29 22:02:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 50c3f397-3666-5802-9240-95b43afdce21
2026-03-29 22:02:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50c3f397-3666-5802-9240-95b43afdce21, skipping ID generation
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 50c3f397-3666-5802-9240-95b43afdce21
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAO68PXJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AO68PXJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6107d950>
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO67CJZ%252F699015519%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015519/600 saved to cache
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4452e7a2-008a-5460-ac69-330bdd58f5d4
2026-03-29 22:02:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4452e7a2-008a-5460-ac69-330bdd58f5d4, skipping ID generation
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4452e7a2-008a-5460-ac69-330bdd58f5d4 sending to next pipeline
2026-03-29 22:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4452e7a2-008a-5460-ac69-330bdd58f5d4, identifier: EO67%20CJZ
2026-03-29 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6117e650>
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64BWF%252F699400498%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400498/600 saved to cache
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c286c031-4c72-5d7f-8c06-04157dc85649
2026-03-29 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616ac250>
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT64GVX%252F699392030%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392030/600 saved to cache
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 65250f67-b63f-5f19-a165-a7afa44cd815
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61653690>
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_expert_report_file_28f3469a-ca3c-4378-a991-111a2e4e8947.pdf HTTP/1.1" 201 0
2026-03-29 22:02:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ec08eddb-f63d-54e1-9917-94a9b51f829d
2026-03-29 22:02:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec08eddb-f63d-54e1-9917-94a9b51f829d, skipping ID generation
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec08eddb-f63d-54e1-9917-94a9b51f829d
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEK10GHA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EK10GHA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637d8d90>
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_expert_report_file_c7213687-21c6-45c9-8d03-2f08acc8a462.pdf HTTP/1.1" 201 0
2026-03-29 22:02:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c
2026-03-29 22:02:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c, skipping ID generation
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYT65OEM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YT65OEM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV10WYJ/42812387?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=rKDmdlJ%2FaZkUq5BixfEsoLqiph02L2tEANiTYwZbhJk%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB06FEG/42812331?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=WNOGcgO%2BJ9WOUiCo3Sdczttz%2B4KwooVxdySbYY3XIt4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ65LKG/42812434?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=lkM6um%2B1esbhyvKPoMr1jepS1nwt47zijrcJLhXCRmQ%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4452e7a2-008a-5460-ac69-330bdd58f5d4 with identifier: EO67%20CJZ
2026-03-29 22:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4452e7a2-008a-5460-ac69-330bdd58f5d4 with identifier: EO67%20CJZ
2026-03-29 22:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4452e7a2-008a-5460-ac69-330bdd58f5d4 with identifier: EO67%20CJZ to the API
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015519/600>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_expert_report_file_f02b5473-7ed1-4b83-be44-f4c47e2b5479.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO67%20CJZ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4452e7a2-008a-5460-ac69-330bdd58f5d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EO67 CJZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EO67%20CJZ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FIAT',
'model': '500C',
'odometer': 66474,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49923,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015468/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47724,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015492/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47377,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015519/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48966,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015534/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48138,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015556/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46879,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015567/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97903,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015585/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69064,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015599/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81871,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015725/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452e7a2-008a-5460-ac69-330bdd58f5d4/4452e7a2-008a-5460-ac69-330bdd58f5d4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78819,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO67CJZ/699015768/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FIAT 500C 1.2 LOUNGE D/LOGIC Convertible',
'transmission': 'automatic',
'trim': 'LOUNGE D/LOGIC',
'vin': 'ZFA3120000J848652',
'year': 2017}
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO67%2520CJZ%27 HTTP/1.1" 200 None
2026-03-29 22:02:26 [bca.uk] INFO: Saving data for EO67%20CJZ: {'created_time': 1774821746.80699, 'last_price_update_time': 1774821746.807001, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EO67%2520CJZ') HTTP/1.1" 204 0
2026-03-29 22:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400478/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400478>
2026-03-29 22:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK59XZJ/42812446?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=Sgf5Rn3FuL23zVfHBfOCfuLsZ0Q0Q6vBgQjw256Li1k%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK59%20XZJ-GB>
2026-03-29 22:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ51OUG/42812406?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=dOYw7ZeP2oQ6UtwSNYEvYEivTdkXlmMD4dvDfKz%2FUX8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ51%20OUG-GB>
2026-03-29 22:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426221/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426221>
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975342%27 HTTP/1.1" 200 None
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975342 not downloaded yet
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443630%27 HTTP/1.1" 200 None
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443630 not downloaded yet
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253942%27 HTTP/1.1" 200 None
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253942 not downloaded yet
2026-03-29 22:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392017/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392017>
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975366%27 HTTP/1.1" 200 None
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975366 not downloaded yet
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443637%27 HTTP/1.1" 200 None
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443637 not downloaded yet
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253949%27 HTTP/1.1" 200 None
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253949 not downloaded yet
2026-03-29 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63577010>
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64BWF%252F699400484%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400484/600 saved to cache
2026-03-29 22:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c286c031-4c72-5d7f-8c06-04157dc85649
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61168d90>
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_expert_report_file_e31f13d2-a50b-44b9-a092-4eae279c07f1.pdf HTTP/1.1" 201 0
2026-03-29 22:02:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c49bd93f-51dc-5a81-b24e-4047e5f56934
2026-03-29 22:02:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c49bd93f-51dc-5a81-b24e-4047e5f56934, skipping ID generation
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c49bd93f-51dc-5a81-b24e-4047e5f56934
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSV10WYJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SV10WYJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617e4cd0>
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_expert_report_file_0843340b-e03f-46d8-ad62-0db39ee54680.pdf HTTP/1.1" 201 0
2026-03-29 22:02:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5a15dc9f-1f43-5f77-8956-0299042e5086
2026-03-29 22:02:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a15dc9f-1f43-5f77-8956-0299042e5086, skipping ID generation
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a15dc9f-1f43-5f77-8956-0299042e5086
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLB06FEG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LB06FEG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637ea450>
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_expert_report_file_b121b86e-e316-4315-a74a-90a3c1ec5bf5.pdf HTTP/1.1" 201 0
2026-03-29 22:02:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 26623def-55ab-5dd0-bf5f-2b44624045f6
2026-03-29 22:02:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26623def-55ab-5dd0-bf5f-2b44624045f6, skipping ID generation
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26623def-55ab-5dd0-bf5f-2b44624045f6
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEJ65LKG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EJ65LKG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699432935/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN62UZG/42812357?sv=2020-08-04&st=2026-03-29T22%3A01%3A45Z&se=2026-03-29T22%3A26%3A45Z&sr=b&sp=r&sig=X9pErQDsrXNy4qMwHp8m59UtcG5VKGVtuCOpQCnsZBk%3D)
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975385%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975385 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443645%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443645 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253955%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253955 not downloaded yet
2026-03-29 22:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250332/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250332>
2026-03-29 22:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426208/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426208>
2026-03-29 22:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY18YLV/42812425?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=h7wOWU%2Fz4prsCRIqJauvz4RzUYcm6nkOFvHwRW%2FqoK0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GY18%20YLV-GB>
2026-03-29 22:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251890/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251890>
2026-03-29 22:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400473/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400473>
2026-03-29 22:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL64TGO/42812263?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=pY6v7UEKmyZW9aGGGL6rcXCO%2BUThsQ9UEkr83E0IxkY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL64%20TGO-GB>
2026-03-29 22:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392022/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT64GVX/42811943?sv=2020-08-04&st=2026-03-29T22%3A01%3A40Z&se=2026-03-29T22%3A26%3A40Z&sr=b&sp=r&sig=cep50iJLm5T2T%2FJIF3KYJUQN262Xx397yLSJF4VsirI%3D)
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699444741%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699444741 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699432952%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432952 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010736%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010736 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975406%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975406 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443653%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443653 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253962%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253962 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699433777%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433777 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699432965%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432965 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010757%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010757 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975430%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975430 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443656%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443656 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253967%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253967 not downloaded yet
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b5790>
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN62UZG%252F699432935%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699432935/600 saved to cache
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f0b17972-5ab7-56c0-825d-14139cf5492c
2026-03-29 22:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400478/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64BWF/42812128?sv=2020-08-04&st=2026-03-29T22%3A01%3A41Z&se=2026-03-29T22%3A26%3A41Z&sr=b&sp=r&sig=MzwyyqM%2Fq9XpCMHPmp7VRaX08ubizr8jYVfx3e066Lo%3D)
2026-03-29 22:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426221/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX68ORU/42812293?sv=2020-08-04&st=2026-03-29T22%3A01%3A38Z&se=2026-03-29T22%3A26%3A38Z&sr=b&sp=r&sig=dTIgs41eJnjcU89aOFdmMmWrmPHqSDyWtMj1MxYIWm4%3D)
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699444749%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699444749 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699432981%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432981 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010778%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010778 not downloaded yet
2026-03-29 22:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253934/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YT65OEM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443627/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EK10GHA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975317/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AO68PXJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392017/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT64GVX/42811943?sv=2020-08-04&st=2026-03-29T22%3A01%3A40Z&se=2026-03-29T22%3A26%3A40Z&sr=b&sp=r&sig=cep50iJLm5T2T%2FJIF3KYJUQN262Xx397yLSJF4VsirI%3D)
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975455%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975455 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443665%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443665 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253979%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253979 not downloaded yet
2026-03-29 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6371e710>
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT64GVX%252F699392022%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392022/600 saved to cache
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65250f67-b63f-5f19-a165-a7afa44cd815
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699433778%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433778 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699432994%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432994 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010805%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010805 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975481%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975481 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443675%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443675 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253991%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253991 not downloaded yet
2026-03-29 22:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400473/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64BWF/42812128?sv=2020-08-04&st=2026-03-29T22%3A01%3A41Z&se=2026-03-29T22%3A26%3A41Z&sr=b&sp=r&sig=MzwyyqM%2Fq9XpCMHPmp7VRaX08ubizr8jYVfx3e066Lo%3D)
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699444758%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699444758 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699433052%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433052 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010840%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010840 not downloaded yet
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69ade8d0>
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64BWF%252F699400478%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400478/600 saved to cache
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c286c031-4c72-5d7f-8c06-04157dc85649
2026-03-29 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61aded50>
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX68ORU%252F699426221%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426221/600 saved to cache
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0556e924-104a-5552-a701-fc5b5327996f
2026-03-29 22:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ51OUG/42812406?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=dOYw7ZeP2oQ6UtwSNYEvYEivTdkXlmMD4dvDfKz%2FUX8%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK59XZJ/42812446?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=Sgf5Rn3FuL23zVfHBfOCfuLsZ0Q0Q6vBgQjw256Li1k%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253949/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253949>
2026-03-29 22:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426208/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX68ORU/42812293?sv=2020-08-04&st=2026-03-29T22%3A01%3A38Z&se=2026-03-29T22%3A26%3A38Z&sr=b&sp=r&sig=dTIgs41eJnjcU89aOFdmMmWrmPHqSDyWtMj1MxYIWm4%3D)
2026-03-29 22:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251890/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66SVX/42805972?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=yl9q46AoV3wQNjXIFCNniksZeCLN9BE%2FANgZ6Iluhps%3D)
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975508%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975508 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443682%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443682 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699253998%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253998 not downloaded yet
2026-03-29 22:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY18YLV/42812425?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=h7wOWU%2Fz4prsCRIqJauvz4RzUYcm6nkOFvHwRW%2FqoK0%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699433780%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433780 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699433079%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433079 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010883%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010883 not downloaded yet
2026-03-29 22:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL64TGO/42812263?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=pY6v7UEKmyZW9aGGGL6rcXCO%2BUThsQ9UEkr83E0IxkY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975538%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975538 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443690%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443690 not downloaded yet
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699254008%27 HTTP/1.1" 200 None
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699254008 not downloaded yet
2026-03-29 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63660910>
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT64GVX%252F699392017%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392017/600 saved to cache
2026-03-29 22:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65250f67-b63f-5f19-a165-a7afa44cd815
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63559490>
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64BWF%252F699400473%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400473/600 saved to cache
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c286c031-4c72-5d7f-8c06-04157dc85649
2026-03-29 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443627/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10GHA/42812411?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=2se60G1wBkZioFdObKgvGGniCfo4KXU1Bg2UVTzdQU8%3D)
2026-03-29 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975317/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO68PXJ/42810644?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=AjrHe%2FZzg02A19bIAPXt9iYd3%2FKnTUKNfDQ2oVTOXpo%3D)
2026-03-29 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253934/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT65OEM/42801591?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=C86xu7kOSIOpI5tq1qwr9sVc1ocdKllXBj4HnJhS92A%3D)
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699444769%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699444769 not downloaded yet
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699433098%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433098 not downloaded yet
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010912%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010912 not downloaded yet
2026-03-29 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253955/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253955>
2026-03-29 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253967/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253967>
2026-03-29 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250332/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX05YUG/42800121?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=MySGDJ66pbFCM8Of63GwPM4lST90Oc%2FUCupYTeM%2FDJ0%3D)
2026-03-29 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975430/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975430>
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699433782%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433782 not downloaded yet
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699433112%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433112 not downloaded yet
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010938%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010938 not downloaded yet
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620791d0>
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_expert_report_file_3aea378c-3e45-4173-8f28-f0c78dd58011.pdf HTTP/1.1" 201 0
2026-03-29 22:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ff1eccc8-fddb-5844-83d2-04a1cea933d7
2026-03-29 22:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff1eccc8-fddb-5844-83d2-04a1cea933d7, skipping ID generation
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff1eccc8-fddb-5844-83d2-04a1cea933d7
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBJ51OUG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BJ51OUG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617f5650>
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_expert_report_file_eeeb655e-d8a8-4066-a7e3-b3e2a8f3fa0f.pdf HTTP/1.1" 201 0
2026-03-29 22:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 63ad9332-ca60-5606-b72d-c629c976dd98
2026-03-29 22:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63ad9332-ca60-5606-b72d-c629c976dd98, skipping ID generation
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63ad9332-ca60-5606-b72d-c629c976dd98
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHK59XZJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HK59XZJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616dcdd0>
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX68ORU%252F699426208%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426208/600 saved to cache
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0556e924-104a-5552-a701-fc5b5327996f
2026-03-29 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6179a1d0>
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66SVX%252F699251890%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251890/600 saved to cache
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 392ba6d2-142e-521e-9c14-6f3c87e57d15
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61746810>
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_expert_report_file_17c578be-e483-4eac-9ed4-b0065502723e.pdf HTTP/1.1" 201 0
2026-03-29 22:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0ddd1886-59fc-5660-a00b-37dddc9ca1b3
2026-03-29 22:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ddd1886-59fc-5660-a00b-37dddc9ca1b3, skipping ID generation
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ddd1886-59fc-5660-a00b-37dddc9ca1b3
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGY18YLV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GY18YLV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62092790>
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_expert_report_file_1229bbf7-d39f-4d1e-aa99-54999935a8ce.pdf HTTP/1.1" 201 0
2026-03-29 22:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9f1adfaa-144b-529f-85fc-38ebafca0461
2026-03-29 22:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f1adfaa-144b-529f-85fc-38ebafca0461, skipping ID generation
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f1adfaa-144b-529f-85fc-38ebafca0461
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFL64TGO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FL64TGO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443656/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443656>
2026-03-29 22:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253949/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT65OEM/42801591?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=C86xu7kOSIOpI5tq1qwr9sVc1ocdKllXBj4HnJhS92A%3D)
2026-03-29 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253991/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253991>
2026-03-29 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010805/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010805>
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699444776%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699444776 not downloaded yet
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699433129%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433129 not downloaded yet
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010962%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010962 not downloaded yet
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440266%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440266 not downloaded yet
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993790%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993790 not downloaded yet
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010728%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010728 not downloaded yet
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422948%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422948 not downloaded yet
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637b5a90>
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10GHA%252F699443627%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443627/600 saved to cache
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec08eddb-f63d-54e1-9917-94a9b51f829d
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6160bfd0>
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO68PXJ%252F698975317%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975317/600 saved to cache
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50c3f397-3666-5802-9240-95b43afdce21
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617f5190>
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT65OEM%252F699253934%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253934/600 saved to cache
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c
2026-03-29 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a51150>
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX05YUG%252F699250332%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250332/600 saved to cache
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f8e435e-d477-50a3-aea7-4952aa2ce397
2026-03-29 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975481/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975481>
2026-03-29 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253998/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253998>
2026-03-29 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432994/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432994>
2026-03-29 22:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443675/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443675>
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440276%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440276 not downloaded yet
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993811%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993811 not downloaded yet
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010748%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010748 not downloaded yet
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422954%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422954 not downloaded yet
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c6c3d0>
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT65OEM%252F699253949%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253949/600 saved to cache
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440281%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440281 not downloaded yet
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993827%27 HTTP/1.1" 200 None
2026-03-29 22:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993827 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010764%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010764 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422961%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422961 not downloaded yet
2026-03-29 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975430/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO68PXJ/42810644?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=AjrHe%2FZzg02A19bIAPXt9iYd3%2FKnTUKNfDQ2oVTOXpo%3D)
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440287%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440287 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993839%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993839 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010791%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010791 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422969%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422969 not downloaded yet
2026-03-29 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253955/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT65OEM/42801591?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=C86xu7kOSIOpI5tq1qwr9sVc1ocdKllXBj4HnJhS92A%3D)
2026-03-29 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253967/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT65OEM/42801591?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=C86xu7kOSIOpI5tq1qwr9sVc1ocdKllXBj4HnJhS92A%3D)
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440294%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440294 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993857%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993857 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010811%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010811 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422975%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422975 not downloaded yet
2026-03-29 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010805/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ65LKG/42812434?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=lkM6um%2B1esbhyvKPoMr1jepS1nwt47zijrcJLhXCRmQ%3D)
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440306%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440306 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993880%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993880 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010850%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010850 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422981%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422981 not downloaded yet
2026-03-29 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699433780/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433780>
2026-03-29 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433079/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433079>
2026-03-29 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010883/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010883>
2026-03-29 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443682/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443682>
2026-03-29 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443656/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10GHA/42812411?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=2se60G1wBkZioFdObKgvGGniCfo4KXU1Bg2UVTzdQU8%3D)
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440313%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440313 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993907%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993907 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010878%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010878 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422988%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422988 not downloaded yet
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62097050>
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO68PXJ%252F698975430%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975430/600 saved to cache
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 50c3f397-3666-5802-9240-95b43afdce21
2026-03-29 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253991/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT65OEM/42801591?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=C86xu7kOSIOpI5tq1qwr9sVc1ocdKllXBj4HnJhS92A%3D)
2026-03-29 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010912/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010912>
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440322%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440322 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993936%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993936 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010903%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010903 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422996%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422996 not downloaded yet
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637c5b90>
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT65OEM%252F699253955%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253955/600 saved to cache
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a51010>
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT65OEM%252F699253967%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253967/600 saved to cache
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c
2026-03-29 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432994/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB06FEG/42812331?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=WNOGcgO%2BJ9WOUiCo3Sdczttz%2B4KwooVxdySbYY3XIt4%3D)
2026-03-29 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975481/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO68PXJ/42810644?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=AjrHe%2FZzg02A19bIAPXt9iYd3%2FKnTUKNfDQ2oVTOXpo%3D)
2026-03-29 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422945/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FL64TGO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422961/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422961>
2026-03-29 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443675/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10GHA/42812411?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=2se60G1wBkZioFdObKgvGGniCfo4KXU1Bg2UVTzdQU8%3D)
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440330%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440330 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993959%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993959 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010927%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010927 not downloaded yet
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699423005%27 HTTP/1.1" 200 None
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699423005 not downloaded yet
2026-03-29 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253998/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT65OEM/42801591?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=C86xu7kOSIOpI5tq1qwr9sVc1ocdKllXBj4HnJhS92A%3D)
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6170cc90>
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ65LKG%252F699010805%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010805/600 saved to cache
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26623def-55ab-5dd0-bf5f-2b44624045f6
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610628d0>
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10GHA%252F699443656%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443656/600 saved to cache
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec08eddb-f63d-54e1-9917-94a9b51f829d
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac684cb110>
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT65OEM%252F699253991%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253991/600 saved to cache
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c
2026-03-29 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422969/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422969>
2026-03-29 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010791/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010791>
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637ee950>
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB06FEG%252F699432994%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432994/600 saved to cache
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a15dc9f-1f43-5f77-8956-0299042e5086
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637ec650>
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO68PXJ%252F698975481%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975481/600 saved to cache
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 50c3f397-3666-5802-9240-95b43afdce21
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614ef350>
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10GHA%252F699443675%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443675/600 saved to cache
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec08eddb-f63d-54e1-9917-94a9b51f829d
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6996fa10>
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT65OEM%252F699253998%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253998/600 saved to cache
2026-03-29 22:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c
2026-03-29 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422988/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422988>
2026-03-29 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422981/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422981>
2026-03-29 22:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422975/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422975>
2026-03-29 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010883/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ65LKG/42812434?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=lkM6um%2B1esbhyvKPoMr1jepS1nwt47zijrcJLhXCRmQ%3D)
2026-03-29 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443682/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10GHA/42812411?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=2se60G1wBkZioFdObKgvGGniCfo4KXU1Bg2UVTzdQU8%3D)
2026-03-29 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433079/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB06FEG/42812331?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=WNOGcgO%2BJ9WOUiCo3Sdczttz%2B4KwooVxdySbYY3XIt4%3D)
2026-03-29 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010912/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ65LKG/42812434?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=lkM6um%2B1esbhyvKPoMr1jepS1nwt47zijrcJLhXCRmQ%3D)
2026-03-29 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699433780/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV10WYJ/42812387?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=rKDmdlJ%2FaZkUq5BixfEsoLqiph02L2tEANiTYwZbhJk%3D)
2026-03-29 22:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422969/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL64TGO/42812263?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=pY6v7UEKmyZW9aGGGL6rcXCO%2BUThsQ9UEkr83E0IxkY%3D)
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422945/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL64TGO/42812263?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=pY6v7UEKmyZW9aGGGL6rcXCO%2BUThsQ9UEkr83E0IxkY%3D)
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422996/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422996>
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993936/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993936>
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440322/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440322>
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422961/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL64TGO/42812263?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=pY6v7UEKmyZW9aGGGL6rcXCO%2BUThsQ9UEkr83E0IxkY%3D)
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010903/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010903>
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63679350>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ65LKG%252F699010883%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010883/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26623def-55ab-5dd0-bf5f-2b44624045f6
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61063490>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10GHA%252F699443682%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443682/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec08eddb-f63d-54e1-9917-94a9b51f829d
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010791/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY18YLV/42812425?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=h7wOWU%2Fz4prsCRIqJauvz4RzUYcm6nkOFvHwRW%2FqoK0%3D)
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422975/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL64TGO/42812263?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=pY6v7UEKmyZW9aGGGL6rcXCO%2BUThsQ9UEkr83E0IxkY%3D)
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422988/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL64TGO/42812263?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=pY6v7UEKmyZW9aGGGL6rcXCO%2BUThsQ9UEkr83E0IxkY%3D)
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010927/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010927>
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699423005/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699423005>
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993959/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993959>
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440330/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440330>
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422981/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL64TGO/42812263?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=pY6v7UEKmyZW9aGGGL6rcXCO%2BUThsQ9UEkr83E0IxkY%3D)
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614ee0d0>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB06FEG%252F699433079%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433079/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a15dc9f-1f43-5f77-8956-0299042e5086
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636e4510>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ65LKG%252F699010912%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010912/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26623def-55ab-5dd0-bf5f-2b44624045f6
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61636690>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV10WYJ%252F699433780%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699433780/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c49bd93f-51dc-5a81-b24e-4047e5f56934
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6118c390>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL64TGO%252F699422969%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422969/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f1adfaa-144b-529f-85fc-38ebafca0461
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611a1490>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL64TGO%252F699422945%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422945/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f1adfaa-144b-529f-85fc-38ebafca0461
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636bf5d0>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL64TGO%252F699422961%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422961/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f1adfaa-144b-529f-85fc-38ebafca0461
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61577110>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY18YLV%252F699010791%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010791/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ddd1886-59fc-5660-a00b-37dddc9ca1b3
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61538dd0>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL64TGO%252F699422975%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422975/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f1adfaa-144b-529f-85fc-38ebafca0461
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac68672e50>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL64TGO%252F699422988%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422988/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f1adfaa-144b-529f-85fc-38ebafca0461
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614efe10>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL64TGO%252F699422981%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422981/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f1adfaa-144b-529f-85fc-38ebafca0461
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010878/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010878>
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010850/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010850>
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440313/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440313>
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993907/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993907>
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993936/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK59XZJ/42812446?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=Sgf5Rn3FuL23zVfHBfOCfuLsZ0Q0Q6vBgQjw256Li1k%3D)
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010903/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY18YLV/42812425?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=h7wOWU%2Fz4prsCRIqJauvz4RzUYcm6nkOFvHwRW%2FqoK0%3D)
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440322/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ51OUG/42812406?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=dOYw7ZeP2oQ6UtwSNYEvYEivTdkXlmMD4dvDfKz%2FUX8%3D)
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422996/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL64TGO/42812263?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=pY6v7UEKmyZW9aGGGL6rcXCO%2BUThsQ9UEkr83E0IxkY%3D)
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993857/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993857>
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440306/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440306>
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010811/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010811>
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993880/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993880>
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993959/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK59XZJ/42812446?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=Sgf5Rn3FuL23zVfHBfOCfuLsZ0Q0Q6vBgQjw256Li1k%3D)
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440330/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ51OUG/42812406?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=dOYw7ZeP2oQ6UtwSNYEvYEivTdkXlmMD4dvDfKz%2FUX8%3D)
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010927/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY18YLV/42812425?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=h7wOWU%2Fz4prsCRIqJauvz4RzUYcm6nkOFvHwRW%2FqoK0%3D)
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61045cd0>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK59XZJ%252F698993936%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993936/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63ad9332-ca60-5606-b72d-c629c976dd98
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac635122d0>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY18YLV%252F699010903%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010903/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ddd1886-59fc-5660-a00b-37dddc9ca1b3
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993907/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK59XZJ/42812446?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=Sgf5Rn3FuL23zVfHBfOCfuLsZ0Q0Q6vBgQjw256Li1k%3D)
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440294/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440294>
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993839/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993839>
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440287/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440287>
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010878/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY18YLV/42812425?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=h7wOWU%2Fz4prsCRIqJauvz4RzUYcm6nkOFvHwRW%2FqoK0%3D)
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6116b110>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ51OUG%252F699440322%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440322/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff1eccc8-fddb-5844-83d2-04a1cea933d7
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637d2fd0>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL64TGO%252F699422996%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422996/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f1adfaa-144b-529f-85fc-38ebafca0461
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440313/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ51OUG/42812406?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=dOYw7ZeP2oQ6UtwSNYEvYEivTdkXlmMD4dvDfKz%2FUX8%3D)
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010850/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY18YLV/42812425?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=h7wOWU%2Fz4prsCRIqJauvz4RzUYcm6nkOFvHwRW%2FqoK0%3D)
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699423005/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL64TGO/42812263?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=pY6v7UEKmyZW9aGGGL6rcXCO%2BUThsQ9UEkr83E0IxkY%3D)
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63577010>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK59XZJ%252F698993959%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993959/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63ad9332-ca60-5606-b72d-c629c976dd98
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6351f010>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ51OUG%252F699440330%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440330/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff1eccc8-fddb-5844-83d2-04a1cea933d7
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61972f50>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY18YLV%252F699010927%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010927/600 saved to cache
2026-03-29 22:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ddd1886-59fc-5660-a00b-37dddc9ca1b3
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993857/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK59XZJ/42812446?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=Sgf5Rn3FuL23zVfHBfOCfuLsZ0Q0Q6vBgQjw256Li1k%3D)
2026-03-29 22:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010764/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010764>
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010811/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY18YLV/42812425?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=h7wOWU%2Fz4prsCRIqJauvz4RzUYcm6nkOFvHwRW%2FqoK0%3D)
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440306/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ51OUG/42812406?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=dOYw7ZeP2oQ6UtwSNYEvYEivTdkXlmMD4dvDfKz%2FUX8%3D)
2026-03-29 22:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993880/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK59XZJ/42812446?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=Sgf5Rn3FuL23zVfHBfOCfuLsZ0Q0Q6vBgQjw256Li1k%3D)
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62136b10>
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK59XZJ%252F698993907%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993907/600 saved to cache
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63ad9332-ca60-5606-b72d-c629c976dd98
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61198850>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY18YLV%252F699010878%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010878/600 saved to cache
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ddd1886-59fc-5660-a00b-37dddc9ca1b3
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6371c890>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ51OUG%252F699440313%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440313/600 saved to cache
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff1eccc8-fddb-5844-83d2-04a1cea933d7
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61198310>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY18YLV%252F699010850%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010850/600 saved to cache
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ddd1886-59fc-5660-a00b-37dddc9ca1b3
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636b6b10>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL64TGO%252F699423005%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699423005/600 saved to cache
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f1adfaa-144b-529f-85fc-38ebafca0461
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422954/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422954>
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440281/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440281>
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993827/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993827>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6208ab50>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK59XZJ%252F698993857%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993857/600 saved to cache
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63ad9332-ca60-5606-b72d-c629c976dd98
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a1cdd0>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY18YLV%252F699010811%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010811/600 saved to cache
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ddd1886-59fc-5660-a00b-37dddc9ca1b3
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62133690>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ51OUG%252F699440306%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440306/600 saved to cache
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff1eccc8-fddb-5844-83d2-04a1cea933d7
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61518850>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK59XZJ%252F698993880%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993880/600 saved to cache
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63ad9332-ca60-5606-b72d-c629c976dd98
2026-03-29 22:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440287/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ51OUG/42812406?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=dOYw7ZeP2oQ6UtwSNYEvYEivTdkXlmMD4dvDfKz%2FUX8%3D)
2026-03-29 22:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440294/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ51OUG/42812406?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=dOYw7ZeP2oQ6UtwSNYEvYEivTdkXlmMD4dvDfKz%2FUX8%3D)
2026-03-29 22:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993839/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK59XZJ/42812446?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=Sgf5Rn3FuL23zVfHBfOCfuLsZ0Q0Q6vBgQjw256Li1k%3D)
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010748/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010748>
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993811/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993811>
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422948/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422948>
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440276/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440276>
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010728/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010728>
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433129/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433129>
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993790/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993790>
2026-03-29 22:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422954/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL64TGO/42812263?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=pY6v7UEKmyZW9aGGGL6rcXCO%2BUThsQ9UEkr83E0IxkY%3D)
2026-03-29 22:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993827/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK59XZJ/42812446?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=Sgf5Rn3FuL23zVfHBfOCfuLsZ0Q0Q6vBgQjw256Li1k%3D)
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010962/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010962>
2026-03-29 22:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440281/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ51OUG/42812406?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=dOYw7ZeP2oQ6UtwSNYEvYEivTdkXlmMD4dvDfKz%2FUX8%3D)
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440266/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440266>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618f6e10>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ51OUG%252F699440287%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440287/600 saved to cache
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff1eccc8-fddb-5844-83d2-04a1cea933d7
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61608610>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ51OUG%252F699440294%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440294/600 saved to cache
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff1eccc8-fddb-5844-83d2-04a1cea933d7
2026-03-29 22:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422948/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL64TGO/42812263?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=pY6v7UEKmyZW9aGGGL6rcXCO%2BUThsQ9UEkr83E0IxkY%3D)
2026-03-29 22:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440276/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ51OUG/42812406?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=dOYw7ZeP2oQ6UtwSNYEvYEivTdkXlmMD4dvDfKz%2FUX8%3D)
2026-03-29 22:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010748/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY18YLV/42812425?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=h7wOWU%2Fz4prsCRIqJauvz4RzUYcm6nkOFvHwRW%2FqoK0%3D)
2026-03-29 22:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993811/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK59XZJ/42812446?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=Sgf5Rn3FuL23zVfHBfOCfuLsZ0Q0Q6vBgQjw256Li1k%3D)
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444776/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699444776>
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010710/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GY18YLV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010728/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY18YLV/42812425?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=h7wOWU%2Fz4prsCRIqJauvz4RzUYcm6nkOFvHwRW%2FqoK0%3D)
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61831350>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK59XZJ%252F698993839%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993839/600 saved to cache
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63ad9332-ca60-5606-b72d-c629c976dd98
2026-03-29 22:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010764/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY18YLV/42812425?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=h7wOWU%2Fz4prsCRIqJauvz4RzUYcm6nkOFvHwRW%2FqoK0%3D)
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6192c6d0>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL64TGO%252F699422954%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422954/600 saved to cache
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f1adfaa-144b-529f-85fc-38ebafca0461
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637db350>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK59XZJ%252F698993827%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993827/600 saved to cache
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63ad9332-ca60-5606-b72d-c629c976dd98
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637273d0>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ51OUG%252F699440281%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440281/600 saved to cache
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff1eccc8-fddb-5844-83d2-04a1cea933d7
2026-03-29 22:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993790/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK59XZJ/42812446?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=Sgf5Rn3FuL23zVfHBfOCfuLsZ0Q0Q6vBgQjw256Li1k%3D)
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433112/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433112>
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440258/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BJ51OUG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993775/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HK59XZJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010938/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010938>
2026-03-29 22:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010962/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ65LKG/42812434?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=lkM6um%2B1esbhyvKPoMr1jepS1nwt47zijrcJLhXCRmQ%3D)
2026-03-29 22:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433129/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB06FEG/42812331?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=WNOGcgO%2BJ9WOUiCo3Sdczttz%2B4KwooVxdySbYY3XIt4%3D)
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61051a50>
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL64TGO%252F699422948%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422948/600 saved to cache
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f1adfaa-144b-529f-85fc-38ebafca0461
2026-03-29 22:02:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f1adfaa-144b-529f-85fc-38ebafca0461, skipping ID generation
2026-03-29 22:02:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f1adfaa-144b-529f-85fc-38ebafca0461 sending to next pipeline
2026-03-29 22:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9f1adfaa-144b-529f-85fc-38ebafca0461, identifier: FL64%20TGO
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b0450>
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ51OUG%252F699440276%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440276/600 saved to cache
2026-03-29 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff1eccc8-fddb-5844-83d2-04a1cea933d7
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614de910>
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY18YLV%252F699010748%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010748/600 saved to cache
2026-03-29 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ddd1886-59fc-5660-a00b-37dddc9ca1b3
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614ef150>
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK59XZJ%252F698993811%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993811/600 saved to cache
2026-03-29 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63ad9332-ca60-5606-b72d-c629c976dd98
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6151b410>
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY18YLV%252F699010728%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010728/600 saved to cache
2026-03-29 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ddd1886-59fc-5660-a00b-37dddc9ca1b3
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69800a10>
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY18YLV%252F699010764%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010764/600 saved to cache
2026-03-29 22:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ddd1886-59fc-5660-a00b-37dddc9ca1b3
2026-03-29 22:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9f1adfaa-144b-529f-85fc-38ebafca0461 with identifier: FL64%20TGO
2026-03-29 22:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9f1adfaa-144b-529f-85fc-38ebafca0461 with identifier: FL64%20TGO
2026-03-29 22:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9f1adfaa-144b-529f-85fc-38ebafca0461 with identifier: FL64%20TGO to the API
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422948/600>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_expert_report_file_1229bbf7-d39f-4d1e-aa99-54999935a8ce.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL64%20TGO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9f1adfaa-144b-529f-85fc-38ebafca0461',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL64 TGO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL64%20TGO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'TOYOTA',
'model': 'AURIS',
'odometer': 31912,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40726,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422945/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40201,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422948/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38442,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422954/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37632,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422961/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33522,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422969/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33740,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422975/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85728,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422981/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59544,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422988/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76632,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699422996/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f1adfaa-144b-529f-85fc-38ebafca0461/9f1adfaa-144b-529f-85fc-38ebafca0461_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67255,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL64TGO/699423005/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'TOYOTA AURIS 1.6 V-MATIC ICON Hatchback',
'transmission': 'manual',
'trim': 'V-MATIC ICON',
'vin': 'SB1ME3JE90E061837',
'year': 2014}
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL64%2520TGO%27 HTTP/1.1" 200 None
2026-03-29 22:02:33 [bca.uk] INFO: Saving data for FL64%20TGO: {'created_time': 1774821753.052653, 'last_price_update_time': 1774821753.052662, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL64%2520TGO') HTTP/1.1" 204 0
2026-03-29 22:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440266/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ51OUG/42812406?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=dOYw7ZeP2oQ6UtwSNYEvYEivTdkXlmMD4dvDfKz%2FUX8%3D)
2026-03-29 22:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444776/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV10WYJ/42812387?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=rKDmdlJ%2FaZkUq5BixfEsoLqiph02L2tEANiTYwZbhJk%3D)
2026-03-29 22:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010710/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY18YLV/42812425?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=h7wOWU%2Fz4prsCRIqJauvz4RzUYcm6nkOFvHwRW%2FqoK0%3D)
2026-03-29 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433098/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433098>
2026-03-29 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699433782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433782>
2026-03-29 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444769/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699444769>
2026-03-29 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443690/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443690>
2026-03-29 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699254008/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699254008>
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62260a90>
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK59XZJ%252F698993790%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993790/600 saved to cache
2026-03-29 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63ad9332-ca60-5606-b72d-c629c976dd98
2026-03-29 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b0b10>
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ65LKG%252F699010962%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010962/600 saved to cache
2026-03-29 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 26623def-55ab-5dd0-bf5f-2b44624045f6
2026-03-29 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611a3050>
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB06FEG%252F699433129%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433129/600 saved to cache
2026-03-29 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a15dc9f-1f43-5f77-8956-0299042e5086
2026-03-29 22:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440258/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ51OUG/42812406?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=dOYw7ZeP2oQ6UtwSNYEvYEivTdkXlmMD4dvDfKz%2FUX8%3D)
2026-03-29 22:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993775/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK59XZJ/42812446?sv=2020-08-04&st=2026-03-29T22%3A02%3A26Z&se=2026-03-29T22%3A27%3A26Z&sr=b&sp=r&sig=Sgf5Rn3FuL23zVfHBfOCfuLsZ0Q0Q6vBgQjw256Li1k%3D)
2026-03-29 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975508/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975508>
2026-03-29 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975538/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975538>
2026-03-29 22:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010938/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ65LKG/42812434?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=lkM6um%2B1esbhyvKPoMr1jepS1nwt47zijrcJLhXCRmQ%3D)
2026-03-29 22:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433112/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB06FEG/42812331?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=WNOGcgO%2BJ9WOUiCo3Sdczttz%2B4KwooVxdySbYY3XIt4%3D)
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6207c950>
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ51OUG%252F699440266%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440266/600 saved to cache
2026-03-29 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff1eccc8-fddb-5844-83d2-04a1cea933d7
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62262690>
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV10WYJ%252F699444776%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444776/600 saved to cache
2026-03-29 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c49bd93f-51dc-5a81-b24e-4047e5f56934
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61168750>
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY18YLV%252F699010710%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010710/600 saved to cache
2026-03-29 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ddd1886-59fc-5660-a00b-37dddc9ca1b3
2026-03-29 22:02:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ddd1886-59fc-5660-a00b-37dddc9ca1b3, skipping ID generation
2026-03-29 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ddd1886-59fc-5660-a00b-37dddc9ca1b3 sending to next pipeline
2026-03-29 22:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0ddd1886-59fc-5660-a00b-37dddc9ca1b3, identifier: GY18%20YLV
2026-03-29 22:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0ddd1886-59fc-5660-a00b-37dddc9ca1b3 with identifier: GY18%20YLV
2026-03-29 22:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0ddd1886-59fc-5660-a00b-37dddc9ca1b3 with identifier: GY18%20YLV
2026-03-29 22:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0ddd1886-59fc-5660-a00b-37dddc9ca1b3 with identifier: GY18%20YLV to the API
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010710/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_expert_report_file_17c578be-e483-4eac-9ed4-b0065502723e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GY18%20YLV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0ddd1886-59fc-5660-a00b-37dddc9ca1b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GY18 YLV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GY18%20YLV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 34284,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48453,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010710/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45317,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010728/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46118,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010748/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47532,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010764/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45007,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010791/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42700,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010811/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84807,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010850/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63376,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010878/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80239,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010903/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ddd1886-59fc-5660-a00b-37dddc9ca1b3/0ddd1886-59fc-5660-a00b-37dddc9ca1b3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65007,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY18YLV/699010927/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'AUDI A3 SPORTBACK 1.0 TFSI 115 BLACK ED. Hatchback',
'transmission': 'manual',
'trim': 'TFSI 115 BLACK ED.',
'vin': 'WAUZZZ8V2JA112714',
'year': 2018}
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY18%2520YLV%27 HTTP/1.1" 200 None
2026-03-29 22:02:33 [bca.uk] INFO: Saving data for GY18%20YLV: {'created_time': 1774821753.803318, 'last_price_update_time': 1774821753.80333, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GY18%2520YLV') HTTP/1.1" 204 0
2026-03-29 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010840/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010840>
2026-03-29 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433052/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433052>
2026-03-29 22:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444769/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV10WYJ/42812387?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=rKDmdlJ%2FaZkUq5BixfEsoLqiph02L2tEANiTYwZbhJk%3D)
2026-03-29 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699433778/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433778>
2026-03-29 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253979/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253979>
2026-03-29 22:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444758/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699444758>
2026-03-29 22:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433098/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB06FEG/42812331?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=WNOGcgO%2BJ9WOUiCo3Sdczttz%2B4KwooVxdySbYY3XIt4%3D)
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6115c910>
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ51OUG%252F699440258%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440258/600 saved to cache
2026-03-29 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff1eccc8-fddb-5844-83d2-04a1cea933d7
2026-03-29 22:02:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff1eccc8-fddb-5844-83d2-04a1cea933d7, skipping ID generation
2026-03-29 22:02:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff1eccc8-fddb-5844-83d2-04a1cea933d7 sending to next pipeline
2026-03-29 22:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ff1eccc8-fddb-5844-83d2-04a1cea933d7, identifier: BJ51%20OUG
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61834990>
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK59XZJ%252F698993775%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993775/600 saved to cache
2026-03-29 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63ad9332-ca60-5606-b72d-c629c976dd98
2026-03-29 22:02:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63ad9332-ca60-5606-b72d-c629c976dd98, skipping ID generation
2026-03-29 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63ad9332-ca60-5606-b72d-c629c976dd98 sending to next pipeline
2026-03-29 22:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 63ad9332-ca60-5606-b72d-c629c976dd98, identifier: HK59%20XZJ
2026-03-29 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6334b690>
2026-03-29 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ65LKG%252F699010938%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010938/600 saved to cache
2026-03-29 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 26623def-55ab-5dd0-bf5f-2b44624045f6
2026-03-29 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61836790>
2026-03-29 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB06FEG%252F699433112%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433112/600 saved to cache
2026-03-29 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a15dc9f-1f43-5f77-8956-0299042e5086
2026-03-29 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699433782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV10WYJ/42812387?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=rKDmdlJ%2FaZkUq5BixfEsoLqiph02L2tEANiTYwZbhJk%3D)
2026-03-29 22:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ff1eccc8-fddb-5844-83d2-04a1cea933d7 with identifier: BJ51%20OUG
2026-03-29 22:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ff1eccc8-fddb-5844-83d2-04a1cea933d7 with identifier: BJ51%20OUG
2026-03-29 22:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ff1eccc8-fddb-5844-83d2-04a1cea933d7 with identifier: BJ51%20OUG to the API
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440258/600>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_expert_report_file_3aea378c-3e45-4173-8f28-f0c78dd58011.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ51%20OUG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.1L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ff1eccc8-fddb-5844-83d2-04a1cea933d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ51 OUG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ51%20OUG&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FIAT',
'model': 'SEICENTO',
'odometer': 33089,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38067,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440258/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38617,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440266/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36576,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440276/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36917,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440281/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34218,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440287/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440294/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88681,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440306/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86272,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440313/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92585,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440322/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff1eccc8-fddb-5844-83d2-04a1cea933d7/ff1eccc8-fddb-5844-83d2-04a1cea933d7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71632,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ51OUG/699440330/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-01-01',
'seller_name': None,
'title': 'FIAT SEICENTO 1.1 SX Hatchback',
'transmission': 'manual',
'trim': 'SX',
'vin': 'ZFA18700000751456',
'year': 2001}
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ51%2520OUG%27 HTTP/1.1" 200 None
2026-03-29 22:02:34 [bca.uk] INFO: Saving data for BJ51%20OUG: {'created_time': 1774821754.551902, 'last_price_update_time': 1774821754.551912, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ51%2520OUG') HTTP/1.1" 204 0
2026-03-29 22:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 63ad9332-ca60-5606-b72d-c629c976dd98 with identifier: HK59%20XZJ
2026-03-29 22:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 63ad9332-ca60-5606-b72d-c629c976dd98 with identifier: HK59%20XZJ
2026-03-29 22:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 63ad9332-ca60-5606-b72d-c629c976dd98 with identifier: HK59%20XZJ to the API
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993775/600>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_expert_report_file_eeeb655e-d8a8-4066-a7e3-b3e2a8f3fa0f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK59%20XZJ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '63ad9332-ca60-5606-b72d-c629c976dd98',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK59 XZJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK59%20XZJ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HYUNDAI',
'model': 'I20',
'odometer': 48596,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48845,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993775/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46210,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993790/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46993,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993811/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47359,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993827/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47626,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993839/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46794,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993857/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89497,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993880/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59491,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993907/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75401,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993936/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63ad9332-ca60-5606-b72d-c629c976dd98/63ad9332-ca60-5606-b72d-c629c976dd98_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70754,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK59XZJ/698993959/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'HYUNDAI I20 1.4 COMFORT Hatchback',
'transmission': 'automatic',
'trim': 'COMFORT',
'vin': 'MALBB51CMAM130072',
'year': 2010}
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK59%2520XZJ%27 HTTP/1.1" 200 None
2026-03-29 22:02:34 [bca.uk] INFO: Saving data for HK59%20XZJ: {'created_time': 1774821754.930446, 'last_price_update_time': 1774821754.93046, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK59%2520XZJ') HTTP/1.1" 204 0
2026-03-29 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443690/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10GHA/42812411?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=2se60G1wBkZioFdObKgvGGniCfo4KXU1Bg2UVTzdQU8%3D)
2026-03-29 22:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975455/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975455>
2026-03-29 22:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010778/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010778>
2026-03-29 22:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443665/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443665>
2026-03-29 22:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699254008/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT65OEM/42801591?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=C86xu7kOSIOpI5tq1qwr9sVc1ocdKllXBj4HnJhS92A%3D)
2026-03-29 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618c4950>
2026-03-29 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV10WYJ%252F699444769%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444769/600 saved to cache
2026-03-29 22:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c49bd93f-51dc-5a81-b24e-4047e5f56934
2026-03-29 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6209ded0>
2026-03-29 22:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB06FEG%252F699433098%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433098/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a15dc9f-1f43-5f77-8956-0299042e5086
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975508/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO68PXJ/42810644?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=AjrHe%2FZzg02A19bIAPXt9iYd3%2FKnTUKNfDQ2oVTOXpo%3D)
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975538/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO68PXJ/42810644?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=AjrHe%2FZzg02A19bIAPXt9iYd3%2FKnTUKNfDQ2oVTOXpo%3D)
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432981/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432981>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac68673cd0>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV10WYJ%252F699433782%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699433782/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c49bd93f-51dc-5a81-b24e-4047e5f56934
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615a3ed0>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10GHA%252F699443690%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443690/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec08eddb-f63d-54e1-9917-94a9b51f829d
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63574e50>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT65OEM%252F699254008%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699254008/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444758/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV10WYJ/42812387?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=rKDmdlJ%2FaZkUq5BixfEsoLqiph02L2tEANiTYwZbhJk%3D)
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433052/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB06FEG/42812331?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=WNOGcgO%2BJ9WOUiCo3Sdczttz%2B4KwooVxdySbYY3XIt4%3D)
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010840/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ65LKG/42812434?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=lkM6um%2B1esbhyvKPoMr1jepS1nwt47zijrcJLhXCRmQ%3D)
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444749/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699444749>
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010757/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010757>
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432965/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432965>
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253979/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT65OEM/42801591?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=C86xu7kOSIOpI5tq1qwr9sVc1ocdKllXBj4HnJhS92A%3D)
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6351d3d0>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO68PXJ%252F698975508%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975508/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 50c3f397-3666-5802-9240-95b43afdce21
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611d5250>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO68PXJ%252F698975538%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975538/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 50c3f397-3666-5802-9240-95b43afdce21
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699433778/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV10WYJ/42812387?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=rKDmdlJ%2FaZkUq5BixfEsoLqiph02L2tEANiTYwZbhJk%3D)
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010778/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ65LKG/42812434?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=lkM6um%2B1esbhyvKPoMr1jepS1nwt47zijrcJLhXCRmQ%3D)
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975455/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO68PXJ/42810644?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=AjrHe%2FZzg02A19bIAPXt9iYd3%2FKnTUKNfDQ2oVTOXpo%3D)
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636b7350>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV10WYJ%252F699444758%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444758/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c49bd93f-51dc-5a81-b24e-4047e5f56934
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443665/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10GHA/42812411?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=2se60G1wBkZioFdObKgvGGniCfo4KXU1Bg2UVTzdQU8%3D)
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432981/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB06FEG/42812331?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=WNOGcgO%2BJ9WOUiCo3Sdczttz%2B4KwooVxdySbYY3XIt4%3D)
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61836850>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB06FEG%252F699433052%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433052/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a15dc9f-1f43-5f77-8956-0299042e5086
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618f1410>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ65LKG%252F699010840%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010840/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26623def-55ab-5dd0-bf5f-2b44624045f6
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61198590>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT65OEM%252F699253979%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253979/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443653/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443653>
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699433777/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433777>
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253962/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253962>
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432952/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432952>
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975406/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975406>
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010736/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010736>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac697ef350>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV10WYJ%252F699433778%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699433778/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c49bd93f-51dc-5a81-b24e-4047e5f56934
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61714e10>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ65LKG%252F699010778%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010778/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26623def-55ab-5dd0-bf5f-2b44624045f6
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69ad97d0>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO68PXJ%252F698975455%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975455/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 50c3f397-3666-5802-9240-95b43afdce21
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636792d0>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10GHA%252F699443665%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443665/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec08eddb-f63d-54e1-9917-94a9b51f829d
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6209fc10>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB06FEG%252F699432981%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432981/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a15dc9f-1f43-5f77-8956-0299042e5086
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432965/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB06FEG/42812331?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=WNOGcgO%2BJ9WOUiCo3Sdczttz%2B4KwooVxdySbYY3XIt4%3D)
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010757/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ65LKG/42812434?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=lkM6um%2B1esbhyvKPoMr1jepS1nwt47zijrcJLhXCRmQ%3D)
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444749/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV10WYJ/42812387?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=rKDmdlJ%2FaZkUq5BixfEsoLqiph02L2tEANiTYwZbhJk%3D)
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444741/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699444741>
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443645/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443645>
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975385/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975385>
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010717/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EJ65LKG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432936/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LB06FEG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975406/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO68PXJ/42810644?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=AjrHe%2FZzg02A19bIAPXt9iYd3%2FKnTUKNfDQ2oVTOXpo%3D)
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010736/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ65LKG/42812434?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=lkM6um%2B1esbhyvKPoMr1jepS1nwt47zijrcJLhXCRmQ%3D)
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432952/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB06FEG/42812331?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=WNOGcgO%2BJ9WOUiCo3Sdczttz%2B4KwooVxdySbYY3XIt4%3D)
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443637/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443637>
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444735/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SV10WYJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443653/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10GHA/42812411?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=2se60G1wBkZioFdObKgvGGniCfo4KXU1Bg2UVTzdQU8%3D)
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61053b10>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB06FEG%252F699432965%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432965/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a15dc9f-1f43-5f77-8956-0299042e5086
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699433777/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV10WYJ/42812387?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=rKDmdlJ%2FaZkUq5BixfEsoLqiph02L2tEANiTYwZbhJk%3D)
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253962/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT65OEM/42801591?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=C86xu7kOSIOpI5tq1qwr9sVc1ocdKllXBj4HnJhS92A%3D)
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432936/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB06FEG/42812331?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=WNOGcgO%2BJ9WOUiCo3Sdczttz%2B4KwooVxdySbYY3XIt4%3D)
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010717/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EJ65LKG/42812434?sv=2020-08-04&st=2026-03-29T22%3A02%3A23Z&se=2026-03-29T22%3A27%3A23Z&sr=b&sp=r&sig=lkM6um%2B1esbhyvKPoMr1jepS1nwt47zijrcJLhXCRmQ%3D)
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975385/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO68PXJ/42810644?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=AjrHe%2FZzg02A19bIAPXt9iYd3%2FKnTUKNfDQ2oVTOXpo%3D)
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444741/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV10WYJ/42812387?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=rKDmdlJ%2FaZkUq5BixfEsoLqiph02L2tEANiTYwZbhJk%3D)
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69b8ff10>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ65LKG%252F699010757%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010757/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26623def-55ab-5dd0-bf5f-2b44624045f6
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443645/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10GHA/42812411?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=2se60G1wBkZioFdObKgvGGniCfo4KXU1Bg2UVTzdQU8%3D)
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62084990>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV10WYJ%252F699444749%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444749/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c49bd93f-51dc-5a81-b24e-4047e5f56934
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975366/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975366>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614ed850>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO68PXJ%252F698975406%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975406/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 50c3f397-3666-5802-9240-95b43afdce21
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a01490>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ65LKG%252F699010736%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010736/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26623def-55ab-5dd0-bf5f-2b44624045f6
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a02ed0>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB06FEG%252F699432952%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432952/600 saved to cache
2026-03-29 22:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a15dc9f-1f43-5f77-8956-0299042e5086
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443637/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10GHA/42812411?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=2se60G1wBkZioFdObKgvGGniCfo4KXU1Bg2UVTzdQU8%3D)
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392014/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392014>
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443630/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443630>
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253942/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699253942>
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975342/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975342>
2026-03-29 22:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435113/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BN62UZG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444735/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV10WYJ/42812387?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=rKDmdlJ%2FaZkUq5BixfEsoLqiph02L2tEANiTYwZbhJk%3D)
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61518850>
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10GHA%252F699443653%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443653/600 saved to cache
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec08eddb-f63d-54e1-9917-94a9b51f829d
2026-03-29 22:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426188/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426188>
2026-03-29 22:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251875/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251875>
2026-03-29 22:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400464/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400464>
2026-03-29 22:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250312/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250312>
2026-03-29 22:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO18HDJ/42812337?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=7zkw1LAtX28kbpKc8v0GGPH11HgeuBJHeW%2BxRsmaah0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO18%20HDJ-GB>
2026-03-29 22:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS67KOJ/42812258?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=Xm69PtzN%2BBnKxoFjkJhsbVPepgGsc73VtaLOevozILc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DS67%20KOJ-GB>
2026-03-29 22:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL20LHD/42812275?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=ElATRSfNmgbyQQ%2FbGpFTKljViqBmS3m9jzeV%2F0ESWho%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NL20%20LHD-GB>
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611a1310>
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV10WYJ%252F699433777%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699433777/600 saved to cache
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c49bd93f-51dc-5a81-b24e-4047e5f56934
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b1150>
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT65OEM%252F699253962%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253962/600 saved to cache
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61539dd0>
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB06FEG%252F699432936%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432936/600 saved to cache
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a15dc9f-1f43-5f77-8956-0299042e5086
2026-03-29 22:02:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a15dc9f-1f43-5f77-8956-0299042e5086, skipping ID generation
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a15dc9f-1f43-5f77-8956-0299042e5086 sending to next pipeline
2026-03-29 22:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5a15dc9f-1f43-5f77-8956-0299042e5086, identifier: LB06%20FEG
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61044cd0>
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEJ65LKG%252F699010717%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010717/600 saved to cache
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26623def-55ab-5dd0-bf5f-2b44624045f6
2026-03-29 22:02:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26623def-55ab-5dd0-bf5f-2b44624045f6, skipping ID generation
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26623def-55ab-5dd0-bf5f-2b44624045f6 sending to next pipeline
2026-03-29 22:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 26623def-55ab-5dd0-bf5f-2b44624045f6, identifier: EJ65%20LKG
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac684cad10>
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO68PXJ%252F698975385%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975385/600 saved to cache
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 50c3f397-3666-5802-9240-95b43afdce21
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621b8750>
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV10WYJ%252F699444741%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444741/600 saved to cache
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c49bd93f-51dc-5a81-b24e-4047e5f56934
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a03f90>
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10GHA%252F699443645%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443645/600 saved to cache
2026-03-29 22:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec08eddb-f63d-54e1-9917-94a9b51f829d
2026-03-29 22:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL15GPF/42812349?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=wTakz0Cc7tufeyH2%2BCZORtgoUt72o3v%2Fn7wL9C24HQg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BL15%20GPF-GB>
2026-03-29 22:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5a15dc9f-1f43-5f77-8956-0299042e5086 with identifier: LB06%20FEG
2026-03-29 22:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5a15dc9f-1f43-5f77-8956-0299042e5086 with identifier: LB06%20FEG
2026-03-29 22:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5a15dc9f-1f43-5f77-8956-0299042e5086 with identifier: LB06%20FEG to the API
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432936/600>
{'auction_title': '',
'c_o_2_emission_value': 176,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_expert_report_file_0843340b-e03f-46d8-ad62-0db39ee54680.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LB06%20FEG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5a15dc9f-1f43-5f77-8956-0299042e5086',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LB06 FEG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LB06%20FEG&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'PEUGEOT',
'model': '206',
'odometer': 67566,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39519,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432936/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39862,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432952/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38362,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432965/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36784,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432981/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34639,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699432994/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34961,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433052/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103459,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433079/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86444,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433098/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92997,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433112/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a15dc9f-1f43-5f77-8956-0299042e5086/5a15dc9f-1f43-5f77-8956-0299042e5086_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71986,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB06FEG/699433129/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'PEUGEOT 206 1.6 16V SPORT3 Hatchback',
'transmission': 'manual',
'trim': '16V SPORT3',
'vin': 'VF32HNFUB47576320',
'year': 2006}
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB06%2520FEG%27 HTTP/1.1" 200 None
2026-03-29 22:02:37 [bca.uk] INFO: Saving data for LB06%20FEG: {'created_time': 1774821757.101661, 'last_price_update_time': 1774821757.10167, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LB06%2520FEG') HTTP/1.1" 204 0
2026-03-29 22:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 26623def-55ab-5dd0-bf5f-2b44624045f6 with identifier: EJ65%20LKG
2026-03-29 22:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 26623def-55ab-5dd0-bf5f-2b44624045f6 with identifier: EJ65%20LKG
2026-03-29 22:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 26623def-55ab-5dd0-bf5f-2b44624045f6 with identifier: EJ65%20LKG to the API
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010717/600>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_expert_report_file_b121b86e-e316-4315-a74a-90a3c1ec5bf5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ65%20LKG-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '26623def-55ab-5dd0-bf5f-2b44624045f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EJ65 LKG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EJ65%20LKG&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'DS AUTOMOBILES',
'model': 'DS 4',
'odometer': 68103,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50445,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010717/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49045,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010736/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49239,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010757/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50024,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010778/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47044,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010805/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47007,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010840/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82584,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010883/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80375,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010912/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88304,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010938/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26623def-55ab-5dd0-bf5f-2b44624045f6/26623def-55ab-5dd0-bf5f-2b44624045f6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77977,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EJ65LKG/699010962/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'DS AUTOMOBILES DS 4 2.0 BLUEHDI 180 PRESTIGE EAT6 Hatchback',
'transmission': 'automatic',
'trim': 'BLUEHDI 180 PRESTIGE EAT6',
'vin': 'VF7NXAHWTFY562148',
'year': 2015}
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ65%2520LKG%27 HTTP/1.1" 200 None
2026-03-29 22:02:37 [bca.uk] INFO: Saving data for EJ65%20LKG: {'created_time': 1774821757.467225, 'last_price_update_time': 1774821757.467236, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EJ65%2520LKG') HTTP/1.1" 204 0
2026-03-29 22:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637c4f50>
2026-03-29 22:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10GHA%252F699443637%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443637/600 saved to cache
2026-03-29 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec08eddb-f63d-54e1-9917-94a9b51f829d
2026-03-29 22:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61063e90>
2026-03-29 22:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV10WYJ%252F699444735%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444735/600 saved to cache
2026-03-29 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c49bd93f-51dc-5a81-b24e-4047e5f56934
2026-03-29 22:02:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c49bd93f-51dc-5a81-b24e-4047e5f56934, skipping ID generation
2026-03-29 22:02:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c49bd93f-51dc-5a81-b24e-4047e5f56934 sending to next pipeline
2026-03-29 22:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c49bd93f-51dc-5a81-b24e-4047e5f56934, identifier: SV10%20WYJ
2026-03-29 22:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392014/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT64GVX/42811943?sv=2020-08-04&st=2026-03-29T22%3A01%3A40Z&se=2026-03-29T22%3A26%3A40Z&sr=b&sp=r&sig=cep50iJLm5T2T%2FJIF3KYJUQN262Xx397yLSJF4VsirI%3D)
2026-03-29 22:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975366/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO68PXJ/42810644?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=AjrHe%2FZzg02A19bIAPXt9iYd3%2FKnTUKNfDQ2oVTOXpo%3D)
2026-03-29 22:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435113/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN62UZG/42812357?sv=2020-08-04&st=2026-03-29T22%3A01%3A45Z&se=2026-03-29T22%3A26%3A45Z&sr=b&sp=r&sig=X9pErQDsrXNy4qMwHp8m59UtcG5VKGVtuCOpQCnsZBk%3D)
2026-03-29 22:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975342/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO68PXJ/42810644?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=AjrHe%2FZzg02A19bIAPXt9iYd3%2FKnTUKNfDQ2oVTOXpo%3D)
2026-03-29 22:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250294/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250294>
2026-03-29 22:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443630/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10GHA/42812411?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=2se60G1wBkZioFdObKgvGGniCfo4KXU1Bg2UVTzdQU8%3D)
2026-03-29 22:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253942/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT65OEM/42801591?sv=2020-08-04&st=2026-03-29T22%3A02%3A22Z&se=2026-03-29T22%3A27%3A22Z&sr=b&sp=r&sig=C86xu7kOSIOpI5tq1qwr9sVc1ocdKllXBj4HnJhS92A%3D)
2026-03-29 22:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c49bd93f-51dc-5a81-b24e-4047e5f56934 with identifier: SV10%20WYJ
2026-03-29 22:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c49bd93f-51dc-5a81-b24e-4047e5f56934 with identifier: SV10%20WYJ
2026-03-29 22:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c49bd93f-51dc-5a81-b24e-4047e5f56934 with identifier: SV10%20WYJ to the API
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444735/600>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_expert_report_file_e31f13d2-a50b-44b9-a092-4eae279c07f1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV10%20WYJ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c49bd93f-51dc-5a81-b24e-4047e5f56934',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV10 WYJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV10%20WYJ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 183859,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39018,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444735/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37827,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444741/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186137,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699433777/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38804,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444749/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187580,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699433778/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40919,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444758/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196593,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699433780/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38028,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444769/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 162565,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699433782/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c49bd93f-51dc-5a81-b24e-4047e5f56934/c49bd93f-51dc-5a81-b24e-4047e5f56934_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36253,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV10WYJ/699444776/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.2 N-TEC Hatchback',
'transmission': 'automatic',
'trim': 'N-TEC',
'vin': 'SJNFBAK12U3192102',
'year': 2010}
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV10%2520WYJ%27 HTTP/1.1" 200 None
2026-03-29 22:02:38 [bca.uk] INFO: Saving data for SV10%20WYJ: {'created_time': 1774821758.097561, 'last_price_update_time': 1774821758.097573, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV10%2520WYJ') HTTP/1.1" 204 0
2026-03-29 22:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251858/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251858>
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6118d690>
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT64GVX%252F699392014%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392014/600 saved to cache
2026-03-29 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65250f67-b63f-5f19-a165-a7afa44cd815
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63546390>
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO68PXJ%252F698975366%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975366/600 saved to cache
2026-03-29 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 50c3f397-3666-5802-9240-95b43afdce21
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62087a10>
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN62UZG%252F699435113%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435113/600 saved to cache
2026-03-29 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0b17972-5ab7-56c0-825d-14139cf5492c
2026-03-29 22:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0b17972-5ab7-56c0-825d-14139cf5492c, skipping ID generation
2026-03-29 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0b17972-5ab7-56c0-825d-14139cf5492c sending to next pipeline
2026-03-29 22:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f0b17972-5ab7-56c0-825d-14139cf5492c, identifier: BN62%20UZG
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637d2310>
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO68PXJ%252F698975342%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975342/600 saved to cache
2026-03-29 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 50c3f397-3666-5802-9240-95b43afdce21
2026-03-29 22:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50c3f397-3666-5802-9240-95b43afdce21, skipping ID generation
2026-03-29 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50c3f397-3666-5802-9240-95b43afdce21 sending to next pipeline
2026-03-29 22:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 50c3f397-3666-5802-9240-95b43afdce21, identifier: AO68%20PXJ
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620fe1d0>
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10GHA%252F699443630%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443630/600 saved to cache
2026-03-29 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec08eddb-f63d-54e1-9917-94a9b51f829d
2026-03-29 22:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec08eddb-f63d-54e1-9917-94a9b51f829d, skipping ID generation
2026-03-29 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec08eddb-f63d-54e1-9917-94a9b51f829d sending to next pipeline
2026-03-29 22:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ec08eddb-f63d-54e1-9917-94a9b51f829d, identifier: EK10%20GHA
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63638e10>
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT65OEM%252F699253942%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253942/600 saved to cache
2026-03-29 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c
2026-03-29 22:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c, skipping ID generation
2026-03-29 22:02:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c sending to next pipeline
2026-03-29 22:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c, identifier: YT65%20OEM
2026-03-29 22:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f0b17972-5ab7-56c0-825d-14139cf5492c with identifier: BN62%20UZG
2026-03-29 22:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f0b17972-5ab7-56c0-825d-14139cf5492c with identifier: BN62%20UZG
2026-03-29 22:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f0b17972-5ab7-56c0-825d-14139cf5492c with identifier: BN62%20UZG to the API
2026-03-29 22:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435113/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_expert_report_file_6efc9d43-76d4-4c65-99ed-eac49e447b6c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BN62%20UZG-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f0b17972-5ab7-56c0-825d-14139cf5492c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BN62 UZG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BN62%20UZG&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 122867,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37258,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435113/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37982,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435117/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43634,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699432935/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37246,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435125/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42280,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699432946/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36241,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435133/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41434,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699432959/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32772,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435140/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40222,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699432980/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b17972-5ab7-56c0-825d-14139cf5492c/f0b17972-5ab7-56c0-825d-14139cf5492c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33138,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN62UZG/699435147/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.6 TDI 105 MATCH Hatchback',
'transmission': 'manual',
'trim': 'TDI 105 MATCH',
'vin': 'WVWZZZ1KZDP034508',
'year': 2012}
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN62%2520UZG%27 HTTP/1.1" 200 None
2026-03-29 22:02:39 [bca.uk] INFO: Saving data for BN62%20UZG: {'created_time': 1774821759.175595, 'last_price_update_time': 1774821759.175605, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BN62%2520UZG') HTTP/1.1" 204 0
2026-03-29 22:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 50c3f397-3666-5802-9240-95b43afdce21 with identifier: AO68%20PXJ
2026-03-29 22:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 50c3f397-3666-5802-9240-95b43afdce21 with identifier: AO68%20PXJ
2026-03-29 22:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 50c3f397-3666-5802-9240-95b43afdce21 with identifier: AO68%20PXJ to the API
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975342/600>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_expert_report_file_8c0011af-a016-423f-a4f7-0b40473bb7a2.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO68%20PXJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': '50c3f397-3666-5802-9240-95b43afdce21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AO68 PXJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AO68%20PXJ&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'MERCEDES-BENZ',
'model': 'CLA 200',
'odometer': 47305,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45996,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975317/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44194,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975342/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42735,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975366/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40252,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975385/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36795,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975406/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36527,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975430/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61654,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975455/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61321,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975481/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78577,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975508/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50c3f397-3666-5802-9240-95b43afdce21/50c3f397-3666-5802-9240-95b43afdce21_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79428,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO68PXJ/698975538/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLA 200 1.6 AMG LINE NIGHT ED.PLUS Coupe',
'transmission': 'manual',
'trim': 'AMG LINE NIGHT ED.PLUS',
'vin': 'WDD1173432N742428',
'year': 2018}
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO68%2520PXJ%27 HTTP/1.1" 200 None
2026-03-29 22:02:39 [bca.uk] INFO: Saving data for AO68%20PXJ: {'created_time': 1774821759.573303, 'last_price_update_time': 1774821759.573314, 'auction_closing_time': 1775124000.0}
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AO68%2520PXJ') HTTP/1.1" 204 0
2026-03-29 22:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ec08eddb-f63d-54e1-9917-94a9b51f829d with identifier: EK10%20GHA
2026-03-29 22:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ec08eddb-f63d-54e1-9917-94a9b51f829d with identifier: EK10%20GHA
2026-03-29 22:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ec08eddb-f63d-54e1-9917-94a9b51f829d with identifier: EK10%20GHA to the API
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443630/600>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_expert_report_file_28f3469a-ca3c-4378-a991-111a2e4e8947.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK10%20GHA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.1L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ec08eddb-f63d-54e1-9917-94a9b51f829d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EK10 GHA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EK10%20GHA&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MERCEDES-BENZ',
'model': 'CLC 220',
'odometer': 145494,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40314,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443627/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39615,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443630/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38306,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443637/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37055,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443645/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32174,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443653/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31630,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443656/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443665/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62360,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443675/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74741,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443682/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec08eddb-f63d-54e1-9917-94a9b51f829d/ec08eddb-f63d-54e1-9917-94a9b51f829d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60204,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10GHA/699443690/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLC 220 2.1 CDI SPORT Coupe',
'transmission': 'manual',
'trim': 'CDI SPORT',
'vin': 'WDB2037082E079722',
'year': 2010}
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK10%2520GHA%27 HTTP/1.1" 200 None
2026-03-29 22:02:39 [bca.uk] INFO: Saving data for EK10%20GHA: {'created_time': 1774821759.949617, 'last_price_update_time': 1774821759.949629, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EK10%2520GHA') HTTP/1.1" 204 0
2026-03-29 22:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c with identifier: YT65%20OEM
2026-03-29 22:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c with identifier: YT65%20OEM
2026-03-29 22:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c with identifier: YT65%20OEM to the API
2026-03-29 22:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253942/600>
{'auction_title': '',
'c_o_2_emission_value': 122,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_expert_report_file_c7213687-21c6-45c9-8d03-2f08acc8a462.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YT65%20OEM-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YT65 OEM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YT65%20OEM&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 41167,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40851,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253934/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39736,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253942/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40511,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253949/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42056,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253955/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36536,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253962/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33772,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253967/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90208,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253979/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72133,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253991/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78149,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699253998/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c/2dd2f6f6-6485-5bb9-90f6-0b7dbeddcf2c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86173,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT65OEM/699254008/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 STUDIO Hatchback',
'transmission': 'manual',
'trim': 'STUDIO',
'vin': 'WF0CXXGAKCFT51180',
'year': 2015}
2026-03-29 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT65%2520OEM%27 HTTP/1.1" 200 None
2026-03-29 22:02:40 [bca.uk] INFO: Saving data for YT65%20OEM: {'created_time': 1774821760.342219, 'last_price_update_time': 1774821760.342231, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YT65%2520OEM') HTTP/1.1" 204 0
2026-03-29 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400464/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT64BWF/42812128?sv=2020-08-04&st=2026-03-29T22%3A01%3A41Z&se=2026-03-29T22%3A26%3A41Z&sr=b&sp=r&sig=MzwyyqM%2Fq9XpCMHPmp7VRaX08ubizr8jYVfx3e066Lo%3D)
2026-03-29 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251875/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66SVX/42805972?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=yl9q46AoV3wQNjXIFCNniksZeCLN9BE%2FANgZ6Iluhps%3D)
2026-03-29 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250312/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX05YUG/42800121?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=MySGDJ66pbFCM8Of63GwPM4lST90Oc%2FUCupYTeM%2FDJ0%3D)
2026-03-29 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426188/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX68ORU/42812293?sv=2020-08-04&st=2026-03-29T22%3A01%3A38Z&se=2026-03-29T22%3A26%3A38Z&sr=b&sp=r&sig=dTIgs41eJnjcU89aOFdmMmWrmPHqSDyWtMj1MxYIWm4%3D)
2026-03-29 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS67KOJ/42812258?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=Xm69PtzN%2BBnKxoFjkJhsbVPepgGsc73VtaLOevozILc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL15GPF/42812349?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=wTakz0Cc7tufeyH2%2BCZORtgoUt72o3v%2Fn7wL9C24HQg%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL20LHD/42812275?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=ElATRSfNmgbyQQ%2FbGpFTKljViqBmS3m9jzeV%2F0ESWho%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO18HDJ/42812337?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=7zkw1LAtX28kbpKc8v0GGPH11HgeuBJHeW%2BxRsmaah0%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250273/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250273>
2026-03-29 22:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251845/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251845>
2026-03-29 22:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426130/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426130>
2026-03-29 22:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV18WBP/42812309?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=S3te%2FtGYnRzy00zjQEu2UP8P%2FzNu2cMFNbkuAlv%2Bjsw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV18%20WBP-GB>
2026-03-29 22:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392008/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392008>
2026-03-29 22:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VU17ESV/42812251?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=TLugECzq9XNhXhCdRnpdn25J387wr1DHk7dj29O2ZH4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VU17%20ESV-GB>
2026-03-29 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250294/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX05YUG/42800121?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=MySGDJ66pbFCM8Of63GwPM4lST90Oc%2FUCupYTeM%2FDJ0%3D)
2026-03-29 22:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251858/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66SVX/42805972?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=yl9q46AoV3wQNjXIFCNniksZeCLN9BE%2FANgZ6Iluhps%3D)
2026-03-29 22:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6351f7d0>
2026-03-29 22:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT64BWF%252F699400464%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400464/600 saved to cache
2026-03-29 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c286c031-4c72-5d7f-8c06-04157dc85649
2026-03-29 22:02:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c286c031-4c72-5d7f-8c06-04157dc85649, skipping ID generation
2026-03-29 22:02:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c286c031-4c72-5d7f-8c06-04157dc85649 sending to next pipeline
2026-03-29 22:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c286c031-4c72-5d7f-8c06-04157dc85649, identifier: LT64%20BWF
2026-03-29 22:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c286c031-4c72-5d7f-8c06-04157dc85649 with identifier: LT64%20BWF
2026-03-29 22:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c286c031-4c72-5d7f-8c06-04157dc85649 with identifier: LT64%20BWF
2026-03-29 22:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c286c031-4c72-5d7f-8c06-04157dc85649 with identifier: LT64%20BWF to the API
2026-03-29 22:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400464/600>
{'auction_title': '',
'c_o_2_emission_value': 172,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_expert_report_file_013874a4-58a1-4121-8c39-5732ce8ba4e4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT64%20BWF-GB',
'category': 'LightCommercialVehicle',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c286c031-4c72-5d7f-8c06-04157dc85649',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT64 BWF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT64%20BWF&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'TOURNEO CUSTOM',
'odometer': 79100,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48050,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400450/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43798,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400458/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42397,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400464/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43318,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400468/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46585,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400473/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43158,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400478/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101473,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400484/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84233,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400489/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95157,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400494/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c286c031-4c72-5d7f-8c06-04157dc85649/c286c031-4c72-5d7f-8c06-04157dc85649_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74189,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT64BWF/699400498/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD TOURNEO CUSTOM 2.2 TDCI 125 300 LWB LIMITED L/R Bus',
'transmission': 'manual',
'trim': 'TDCI 125 300 LWB LIMITED L/R',
'vin': 'WF03XXTTG3EL49510',
'year': 2014}
2026-03-29 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT64%2520BWF%27 HTTP/1.1" 200 None
2026-03-29 22:02:40 [bca.uk] INFO: Saving data for LT64%20BWF: {'created_time': 1774821760.999711, 'last_price_update_time': 1774821760.999722, 'auction_closing_time': 1775037600.0}
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT64%2520BWF') HTTP/1.1" 204 0
2026-03-29 22:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388482/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388482>
2026-03-29 22:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388498/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388498>
2026-03-29 22:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250248/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250248>
2026-03-29 22:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV18BTX/42812340?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=%2Bezp23zAvj2j8ibvjS%2BYNxY8QBFXj1q86XU9oqLT%2FMg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GV18%20BTX-GB>
2026-03-29 22:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/IXZ8865/42812392?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=d1AmjTDOgXlra09ci3%2FHXBYVklGZHl9eLV2qz%2Fpe%2BBc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=IXZ%208865-GB>
2026-03-29 22:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392002/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MT64GVX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251827/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251827>
2026-03-29 22:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP06LGD/42812325?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=stINPqP%2FwDQAFMKNCdBc5N5m6v7PXR2E3EUk%2B9QFqEM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP06%20LGD-GB>
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6368ff90>
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66SVX%252F699251875%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251875/600 saved to cache
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 392ba6d2-142e-521e-9c14-6f3c87e57d15
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6207b6d0>
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX05YUG%252F699250312%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250312/600 saved to cache
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f8e435e-d477-50a3-aea7-4952aa2ce397
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6368f550>
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX68ORU%252F699426188%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426188/600 saved to cache
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0556e924-104a-5552-a701-fc5b5327996f
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6207a5d0>
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_expert_report_file_f1c423d2-7084-43d5-afa4-113deae7b875.pdf HTTP/1.1" 201 0
2026-03-29 22:02:41 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1059463b-3c93-584e-a414-d6327bf60ecc
2026-03-29 22:02:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1059463b-3c93-584e-a414-d6327bf60ecc, skipping ID generation
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1059463b-3c93-584e-a414-d6327bf60ecc
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDS67KOJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DS67KOJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620a8050>
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_expert_report_file_4a5d5833-62ff-46f2-8402-6981e9848439.pdf HTTP/1.1" 201 0
2026-03-29 22:02:41 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d69b9e39-94d5-5512-b4c2-1dbe0861f944
2026-03-29 22:02:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d69b9e39-94d5-5512-b4c2-1dbe0861f944, skipping ID generation
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d69b9e39-94d5-5512-b4c2-1dbe0861f944
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBL15GPF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BL15GPF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61023ad0>
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_expert_report_file_0dc0e6e7-da07-4e33-9dea-2bde6e8e82ca.pdf HTTP/1.1" 201 0
2026-03-29 22:02:41 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 567aca6a-4739-5529-95c7-9434b19eb603
2026-03-29 22:02:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 567aca6a-4739-5529-95c7-9434b19eb603, skipping ID generation
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 567aca6a-4739-5529-95c7-9434b19eb603
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNL20LHD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NL20LHD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6224ed50>
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_expert_report_file_5190959c-24cb-400b-8a64-f5b4d5f565aa.pdf HTTP/1.1" 201 0
2026-03-29 22:02:41 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bdab8438-e5c7-52d5-82d4-2d0efd86d463
2026-03-29 22:02:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bdab8438-e5c7-52d5-82d4-2d0efd86d463, skipping ID generation
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bdab8438-e5c7-52d5-82d4-2d0efd86d463
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLO18HDJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LO18HDJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611cbe50>
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX05YUG%252F699250294%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250294/600 saved to cache
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f8e435e-d477-50a3-aea7-4952aa2ce397
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62079490>
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66SVX%252F699251858%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251858/600 saved to cache
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 392ba6d2-142e-521e-9c14-6f3c87e57d15
2026-03-29 22:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392008/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT64GVX/42811943?sv=2020-08-04&st=2026-03-29T22%3A01%3A40Z&se=2026-03-29T22%3A26%3A40Z&sr=b&sp=r&sig=cep50iJLm5T2T%2FJIF3KYJUQN262Xx397yLSJF4VsirI%3D)
2026-03-29 22:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426130/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX68ORU/42812293?sv=2020-08-04&st=2026-03-29T22%3A01%3A38Z&se=2026-03-29T22%3A26%3A38Z&sr=b&sp=r&sig=dTIgs41eJnjcU89aOFdmMmWrmPHqSDyWtMj1MxYIWm4%3D)
2026-03-29 22:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388471/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388471>
2026-03-29 22:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426103/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426103>
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422947%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422947 not downloaded yet
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699432938%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432938 not downloaded yet
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015378%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015378 not downloaded yet
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145349%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145349 not downloaded yet
2026-03-29 22:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251845/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66SVX/42805972?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=yl9q46AoV3wQNjXIFCNniksZeCLN9BE%2FANgZ6Iluhps%3D)
2026-03-29 22:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250273/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX05YUG/42800121?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=MySGDJ66pbFCM8Of63GwPM4lST90Oc%2FUCupYTeM%2FDJ0%3D)
2026-03-29 22:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VU17ESV/42812251?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=TLugECzq9XNhXhCdRnpdn25J387wr1DHk7dj29O2ZH4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV18WBP/42812309?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=S3te%2FtGYnRzy00zjQEu2UP8P%2FzNu2cMFNbkuAlv%2Bjsw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422952%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422952 not downloaded yet
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699432955%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432955 not downloaded yet
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015394%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015394 not downloaded yet
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145355%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145355 not downloaded yet
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422958%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422958 not downloaded yet
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699432975%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432975 not downloaded yet
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015410%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015410 not downloaded yet
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145362%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145362 not downloaded yet
2026-03-29 22:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251827/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66SVX/42805972?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=yl9q46AoV3wQNjXIFCNniksZeCLN9BE%2FANgZ6Iluhps%3D)
2026-03-29 22:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392002/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT64GVX/42811943?sv=2020-08-04&st=2026-03-29T22%3A01%3A40Z&se=2026-03-29T22%3A26%3A40Z&sr=b&sp=r&sig=cep50iJLm5T2T%2FJIF3KYJUQN262Xx397yLSJF4VsirI%3D)
2026-03-29 22:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250248/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX05YUG/42800121?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=MySGDJ66pbFCM8Of63GwPM4lST90Oc%2FUCupYTeM%2FDJ0%3D)
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422965%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422965 not downloaded yet
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699432991%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432991 not downloaded yet
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015428%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015428 not downloaded yet
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145368%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145368 not downloaded yet
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69bf0650>
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT64GVX%252F699392008%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392008/600 saved to cache
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65250f67-b63f-5f19-a165-a7afa44cd815
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632f3950>
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX68ORU%252F699426130%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426130/600 saved to cache
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0556e924-104a-5552-a701-fc5b5327996f
2026-03-29 22:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388498/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68OTW/42811886?sv=2020-08-04&st=2026-03-29T22%3A01%3A29Z&se=2026-03-29T22%3A26%3A29Z&sr=b&sp=r&sig=fuk2ajppUL%2BpY5Jq%2BLDEOSIJIqcNrPdxnkllkXnrnUc%3D)
2026-03-29 22:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388482/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68OTW/42811886?sv=2020-08-04&st=2026-03-29T22%3A01%3A29Z&se=2026-03-29T22%3A26%3A29Z&sr=b&sp=r&sig=fuk2ajppUL%2BpY5Jq%2BLDEOSIJIqcNrPdxnkllkXnrnUc%3D)
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422972%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422972 not downloaded yet
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699433009%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433009 not downloaded yet
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015444%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015444 not downloaded yet
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145375%27 HTTP/1.1" 200 None
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145375 not downloaded yet
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62260210>
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66SVX%252F699251845%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251845/600 saved to cache
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 392ba6d2-142e-521e-9c14-6f3c87e57d15
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac60fef550>
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX05YUG%252F699250273%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250273/600 saved to cache
2026-03-29 22:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f8e435e-d477-50a3-aea7-4952aa2ce397
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6116ae90>
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_expert_report_file_b07019e6-1088-4db8-bced-95613f362664.pdf HTTP/1.1" 201 0
2026-03-29 22:02:42 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8b771c8f-dd52-56d3-87b9-72b4d2130708
2026-03-29 22:02:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b771c8f-dd52-56d3-87b9-72b4d2130708, skipping ID generation
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b771c8f-dd52-56d3-87b9-72b4d2130708
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVU17ESV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VU17ESV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618f4790>
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_expert_report_file_ebfecfc1-6547-4984-bc2b-a21884e11538.pdf HTTP/1.1" 201 0
2026-03-29 22:02:42 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1c168010-7a7e-5fdd-b0cd-fac1fdc97858
2026-03-29 22:02:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c168010-7a7e-5fdd-b0cd-fac1fdc97858, skipping ID generation
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1c168010-7a7e-5fdd-b0cd-fac1fdc97858
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHV18WBP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HV18WBP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/IXZ8865/42812392?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=d1AmjTDOgXlra09ci3%2FHXBYVklGZHl9eLV2qz%2Fpe%2BBc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145342/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LO18HDJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426103/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX68ORU/42812293?sv=2020-08-04&st=2026-03-29T22%3A01%3A38Z&se=2026-03-29T22%3A26%3A38Z&sr=b&sp=r&sig=dTIgs41eJnjcU89aOFdmMmWrmPHqSDyWtMj1MxYIWm4%3D)
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422980%27 HTTP/1.1" 200 None
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422980 not downloaded yet
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699433036%27 HTTP/1.1" 200 None
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433036 not downloaded yet
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015471%27 HTTP/1.1" 200 None
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015471 not downloaded yet
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145392%27 HTTP/1.1" 200 None
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145392 not downloaded yet
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422949%27 HTTP/1.1" 200 None
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422949 not downloaded yet
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022837%27 HTTP/1.1" 200 None
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022837 not downloaded yet
2026-03-29 22:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388471/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68OTW/42811886?sv=2020-08-04&st=2026-03-29T22%3A01%3A29Z&se=2026-03-29T22%3A26%3A29Z&sr=b&sp=r&sig=fuk2ajppUL%2BpY5Jq%2BLDEOSIJIqcNrPdxnkllkXnrnUc%3D)
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618f6910>
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66SVX%252F699251827%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251827/600 saved to cache
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 392ba6d2-142e-521e-9c14-6f3c87e57d15
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61837f10>
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT64GVX%252F699392002%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392002/600 saved to cache
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65250f67-b63f-5f19-a165-a7afa44cd815
2026-03-29 22:02:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65250f67-b63f-5f19-a165-a7afa44cd815, skipping ID generation
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65250f67-b63f-5f19-a165-a7afa44cd815 sending to next pipeline
2026-03-29 22:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 65250f67-b63f-5f19-a165-a7afa44cd815, identifier: MT64%20GVX
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac684a6090>
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX05YUG%252F699250248%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250248/600 saved to cache
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f8e435e-d477-50a3-aea7-4952aa2ce397
2026-03-29 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61935d10>
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68OTW%252F699388498%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388498/600 saved to cache
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4
2026-03-29 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63724790>
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68OTW%252F699388482%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388482/600 saved to cache
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4
2026-03-29 22:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV18BTX/42812340?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=%2Bezp23zAvj2j8ibvjS%2BYNxY8QBFXj1q86XU9oqLT%2FMg%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015364/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NL20LHD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422942/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DS67KOJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432929/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BL15GPF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422991%27 HTTP/1.1" 200 None
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422991 not downloaded yet
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699433051%27 HTTP/1.1" 200 None
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433051 not downloaded yet
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015500%27 HTTP/1.1" 200 None
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015500 not downloaded yet
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145401%27 HTTP/1.1" 200 None
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145401 not downloaded yet
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422955%27 HTTP/1.1" 200 None
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422955 not downloaded yet
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022846%27 HTTP/1.1" 200 None
2026-03-29 22:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022846 not downloaded yet
2026-03-29 22:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 65250f67-b63f-5f19-a165-a7afa44cd815 with identifier: MT64%20GVX
2026-03-29 22:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 65250f67-b63f-5f19-a165-a7afa44cd815 with identifier: MT64%20GVX
2026-03-29 22:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 65250f67-b63f-5f19-a165-a7afa44cd815 with identifier: MT64%20GVX to the API
2026-03-29 22:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392002/600>
{'auction_title': '',
'c_o_2_emission_value': 227,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_expert_report_file_11d605b0-43fd-4596-be8b-2e85d6d6f8c9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT64%20GVX-GB',
'category': 'LightCommercialVehicle',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '65250f67-b63f-5f19-a165-a7afa44cd815',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT64 GVX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT64%20GVX&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'TOYOTA',
'model': 'HILUX',
'odometer': 198653,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47329,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392002/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47001,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392005/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47315,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392008/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44677,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392010/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40758,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392011/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41782,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392014/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74284,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392017/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68805,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392022/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82027,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392026/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65250f67-b63f-5f19-a165-a7afa44cd815/65250f67-b63f-5f19-a165-a7afa44cd815_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80184,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT64GVX/699392030/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'TOYOTA HILUX 3.0 D-4D 171 INVINCIBLE 4WD CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'D-4D 171 INVINCIBLE 4WD',
'vin': 'AHTFZ29G109120822',
'year': 2014}
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT64%2520GVX%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [bca.uk] INFO: Saving data for MT64%20GVX: {'created_time': 1774821763.142044, 'last_price_update_time': 1774821763.142053, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT64%2520GVX') HTTP/1.1" 204 0
2026-03-29 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP06LGD/42812325?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=stINPqP%2FwDQAFMKNCdBc5N5m6v7PXR2E3EUk%2B9QFqEM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145362/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145362>
2026-03-29 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145349/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145349>
2026-03-29 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015378/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015378>
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422998%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422998 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699433068%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433068 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015529%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015529 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145409%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145409 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422960%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422960 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022862%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022862 not downloaded yet
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63779a90>
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_expert_report_file_5fa0ef97-dc30-4162-92a6-2750ab6af37b.pdf HTTP/1.1" 201 0
2026-03-29 22:02:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2d19e50d-f395-509a-9c03-74299fc0a339
2026-03-29 22:02:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d19e50d-f395-509a-9c03-74299fc0a339, skipping ID generation
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d19e50d-f395-509a-9c03-74299fc0a339
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DIXZ8865-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=IXZ8865-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610045d0>
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX68ORU%252F699426103%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426103/600 saved to cache
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0556e924-104a-5552-a701-fc5b5327996f
2026-03-29 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62130610>
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68OTW%252F699388471%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388471/600 saved to cache
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4
2026-03-29 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015428/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015428>
2026-03-29 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015410/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015410>
2026-03-29 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145368/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145368>
2026-03-29 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432975/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432975>
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699423003%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699423003 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699433087%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433087 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015737%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015737 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145416%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145416 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422967%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422967 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022870%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022870 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440262%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440262 not downloaded yet
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61bbd110>
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_expert_report_file_2aaca5db-1be6-43bd-9dc7-a19f4487da23.pdf HTTP/1.1" 201 0
2026-03-29 22:02:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9f452a12-ff71-5168-a92c-5282beaef88c
2026-03-29 22:02:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f452a12-ff71-5168-a92c-5282beaef88c, skipping ID generation
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f452a12-ff71-5168-a92c-5282beaef88c
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGV18BTX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GV18BTX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145342/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO18HDJ/42812337?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=7zkw1LAtX28kbpKc8v0GGPH11HgeuBJHeW%2BxRsmaah0%3D)
2026-03-29 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432991/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432991>
2026-03-29 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022826/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HV18WBP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422973%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422973 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022881%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022881 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440269%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440269 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022703%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022703 not downloaded yet
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6102f290>
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_expert_report_file_c5386c95-1447-4d4a-b584-b89735859754.pdf HTTP/1.1" 201 0
2026-03-29 22:02:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bd537952-b4a0-5a83-afdd-36c493417154
2026-03-29 22:02:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd537952-b4a0-5a83-afdd-36c493417154, skipping ID generation
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd537952-b4a0-5a83-afdd-36c493417154
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWP06LGD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WP06LGD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015364/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL20LHD/42812275?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=ElATRSfNmgbyQQ%2FbGpFTKljViqBmS3m9jzeV%2F0ESWho%3D)
2026-03-29 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432929/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL15GPF/42812349?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=wTakz0Cc7tufeyH2%2BCZORtgoUt72o3v%2Fn7wL9C24HQg%3D)
2026-03-29 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422942/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS67KOJ/42812258?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=Xm69PtzN%2BBnKxoFjkJhsbVPepgGsc73VtaLOevozILc%3D)
2026-03-29 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022837/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022837>
2026-03-29 22:02:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422944/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VU17ESV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422982%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422982 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022902%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022902 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440278%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440278 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022712%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022712 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031026%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031026 not downloaded yet
2026-03-29 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015378/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL20LHD/42812275?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=ElATRSfNmgbyQQ%2FbGpFTKljViqBmS3m9jzeV%2F0ESWho%3D)
2026-03-29 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145362/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO18HDJ/42812337?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=7zkw1LAtX28kbpKc8v0GGPH11HgeuBJHeW%2BxRsmaah0%3D)
2026-03-29 22:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145349/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO18HDJ/42812337?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=7zkw1LAtX28kbpKc8v0GGPH11HgeuBJHeW%2BxRsmaah0%3D)
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422987%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422987 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022926%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022926 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440285%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440285 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022723%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022723 not downloaded yet
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031035%27 HTTP/1.1" 200 None
2026-03-29 22:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031035 not downloaded yet
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6184c110>
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO18HDJ%252F699145342%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145342/600 saved to cache
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bdab8438-e5c7-52d5-82d4-2d0efd86d463
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6981cc90>
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL20LHD%252F699015364%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015364/600 saved to cache
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 567aca6a-4739-5529-95c7-9434b19eb603
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a74090>
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL15GPF%252F699432929%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432929/600 saved to cache
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d69b9e39-94d5-5512-b4c2-1dbe0861f944
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61643bd0>
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS67KOJ%252F699422942%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422942/600 saved to cache
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1059463b-3c93-584e-a414-d6327bf60ecc
2026-03-29 22:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015410/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL20LHD/42812275?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=ElATRSfNmgbyQQ%2FbGpFTKljViqBmS3m9jzeV%2F0ESWho%3D)
2026-03-29 22:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432975/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL15GPF/42812349?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=wTakz0Cc7tufeyH2%2BCZORtgoUt72o3v%2Fn7wL9C24HQg%3D)
2026-03-29 22:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015428/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL20LHD/42812275?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=ElATRSfNmgbyQQ%2FbGpFTKljViqBmS3m9jzeV%2F0ESWho%3D)
2026-03-29 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022846/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022846>
2026-03-29 22:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145368/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO18HDJ/42812337?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=7zkw1LAtX28kbpKc8v0GGPH11HgeuBJHeW%2BxRsmaah0%3D)
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422994%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422994 not downloaded yet
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022948%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022948 not downloaded yet
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440293%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440293 not downloaded yet
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022734%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022734 not downloaded yet
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031051%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031051 not downloaded yet
2026-03-29 22:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022826/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV18WBP/42812309?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=S3te%2FtGYnRzy00zjQEu2UP8P%2FzNu2cMFNbkuAlv%2Bjsw%3D)
2026-03-29 22:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432991/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL15GPF/42812349?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=wTakz0Cc7tufeyH2%2BCZORtgoUt72o3v%2Fn7wL9C24HQg%3D)
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699423000%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699423000 not downloaded yet
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022965%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022965 not downloaded yet
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440305%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440305 not downloaded yet
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022748%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022748 not downloaded yet
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031059%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031059 not downloaded yet
2026-03-29 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022692/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GV18BTX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422944/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VU17ESV/42812251?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=TLugECzq9XNhXhCdRnpdn25J387wr1DHk7dj29O2ZH4%3D)
2026-03-29 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031009/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WP06LGD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440315%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440315 not downloaded yet
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022773%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022773 not downloaded yet
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a76810>
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL20LHD%252F699015378%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015378/600 saved to cache
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 567aca6a-4739-5529-95c7-9434b19eb603
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63663b90>
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO18HDJ%252F699145362%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145362/600 saved to cache
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bdab8438-e5c7-52d5-82d4-2d0efd86d463
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62093250>
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO18HDJ%252F699145349%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145349/600 saved to cache
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bdab8438-e5c7-52d5-82d4-2d0efd86d463
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63725dd0>
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL20LHD%252F699015410%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015410/600 saved to cache
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 567aca6a-4739-5529-95c7-9434b19eb603
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632f1e50>
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL15GPF%252F699432975%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432975/600 saved to cache
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d69b9e39-94d5-5512-b4c2-1dbe0861f944
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69adbc10>
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL20LHD%252F699015428%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015428/600 saved to cache
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 567aca6a-4739-5529-95c7-9434b19eb603
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61abf4d0>
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO18HDJ%252F699145368%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145368/600 saved to cache
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bdab8438-e5c7-52d5-82d4-2d0efd86d463
2026-03-29 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440269/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440269>
2026-03-29 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022703/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022703>
2026-03-29 22:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022837/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV18WBP/42812309?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=S3te%2FtGYnRzy00zjQEu2UP8P%2FzNu2cMFNbkuAlv%2Bjsw%3D)
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031089%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031089 not downloaded yet
2026-03-29 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022712/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022712>
2026-03-29 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031026/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031026>
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440323%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440323 not downloaded yet
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022801%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022801 not downloaded yet
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031118%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031118 not downloaded yet
2026-03-29 22:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022846/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV18WBP/42812309?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=S3te%2FtGYnRzy00zjQEu2UP8P%2FzNu2cMFNbkuAlv%2Bjsw%3D)
2026-03-29 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031035/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031035>
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440331%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440331 not downloaded yet
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022836%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022836 not downloaded yet
2026-03-29 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440278/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440278>
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031147%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031147 not downloaded yet
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63727dd0>
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV18WBP%252F699022826%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022826/600 saved to cache
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c168010-7a7e-5fdd-b0cd-fac1fdc97858
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6207e0d0>
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL15GPF%252F699432991%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432991/600 saved to cache
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d69b9e39-94d5-5512-b4c2-1dbe0861f944
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6102ffd0>
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVU17ESV%252F699422944%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422944/600 saved to cache
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b771c8f-dd52-56d3-87b9-72b4d2130708
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022860%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022860 not downloaded yet
2026-03-29 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022723/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022723>
2026-03-29 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022926/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022926>
2026-03-29 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440285/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440285>
2026-03-29 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440293/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440293>
2026-03-29 22:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022734/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022734>
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031177%27 HTTP/1.1" 200 None
2026-03-29 22:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031177 not downloaded yet
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6365e010>
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV18WBP%252F699022837%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022837/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c168010-7a7e-5fdd-b0cd-fac1fdc97858
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031009/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP06LGD/42812325?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=stINPqP%2FwDQAFMKNCdBc5N5m6v7PXR2E3EUk%2B9QFqEM%3D)
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022692/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV18BTX/42812340?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=%2Bezp23zAvj2j8ibvjS%2BYNxY8QBFXj1q86XU9oqLT%2FMg%3D)
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022748/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022748>
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031201%27 HTTP/1.1" 200 None
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031201 not downloaded yet
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637ec390>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV18WBP%252F699022846%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022846/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c168010-7a7e-5fdd-b0cd-fac1fdc97858
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440269/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/IXZ8865/42812392?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=d1AmjTDOgXlra09ci3%2FHXBYVklGZHl9eLV2qz%2Fpe%2BBc%3D)
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022773/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022773>
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022712/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV18BTX/42812340?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=%2Bezp23zAvj2j8ibvjS%2BYNxY8QBFXj1q86XU9oqLT%2FMg%3D)
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031026/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP06LGD/42812325?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=stINPqP%2FwDQAFMKNCdBc5N5m6v7PXR2E3EUk%2B9QFqEM%3D)
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022703/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV18BTX/42812340?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=%2Bezp23zAvj2j8ibvjS%2BYNxY8QBFXj1q86XU9oqLT%2FMg%3D)
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614bb610>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP06LGD%252F699031009%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031009/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd537952-b4a0-5a83-afdd-36c493417154
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61874ad0>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV18BTX%252F699022692%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022692/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f452a12-ff71-5168-a92c-5282beaef88c
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440278/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/IXZ8865/42812392?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=d1AmjTDOgXlra09ci3%2FHXBYVklGZHl9eLV2qz%2Fpe%2BBc%3D)
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031035/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP06LGD/42812325?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=stINPqP%2FwDQAFMKNCdBc5N5m6v7PXR2E3EUk%2B9QFqEM%3D)
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022734/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV18BTX/42812340?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=%2Bezp23zAvj2j8ibvjS%2BYNxY8QBFXj1q86XU9oqLT%2FMg%3D)
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440293/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/IXZ8865/42812392?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=d1AmjTDOgXlra09ci3%2FHXBYVklGZHl9eLV2qz%2Fpe%2BBc%3D)
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440285/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/IXZ8865/42812392?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=d1AmjTDOgXlra09ci3%2FHXBYVklGZHl9eLV2qz%2Fpe%2BBc%3D)
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031118/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031118>
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022723/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV18BTX/42812340?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=%2Bezp23zAvj2j8ibvjS%2BYNxY8QBFXj1q86XU9oqLT%2FMg%3D)
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac60fec750>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FIXZ8865%252F699440269%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440269/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d19e50d-f395-509a-9c03-74299fc0a339
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61bbde50>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV18BTX%252F699022712%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022712/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f452a12-ff71-5168-a92c-5282beaef88c
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63661450>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP06LGD%252F699031026%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031026/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd537952-b4a0-5a83-afdd-36c493417154
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6360c9d0>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV18BTX%252F699022703%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022703/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f452a12-ff71-5168-a92c-5282beaef88c
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022926/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV18WBP/42812309?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=S3te%2FtGYnRzy00zjQEu2UP8P%2FzNu2cMFNbkuAlv%2Bjsw%3D)
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022748/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV18BTX/42812340?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=%2Bezp23zAvj2j8ibvjS%2BYNxY8QBFXj1q86XU9oqLT%2FMg%3D)
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031201/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031201>
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031147/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031147>
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031177/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031177>
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022836/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022836>
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022860/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022860>
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022773/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV18BTX/42812340?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=%2Bezp23zAvj2j8ibvjS%2BYNxY8QBFXj1q86XU9oqLT%2FMg%3D)
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a464d0>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FIXZ8865%252F699440278%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440278/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d19e50d-f395-509a-9c03-74299fc0a339
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616820d0>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP06LGD%252F699031035%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031035/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd537952-b4a0-5a83-afdd-36c493417154
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617ee510>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV18BTX%252F699022734%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022734/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f452a12-ff71-5168-a92c-5282beaef88c
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616820d0>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FIXZ8865%252F699440293%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440293/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d19e50d-f395-509a-9c03-74299fc0a339
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6107ef10>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FIXZ8865%252F699440285%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440285/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d19e50d-f395-509a-9c03-74299fc0a339
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61714c90>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV18BTX%252F699022723%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022723/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f452a12-ff71-5168-a92c-5282beaef88c
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031059/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031059>
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022801/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022801>
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440323/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440323>
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440331/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440331>
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440315/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440315>
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031089/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031089>
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031118/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP06LGD/42812325?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=stINPqP%2FwDQAFMKNCdBc5N5m6v7PXR2E3EUk%2B9QFqEM%3D)
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61747650>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV18WBP%252F699022926%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022926/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c168010-7a7e-5fdd-b0cd-fac1fdc97858
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6221f8d0>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV18BTX%252F699022748%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022748/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f452a12-ff71-5168-a92c-5282beaef88c
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69973c50>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV18BTX%252F699022773%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022773/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f452a12-ff71-5168-a92c-5282beaef88c
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440305/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440305>
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022965/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022965>
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022836/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV18BTX/42812340?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=%2Bezp23zAvj2j8ibvjS%2BYNxY8QBFXj1q86XU9oqLT%2FMg%3D)
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031147/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP06LGD/42812325?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=stINPqP%2FwDQAFMKNCdBc5N5m6v7PXR2E3EUk%2B9QFqEM%3D)
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031177/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP06LGD/42812325?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=stINPqP%2FwDQAFMKNCdBc5N5m6v7PXR2E3EUk%2B9QFqEM%3D)
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022860/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV18BTX/42812340?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=%2Bezp23zAvj2j8ibvjS%2BYNxY8QBFXj1q86XU9oqLT%2FMg%3D)
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031201/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP06LGD/42812325?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=stINPqP%2FwDQAFMKNCdBc5N5m6v7PXR2E3EUk%2B9QFqEM%3D)
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6117c210>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP06LGD%252F699031118%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031118/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd537952-b4a0-5a83-afdd-36c493417154
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031089/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP06LGD/42812325?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=stINPqP%2FwDQAFMKNCdBc5N5m6v7PXR2E3EUk%2B9QFqEM%3D)
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031059/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP06LGD/42812325?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=stINPqP%2FwDQAFMKNCdBc5N5m6v7PXR2E3EUk%2B9QFqEM%3D)
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022801/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GV18BTX/42812340?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=%2Bezp23zAvj2j8ibvjS%2BYNxY8QBFXj1q86XU9oqLT%2FMg%3D)
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637248d0>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV18BTX%252F699022836%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022836/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f452a12-ff71-5168-a92c-5282beaef88c
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61746010>
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP06LGD%252F699031147%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031147/600 saved to cache
2026-03-29 22:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd537952-b4a0-5a83-afdd-36c493417154
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440323/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/IXZ8865/42812392?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=d1AmjTDOgXlra09ci3%2FHXBYVklGZHl9eLV2qz%2Fpe%2BBc%3D)
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440331/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/IXZ8865/42812392?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=d1AmjTDOgXlra09ci3%2FHXBYVklGZHl9eLV2qz%2Fpe%2BBc%3D)
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031051/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031051>
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699423000/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699423000>
2026-03-29 22:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440315/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/IXZ8865/42812392?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=d1AmjTDOgXlra09ci3%2FHXBYVklGZHl9eLV2qz%2Fpe%2BBc%3D)
2026-03-29 22:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022948/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022948>
2026-03-29 22:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440305/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/IXZ8865/42812392?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=d1AmjTDOgXlra09ci3%2FHXBYVklGZHl9eLV2qz%2Fpe%2BBc%3D)
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637edcd0>
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP06LGD%252F699031177%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031177/600 saved to cache
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd537952-b4a0-5a83-afdd-36c493417154
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6331a310>
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV18BTX%252F699022860%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022860/600 saved to cache
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f452a12-ff71-5168-a92c-5282beaef88c
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6367b350>
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP06LGD%252F699031201%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031201/600 saved to cache
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd537952-b4a0-5a83-afdd-36c493417154
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61609690>
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP06LGD%252F699031089%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031089/600 saved to cache
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd537952-b4a0-5a83-afdd-36c493417154
2026-03-29 22:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422994/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422994>
2026-03-29 22:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022965/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV18WBP/42812309?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=S3te%2FtGYnRzy00zjQEu2UP8P%2FzNu2cMFNbkuAlv%2Bjsw%3D)
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6119aa10>
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP06LGD%252F699031059%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031059/600 saved to cache
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd537952-b4a0-5a83-afdd-36c493417154
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c6e910>
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGV18BTX%252F699022801%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022801/600 saved to cache
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f452a12-ff71-5168-a92c-5282beaef88c
2026-03-29 22:02:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f452a12-ff71-5168-a92c-5282beaef88c, skipping ID generation
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f452a12-ff71-5168-a92c-5282beaef88c sending to next pipeline
2026-03-29 22:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9f452a12-ff71-5168-a92c-5282beaef88c, identifier: GV18%20BTX
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6372f3d0>
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FIXZ8865%252F699440323%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440323/600 saved to cache
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d19e50d-f395-509a-9c03-74299fc0a339
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63661b90>
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FIXZ8865%252F699440331%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440331/600 saved to cache
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d19e50d-f395-509a-9c03-74299fc0a339
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62130690>
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FIXZ8865%252F699440315%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440315/600 saved to cache
2026-03-29 22:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d19e50d-f395-509a-9c03-74299fc0a339
2026-03-29 22:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9f452a12-ff71-5168-a92c-5282beaef88c with identifier: GV18%20BTX
2026-03-29 22:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9f452a12-ff71-5168-a92c-5282beaef88c with identifier: GV18%20BTX
2026-03-29 22:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9f452a12-ff71-5168-a92c-5282beaef88c with identifier: GV18%20BTX to the API
2026-03-29 22:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022801/600>
{'auction_title': '',
'c_o_2_emission_value': 97,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_expert_report_file_2aaca5db-1be6-43bd-9dc7-a19f4487da23.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GV18%20BTX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9f452a12-ff71-5168-a92c-5282beaef88c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GV18 BTX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GV18%20BTX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'CITROEN',
'model': 'C1',
'odometer': 34178,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47624,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022692/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022703/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45397,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022712/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46717,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022723/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47244,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022734/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44589,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022748/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78369,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022773/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60472,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022801/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79887,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022836/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f452a12-ff71-5168-a92c-5282beaef88c/9f452a12-ff71-5168-a92c-5282beaef88c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84481,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GV18BTX/699022860/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'CITROEN C1 1.0 VTI FLAIR ETG Hatchback',
'transmission': 'automatic',
'trim': 'VTI FLAIR ETG',
'vin': 'VF7PSCFBCHR673776',
'year': 2018}
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV18%2520BTX%27 HTTP/1.1" 200 None
2026-03-29 22:02:47 [bca.uk] INFO: Saving data for GV18%20BTX: {'created_time': 1774821767.227539, 'last_price_update_time': 1774821767.22755, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GV18%2520BTX') HTTP/1.1" 204 0
2026-03-29 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022902/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022902>
2026-03-29 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422987/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422987>
2026-03-29 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022881>
2026-03-29 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440262/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440262>
2026-03-29 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422973/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422973>
2026-03-29 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422982/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422982>
2026-03-29 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022870/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022870>
2026-03-29 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422967/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422967>
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611e0ed0>
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FIXZ8865%252F699440305%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440305/600 saved to cache
2026-03-29 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d19e50d-f395-509a-9c03-74299fc0a339
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620c32d0>
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV18WBP%252F699022965%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022965/600 saved to cache
2026-03-29 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1c168010-7a7e-5fdd-b0cd-fac1fdc97858
2026-03-29 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145416/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145416>
2026-03-29 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699423003/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699423003>
2026-03-29 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433087/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433087>
2026-03-29 22:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015737/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015737>
2026-03-29 22:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022948/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV18WBP/42812309?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=S3te%2FtGYnRzy00zjQEu2UP8P%2FzNu2cMFNbkuAlv%2Bjsw%3D)
2026-03-29 22:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422994/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VU17ESV/42812251?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=TLugECzq9XNhXhCdRnpdn25J387wr1DHk7dj29O2ZH4%3D)
2026-03-29 22:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031051/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP06LGD/42812325?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=stINPqP%2FwDQAFMKNCdBc5N5m6v7PXR2E3EUk%2B9QFqEM%3D)
2026-03-29 22:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440262/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/IXZ8865/42812392?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=d1AmjTDOgXlra09ci3%2FHXBYVklGZHl9eLV2qz%2Fpe%2BBc%3D)
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636ada90>
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV18WBP%252F699022948%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022948/600 saved to cache
2026-03-29 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c168010-7a7e-5fdd-b0cd-fac1fdc97858
2026-03-29 22:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022870/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV18WBP/42812309?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=S3te%2FtGYnRzy00zjQEu2UP8P%2FzNu2cMFNbkuAlv%2Bjsw%3D)
2026-03-29 22:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422967/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VU17ESV/42812251?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=TLugECzq9XNhXhCdRnpdn25J387wr1DHk7dj29O2ZH4%3D)
2026-03-29 22:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422973/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VU17ESV/42812251?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=TLugECzq9XNhXhCdRnpdn25J387wr1DHk7dj29O2ZH4%3D)
2026-03-29 22:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022881/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV18WBP/42812309?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=S3te%2FtGYnRzy00zjQEu2UP8P%2FzNu2cMFNbkuAlv%2Bjsw%3D)
2026-03-29 22:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422987/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VU17ESV/42812251?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=TLugECzq9XNhXhCdRnpdn25J387wr1DHk7dj29O2ZH4%3D)
2026-03-29 22:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022902/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV18WBP/42812309?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=S3te%2FtGYnRzy00zjQEu2UP8P%2FzNu2cMFNbkuAlv%2Bjsw%3D)
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6372f790>
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVU17ESV%252F699422994%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422994/600 saved to cache
2026-03-29 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b771c8f-dd52-56d3-87b9-72b4d2130708
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6164c050>
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP06LGD%252F699031051%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031051/600 saved to cache
2026-03-29 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd537952-b4a0-5a83-afdd-36c493417154
2026-03-29 22:02:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd537952-b4a0-5a83-afdd-36c493417154, skipping ID generation
2026-03-29 22:02:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd537952-b4a0-5a83-afdd-36c493417154 sending to next pipeline
2026-03-29 22:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bd537952-b4a0-5a83-afdd-36c493417154, identifier: WP06%20LGD
2026-03-29 22:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bd537952-b4a0-5a83-afdd-36c493417154 with identifier: WP06%20LGD
2026-03-29 22:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bd537952-b4a0-5a83-afdd-36c493417154 with identifier: WP06%20LGD
2026-03-29 22:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bd537952-b4a0-5a83-afdd-36c493417154 with identifier: WP06%20LGD to the API
2026-03-29 22:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031051/600>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_expert_report_file_c5386c95-1447-4d4a-b584-b89735859754.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP06%20LGD-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bd537952-b4a0-5a83-afdd-36c493417154',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WP06 LGD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WP06%20LGD&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 102697,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48897,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031009/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45596,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031026/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48032,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031035/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49288,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031051/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47043,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031059/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44012,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031089/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98210,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031118/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70718,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031147/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85335,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031177/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd537952-b4a0-5a83-afdd-36c493417154/bd537952-b4a0-5a83-afdd-36c493417154_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79230,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP06LGD/699031201/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 ZETEC CLIMATE Hatchback',
'transmission': 'automatic',
'trim': 'ZETEC CLIMATE',
'vin': 'WF05XXWPD56U14821',
'year': 2006}
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP06%2520LGD%27 HTTP/1.1" 200 None
2026-03-29 22:02:48 [bca.uk] INFO: Saving data for WP06%20LGD: {'created_time': 1774821768.531289, 'last_price_update_time': 1774821768.531299, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WP06%2520LGD') HTTP/1.1" 204 0
2026-03-29 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422982/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VU17ESV/42812251?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=TLugECzq9XNhXhCdRnpdn25J387wr1DHk7dj29O2ZH4%3D)
2026-03-29 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440257/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=IXZ8865-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145416/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO18HDJ/42812337?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=7zkw1LAtX28kbpKc8v0GGPH11HgeuBJHeW%2BxRsmaah0%3D)
2026-03-29 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699423000/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VU17ESV/42812251?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=TLugECzq9XNhXhCdRnpdn25J387wr1DHk7dj29O2ZH4%3D)
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6867b690>
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FIXZ8865%252F699440262%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440262/600 saved to cache
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d19e50d-f395-509a-9c03-74299fc0a339
2026-03-29 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022862/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022862>
2026-03-29 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433087/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL15GPF/42812349?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=wTakz0Cc7tufeyH2%2BCZORtgoUt72o3v%2Fn7wL9C24HQg%3D)
2026-03-29 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015737/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL20LHD/42812275?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=ElATRSfNmgbyQQ%2FbGpFTKljViqBmS3m9jzeV%2F0ESWho%3D)
2026-03-29 22:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699423003/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS67KOJ/42812258?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=Xm69PtzN%2BBnKxoFjkJhsbVPepgGsc73VtaLOevozILc%3D)
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6981c310>
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV18WBP%252F699022870%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022870/600 saved to cache
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c168010-7a7e-5fdd-b0cd-fac1fdc97858
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6995f710>
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVU17ESV%252F699422967%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422967/600 saved to cache
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b771c8f-dd52-56d3-87b9-72b4d2130708
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614de810>
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVU17ESV%252F699422973%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422973/600 saved to cache
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b771c8f-dd52-56d3-87b9-72b4d2130708
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6164ce90>
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV18WBP%252F699022881%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022881/600 saved to cache
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c168010-7a7e-5fdd-b0cd-fac1fdc97858
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6179b310>
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVU17ESV%252F699422987%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422987/600 saved to cache
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b771c8f-dd52-56d3-87b9-72b4d2130708
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637791d0>
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV18WBP%252F699022902%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022902/600 saved to cache
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c168010-7a7e-5fdd-b0cd-fac1fdc97858
2026-03-29 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145409/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145409>
2026-03-29 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422960/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422960>
2026-03-29 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433068/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433068>
2026-03-29 22:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015529/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015529>
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6102ff10>
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVU17ESV%252F699422982%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422982/600 saved to cache
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b771c8f-dd52-56d3-87b9-72b4d2130708
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617f4790>
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO18HDJ%252F699145416%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145416/600 saved to cache
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bdab8438-e5c7-52d5-82d4-2d0efd86d463
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61807250>
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVU17ESV%252F699423000%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699423000/600 saved to cache
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b771c8f-dd52-56d3-87b9-72b4d2130708
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69adc510>
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL15GPF%252F699433087%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433087/600 saved to cache
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d69b9e39-94d5-5512-b4c2-1dbe0861f944
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61807910>
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL20LHD%252F699015737%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015737/600 saved to cache
2026-03-29 22:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 567aca6a-4739-5529-95c7-9434b19eb603
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6208b350>
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS67KOJ%252F699423003%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699423003/600 saved to cache
2026-03-29 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1059463b-3c93-584e-a414-d6327bf60ecc
2026-03-29 22:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145401/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145401>
2026-03-29 22:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422998/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422998>
2026-03-29 22:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422955/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422955>
2026-03-29 22:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015500/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015500>
2026-03-29 22:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433051/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433051>
2026-03-29 22:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422991/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422991>
2026-03-29 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440257/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/IXZ8865/42812392?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=d1AmjTDOgXlra09ci3%2FHXBYVklGZHl9eLV2qz%2Fpe%2BBc%3D)
2026-03-29 22:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422949/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422949>
2026-03-29 22:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015471/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015471>
2026-03-29 22:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145392/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145392>
2026-03-29 22:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433036/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433036>
2026-03-29 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422955/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VU17ESV/42812251?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=TLugECzq9XNhXhCdRnpdn25J387wr1DHk7dj29O2ZH4%3D)
2026-03-29 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022862/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV18WBP/42812309?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=S3te%2FtGYnRzy00zjQEu2UP8P%2FzNu2cMFNbkuAlv%2Bjsw%3D)
2026-03-29 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015529/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL20LHD/42812275?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=ElATRSfNmgbyQQ%2FbGpFTKljViqBmS3m9jzeV%2F0ESWho%3D)
2026-03-29 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433068/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL15GPF/42812349?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=wTakz0Cc7tufeyH2%2BCZORtgoUt72o3v%2Fn7wL9C24HQg%3D)
2026-03-29 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145409/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO18HDJ/42812337?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=7zkw1LAtX28kbpKc8v0GGPH11HgeuBJHeW%2BxRsmaah0%3D)
2026-03-29 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015500/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL20LHD/42812275?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=ElATRSfNmgbyQQ%2FbGpFTKljViqBmS3m9jzeV%2F0ESWho%3D)
2026-03-29 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422998/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS67KOJ/42812258?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=Xm69PtzN%2BBnKxoFjkJhsbVPepgGsc73VtaLOevozILc%3D)
2026-03-29 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422960/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VU17ESV/42812251?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=TLugECzq9XNhXhCdRnpdn25J387wr1DHk7dj29O2ZH4%3D)
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61097810>
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FIXZ8865%252F699440257%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440257/600 saved to cache
2026-03-29 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d19e50d-f395-509a-9c03-74299fc0a339
2026-03-29 22:02:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d19e50d-f395-509a-9c03-74299fc0a339, skipping ID generation
2026-03-29 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d19e50d-f395-509a-9c03-74299fc0a339 sending to next pipeline
2026-03-29 22:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2d19e50d-f395-509a-9c03-74299fc0a339, identifier: IXZ%208865
2026-03-29 22:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2d19e50d-f395-509a-9c03-74299fc0a339 with identifier: IXZ%208865
2026-03-29 22:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2d19e50d-f395-509a-9c03-74299fc0a339 with identifier: IXZ%208865
2026-03-29 22:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2d19e50d-f395-509a-9c03-74299fc0a339 with identifier: IXZ%208865 to the API
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440257/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_expert_report_file_5fa0ef97-dc30-4162-92a6-2750ab6af37b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=IXZ%208865-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2d19e50d-f395-509a-9c03-74299fc0a339',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'IXZ 8865',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=IXZ%208865&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MINI',
'model': 'ONE',
'odometer': 48295,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38241,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440257/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37245,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440262/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35568,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440269/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35069,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440278/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30490,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440285/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30684,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440293/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84142,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440305/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72631,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440315/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84054,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440323/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d19e50d-f395-509a-9c03-74299fc0a339/2d19e50d-f395-509a-9c03-74299fc0a339_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91842,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/IXZ8865/699440331/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MINI ONE 1.2 102 Hatchback',
'transmission': 'manual',
'trim': '102',
'vin': 'WMWXN720703B12105',
'year': 2016}
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27IXZ%25208865%27 HTTP/1.1" 200 None
2026-03-29 22:02:49 [bca.uk] INFO: Saving data for IXZ%208865: {'created_time': 1774821769.738871, 'last_price_update_time': 1774821769.738882, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='IXZ%25208865') HTTP/1.1" 204 0
2026-03-29 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422991/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS67KOJ/42812258?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=Xm69PtzN%2BBnKxoFjkJhsbVPepgGsc73VtaLOevozILc%3D)
2026-03-29 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422949/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VU17ESV/42812251?sv=2020-08-04&st=2026-03-29T22%3A02%3A40Z&se=2026-03-29T22%3A27%3A40Z&sr=b&sp=r&sig=TLugECzq9XNhXhCdRnpdn25J387wr1DHk7dj29O2ZH4%3D)
2026-03-29 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145401/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO18HDJ/42812337?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=7zkw1LAtX28kbpKc8v0GGPH11HgeuBJHeW%2BxRsmaah0%3D)
2026-03-29 22:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422980/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422980>
2026-03-29 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433051/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL15GPF/42812349?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=wTakz0Cc7tufeyH2%2BCZORtgoUt72o3v%2Fn7wL9C24HQg%3D)
2026-03-29 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015471/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL20LHD/42812275?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=ElATRSfNmgbyQQ%2FbGpFTKljViqBmS3m9jzeV%2F0ESWho%3D)
2026-03-29 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433036/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL15GPF/42812349?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=wTakz0Cc7tufeyH2%2BCZORtgoUt72o3v%2Fn7wL9C24HQg%3D)
2026-03-29 22:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145392/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO18HDJ/42812337?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=7zkw1LAtX28kbpKc8v0GGPH11HgeuBJHeW%2BxRsmaah0%3D)
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6351cdd0>
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVU17ESV%252F699422955%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422955/600 saved to cache
2026-03-29 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b771c8f-dd52-56d3-87b9-72b4d2130708
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616411d0>
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV18WBP%252F699022862%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022862/600 saved to cache
2026-03-29 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c168010-7a7e-5fdd-b0cd-fac1fdc97858
2026-03-29 22:02:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c168010-7a7e-5fdd-b0cd-fac1fdc97858, skipping ID generation
2026-03-29 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c168010-7a7e-5fdd-b0cd-fac1fdc97858 sending to next pipeline
2026-03-29 22:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1c168010-7a7e-5fdd-b0cd-fac1fdc97858, identifier: HV18%20WBP
2026-03-29 22:02:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62106710>
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL20LHD%252F699015529%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015529/600 saved to cache
2026-03-29 22:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 567aca6a-4739-5529-95c7-9434b19eb603
2026-03-29 22:02:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61642650>
2026-03-29 22:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL15GPF%252F699433068%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433068/600 saved to cache
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d69b9e39-94d5-5512-b4c2-1dbe0861f944
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63622810>
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO18HDJ%252F699145409%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145409/600 saved to cache
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bdab8438-e5c7-52d5-82d4-2d0efd86d463
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614ec150>
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL20LHD%252F699015500%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015500/600 saved to cache
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 567aca6a-4739-5529-95c7-9434b19eb603
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63577990>
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS67KOJ%252F699422998%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422998/600 saved to cache
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1059463b-3c93-584e-a414-d6327bf60ecc
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6372e590>
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVU17ESV%252F699422960%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422960/600 saved to cache
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b771c8f-dd52-56d3-87b9-72b4d2130708
2026-03-29 22:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1c168010-7a7e-5fdd-b0cd-fac1fdc97858 with identifier: HV18%20WBP
2026-03-29 22:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1c168010-7a7e-5fdd-b0cd-fac1fdc97858 with identifier: HV18%20WBP
2026-03-29 22:02:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1c168010-7a7e-5fdd-b0cd-fac1fdc97858 with identifier: HV18%20WBP to the API
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022862/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_expert_report_file_ebfecfc1-6547-4984-bc2b-a21884e11538.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV18%20WBP-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1c168010-7a7e-5fdd-b0cd-fac1fdc97858',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV18 WBP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV18%20WBP&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FIAT',
'model': '500',
'odometer': 19706,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50729,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022826/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48567,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022837/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46743,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022846/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48204,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022862/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49638,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022870/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48614,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022881/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104902,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022902/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022926/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95856,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022948/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c168010-7a7e-5fdd-b0cd-fac1fdc97858/1c168010-7a7e-5fdd-b0cd-fac1fdc97858_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76723,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV18WBP/699022965/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 LOUNGE Hatchback',
'transmission': 'manual',
'trim': 'LOUNGE',
'vin': 'ZFA3120000J923560',
'year': 2018}
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV18%2520WBP%27 HTTP/1.1" 200 None
2026-03-29 22:02:50 [bca.uk] INFO: Saving data for HV18%20WBP: {'created_time': 1774821770.614487, 'last_price_update_time': 1774821770.614499, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV18%2520WBP') HTTP/1.1" 204 0
2026-03-29 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145375/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145375>
2026-03-29 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015444/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015444>
2026-03-29 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433009/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699433009>
2026-03-29 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422972/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422972>
2026-03-29 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422965/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422965>
2026-03-29 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422958/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422958>
2026-03-29 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145355/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145355>
2026-03-29 22:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015394/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015394>
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62104bd0>
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS67KOJ%252F699422991%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422991/600 saved to cache
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1059463b-3c93-584e-a414-d6327bf60ecc
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6106c690>
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVU17ESV%252F699422949%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422949/600 saved to cache
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b771c8f-dd52-56d3-87b9-72b4d2130708
2026-03-29 22:02:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b771c8f-dd52-56d3-87b9-72b4d2130708, skipping ID generation
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b771c8f-dd52-56d3-87b9-72b4d2130708 sending to next pipeline
2026-03-29 22:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8b771c8f-dd52-56d3-87b9-72b4d2130708, identifier: VU17%20ESV
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac697c61d0>
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO18HDJ%252F699145401%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145401/600 saved to cache
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bdab8438-e5c7-52d5-82d4-2d0efd86d463
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61833450>
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL15GPF%252F699433051%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433051/600 saved to cache
2026-03-29 22:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d69b9e39-94d5-5512-b4c2-1dbe0861f944
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61746f50>
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL20LHD%252F699015471%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015471/600 saved to cache
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 567aca6a-4739-5529-95c7-9434b19eb603
2026-03-29 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6365ed90>
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL15GPF%252F699433036%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433036/600 saved to cache
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d69b9e39-94d5-5512-b4c2-1dbe0861f944
2026-03-29 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6209aad0>
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO18HDJ%252F699145392%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145392/600 saved to cache
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bdab8438-e5c7-52d5-82d4-2d0efd86d463
2026-03-29 22:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8b771c8f-dd52-56d3-87b9-72b4d2130708 with identifier: VU17%20ESV
2026-03-29 22:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8b771c8f-dd52-56d3-87b9-72b4d2130708 with identifier: VU17%20ESV
2026-03-29 22:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8b771c8f-dd52-56d3-87b9-72b4d2130708 with identifier: VU17%20ESV to the API
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422949/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_expert_report_file_b07019e6-1088-4db8-bced-95613f362664.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VU17%20ESV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8b771c8f-dd52-56d3-87b9-72b4d2130708',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VU17 ESV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VU17%20ESV&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 47411,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38000,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422944/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38624,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422949/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35791,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422955/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34936,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422960/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32665,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422967/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33109,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422973/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84561,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422982/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52601,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422987/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80770,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699422994/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b771c8f-dd52-56d3-87b9-72b4d2130708/8b771c8f-dd52-56d3-87b9-72b4d2130708_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82894,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU17ESV/699423000/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.3 VVT-I DESIGN Hatchback',
'transmission': 'manual',
'trim': 'VVT-I DESIGN',
'vin': 'VNKKJ3D350A398383',
'year': 2017}
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU17%2520ESV%27 HTTP/1.1" 200 None
2026-03-29 22:02:51 [bca.uk] INFO: Saving data for VU17%20ESV: {'created_time': 1774821771.509034, 'last_price_update_time': 1774821771.509044, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VU17%2520ESV') HTTP/1.1" 204 0
2026-03-29 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432955/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432955>
2026-03-29 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422952/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422952>
2026-03-29 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426091/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426091>
2026-03-29 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV62WYY/42811368?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=%2F4Jt0259hVVH95OU2b8Hd%2Bcz1OsgoLKZWHm7TE8pYYg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV62%20WYY-GB>
2026-03-29 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422947/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422947>
2026-03-29 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432938/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699432938>
2026-03-29 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT73RVP/42812415?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=1%2BC%2BZTSvvIkeTnD4KAhn2Pua0yv439rpv7qE86fFBKw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT73%20RVP-GB>
2026-03-29 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422980/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS67KOJ/42812258?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=Xm69PtzN%2BBnKxoFjkJhsbVPepgGsc73VtaLOevozILc%3D)
2026-03-29 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433009/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL15GPF/42812349?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=wTakz0Cc7tufeyH2%2BCZORtgoUt72o3v%2Fn7wL9C24HQg%3D)
2026-03-29 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145375/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO18HDJ/42812337?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=7zkw1LAtX28kbpKc8v0GGPH11HgeuBJHeW%2BxRsmaah0%3D)
2026-03-29 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145355/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO18HDJ/42812337?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=7zkw1LAtX28kbpKc8v0GGPH11HgeuBJHeW%2BxRsmaah0%3D)
2026-03-29 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015394/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL20LHD/42812275?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=ElATRSfNmgbyQQ%2FbGpFTKljViqBmS3m9jzeV%2F0ESWho%3D)
2026-03-29 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422972/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS67KOJ/42812258?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=Xm69PtzN%2BBnKxoFjkJhsbVPepgGsc73VtaLOevozILc%3D)
2026-03-29 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015444/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NL20LHD/42812275?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=ElATRSfNmgbyQQ%2FbGpFTKljViqBmS3m9jzeV%2F0ESWho%3D)
2026-03-29 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422958/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS67KOJ/42812258?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=Xm69PtzN%2BBnKxoFjkJhsbVPepgGsc73VtaLOevozILc%3D)
2026-03-29 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618e1550>
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS67KOJ%252F699422980%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422980/600 saved to cache
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1059463b-3c93-584e-a414-d6327bf60ecc
2026-03-29 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422965/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS67KOJ/42812258?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=Xm69PtzN%2BBnKxoFjkJhsbVPepgGsc73VtaLOevozILc%3D)
2026-03-29 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432938/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL15GPF/42812349?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=wTakz0Cc7tufeyH2%2BCZORtgoUt72o3v%2Fn7wL9C24HQg%3D)
2026-03-29 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422952/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS67KOJ/42812258?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=Xm69PtzN%2BBnKxoFjkJhsbVPepgGsc73VtaLOevozILc%3D)
2026-03-29 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426091/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX68ORU/42812293?sv=2020-08-04&st=2026-03-29T22%3A01%3A38Z&se=2026-03-29T22%3A26%3A38Z&sr=b&sp=r&sig=dTIgs41eJnjcU89aOFdmMmWrmPHqSDyWtMj1MxYIWm4%3D)
2026-03-29 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432955/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL15GPF/42812349?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=wTakz0Cc7tufeyH2%2BCZORtgoUt72o3v%2Fn7wL9C24HQg%3D)
2026-03-29 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422947/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS67KOJ/42812258?sv=2020-08-04&st=2026-03-29T22%3A02%3A36Z&se=2026-03-29T22%3A27%3A36Z&sr=b&sp=r&sig=Xm69PtzN%2BBnKxoFjkJhsbVPepgGsc73VtaLOevozILc%3D)
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61538b50>
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL15GPF%252F699433009%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433009/600 saved to cache
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d69b9e39-94d5-5512-b4c2-1dbe0861f944
2026-03-29 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250229/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250229>
2026-03-29 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388397/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388397>
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6176fd50>
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO18HDJ%252F699145375%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145375/600 saved to cache
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bdab8438-e5c7-52d5-82d4-2d0efd86d463
2026-03-29 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251813/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251813>
2026-03-29 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10JMO/42812403?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=CQfUomljMmNtx7dhqdwz4%2BFvuhlesuPaIQvEJxPtfik%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU10%20JMO-GB>
2026-03-29 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV62WYY/42811368?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=%2F4Jt0259hVVH95OU2b8Hd%2Bcz1OsgoLKZWHm7TE8pYYg%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT73RVP/42812415?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=1%2BC%2BZTSvvIkeTnD4KAhn2Pua0yv439rpv7qE86fFBKw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10CHY/42812355?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=4pZij%2Fr47Dgf3Dc7560BMlrvdsRK0FCKRnvXZEH489Q%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AJ10%20CHY-GB>
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6355af50>
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO18HDJ%252F699145355%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145355/600 saved to cache
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bdab8438-e5c7-52d5-82d4-2d0efd86d463
2026-03-29 22:02:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bdab8438-e5c7-52d5-82d4-2d0efd86d463, skipping ID generation
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bdab8438-e5c7-52d5-82d4-2d0efd86d463 sending to next pipeline
2026-03-29 22:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bdab8438-e5c7-52d5-82d4-2d0efd86d463, identifier: LO18%20HDJ
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61abd910>
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL20LHD%252F699015394%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015394/600 saved to cache
2026-03-29 22:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 567aca6a-4739-5529-95c7-9434b19eb603
2026-03-29 22:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616af450>
2026-03-29 22:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS67KOJ%252F699422972%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422972/600 saved to cache
2026-03-29 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1059463b-3c93-584e-a414-d6327bf60ecc
2026-03-29 22:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6369b490>
2026-03-29 22:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNL20LHD%252F699015444%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015444/600 saved to cache
2026-03-29 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 567aca6a-4739-5529-95c7-9434b19eb603
2026-03-29 22:02:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 567aca6a-4739-5529-95c7-9434b19eb603, skipping ID generation
2026-03-29 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 567aca6a-4739-5529-95c7-9434b19eb603 sending to next pipeline
2026-03-29 22:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 567aca6a-4739-5529-95c7-9434b19eb603, identifier: NL20%20LHD
2026-03-29 22:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6209a850>
2026-03-29 22:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS67KOJ%252F699422958%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422958/600 saved to cache
2026-03-29 22:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1059463b-3c93-584e-a414-d6327bf60ecc
2026-03-29 22:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bdab8438-e5c7-52d5-82d4-2d0efd86d463 with identifier: LO18%20HDJ
2026-03-29 22:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bdab8438-e5c7-52d5-82d4-2d0efd86d463 with identifier: LO18%20HDJ
2026-03-29 22:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bdab8438-e5c7-52d5-82d4-2d0efd86d463 with identifier: LO18%20HDJ to the API
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145355/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_expert_report_file_5190959c-24cb-400b-8a64-f5b4d5f565aa.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO18%20HDJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Electric',
'id': 'bdab8438-e5c7-52d5-82d4-2d0efd86d463',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LO18 HDJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LO18%20HDJ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'RENAULT',
'model': 'ZOE',
'odometer': 16707,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145342/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44464,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145349/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43834,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145355/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45358,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145362/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46444,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145368/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45557,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145375/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78193,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145392/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52672,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145401/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73692,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145409/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab8438-e5c7-52d5-82d4-2d0efd86d463/bdab8438-e5c7-52d5-82d4-2d0efd86d463_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62884,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO18HDJ/699145416/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'RENAULT ZOE 40KWH 110 DYNAMIQUE (22KW) Hatchback',
'transmission': 'automatic',
'trim': '40KWH 110 DYNAMIQUE (22KW)',
'vin': 'VF1AGVYF060093758',
'year': 2018}
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO18%2520HDJ%27 HTTP/1.1" 200 None
2026-03-29 22:02:52 [bca.uk] INFO: Saving data for LO18%20HDJ: {'created_time': 1774821772.571396, 'last_price_update_time': 1774821772.571413, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LO18%2520HDJ') HTTP/1.1" 204 0
2026-03-29 22:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 567aca6a-4739-5529-95c7-9434b19eb603 with identifier: NL20%20LHD
2026-03-29 22:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 567aca6a-4739-5529-95c7-9434b19eb603 with identifier: NL20%20LHD
2026-03-29 22:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 567aca6a-4739-5529-95c7-9434b19eb603 with identifier: NL20%20LHD to the API
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015444/600>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_expert_report_file_0dc0e6e7-da07-4e33-9dea-2bde6e8e82ca.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NL20%20LHD-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '567aca6a-4739-5529-95c7-9434b19eb603',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NL20 LHD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NL20%20LHD&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 38741,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51399,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015364/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48063,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015378/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49085,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015394/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50356,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015410/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46620,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015428/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44254,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015444/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94309,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015471/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66920,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015500/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015529/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_567aca6a-4739-5529-95c7-9434b19eb603/567aca6a-4739-5529-95c7-9434b19eb603_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71227,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NL20LHD/699015737/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.3 DIG-T 140 N-CONNECTA Hatchback',
'transmission': 'manual',
'trim': 'DIG-T 140 N-CONNECTA',
'vin': 'SJNFFAJ11U2705395',
'year': 2020}
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL20%2520LHD%27 HTTP/1.1" 200 None
2026-03-29 22:02:52 [bca.uk] INFO: Saving data for NL20%20LHD: {'created_time': 1774821772.962265, 'last_price_update_time': 1774821772.962279, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NL20%2520LHD') HTTP/1.1" 204 0
2026-03-29 22:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250223/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250223>
2026-03-29 22:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML12ZHW/42812414?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=V4QZ9w7hBnm%2FMYbVuMY%2BCH2XPiov1C3DLRxZaI6iSc4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML12%20ZHW-GB>
2026-03-29 22:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388445/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388445>
2026-03-29 22:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251805/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251805>
2026-03-29 22:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242956/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242956>
2026-03-29 22:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073235/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073235>
2026-03-29 22:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251800/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LP66SVX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG58WEO/42812332?sv=2020-08-04&st=2026-03-29T22%3A02%3A52Z&se=2026-03-29T22%3A27%3A52Z&sr=b&sp=r&sig=Ie8d2tzUK3GLWM0ldRErFf8UqLGM13BDsRwEgjAZqZk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YG58%20WEO-GB>
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61683790>
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS67KOJ%252F699422965%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422965/600 saved to cache
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1059463b-3c93-584e-a414-d6327bf60ecc
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6217b890>
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL15GPF%252F699432938%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432938/600 saved to cache
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d69b9e39-94d5-5512-b4c2-1dbe0861f944
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a182d0>
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS67KOJ%252F699422952%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422952/600 saved to cache
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1059463b-3c93-584e-a414-d6327bf60ecc
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621798d0>
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX68ORU%252F699426091%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426091/600 saved to cache
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0556e924-104a-5552-a701-fc5b5327996f
2026-03-29 22:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0556e924-104a-5552-a701-fc5b5327996f, skipping ID generation
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0556e924-104a-5552-a701-fc5b5327996f sending to next pipeline
2026-03-29 22:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0556e924-104a-5552-a701-fc5b5327996f, identifier: LX68%20ORU
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620eca10>
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL15GPF%252F699432955%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432955/600 saved to cache
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d69b9e39-94d5-5512-b4c2-1dbe0861f944
2026-03-29 22:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d69b9e39-94d5-5512-b4c2-1dbe0861f944, skipping ID generation
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d69b9e39-94d5-5512-b4c2-1dbe0861f944 sending to next pipeline
2026-03-29 22:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d69b9e39-94d5-5512-b4c2-1dbe0861f944, identifier: BL15%20GPF
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63348850>
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS67KOJ%252F699422947%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422947/600 saved to cache
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1059463b-3c93-584e-a414-d6327bf60ecc
2026-03-29 22:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1059463b-3c93-584e-a414-d6327bf60ecc, skipping ID generation
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1059463b-3c93-584e-a414-d6327bf60ecc sending to next pipeline
2026-03-29 22:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1059463b-3c93-584e-a414-d6327bf60ecc, identifier: DS67%20KOJ
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620ab250>
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_expert_report_file_d8a8e61f-f9bb-4253-9f1b-db00d8cdec1f.pdf HTTP/1.1" 201 0
2026-03-29 22:02:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 24ad4fc7-54b2-5a7b-9fae-16e0849e8972
2026-03-29 22:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24ad4fc7-54b2-5a7b-9fae-16e0849e8972, skipping ID generation
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24ad4fc7-54b2-5a7b-9fae-16e0849e8972
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOV62WYY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV62WYY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62150490>
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_expert_report_file_47e847ee-a73b-4bdd-8eff-d4a3033146e6.pdf HTTP/1.1" 201 0
2026-03-29 22:02:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 85fa43ad-0cd8-5fcb-8570-724bee64deae
2026-03-29 22:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85fa43ad-0cd8-5fcb-8570-724bee64deae, skipping ID generation
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85fa43ad-0cd8-5fcb-8570-724bee64deae
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBT73RVP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BT73RVP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0556e924-104a-5552-a701-fc5b5327996f with identifier: LX68%20ORU
2026-03-29 22:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0556e924-104a-5552-a701-fc5b5327996f with identifier: LX68%20ORU
2026-03-29 22:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0556e924-104a-5552-a701-fc5b5327996f with identifier: LX68%20ORU to the API
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426091/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_expert_report_file_7b61bbf5-20a6-4a95-bfa5-50dcbb995c5d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX68%20ORU-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Electric',
'id': '0556e924-104a-5552-a701-fc5b5327996f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LX68 ORU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LX68%20ORU&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'RENAULT',
'model': 'KANGOO',
'odometer': 61214,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44592,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426066/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41534,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426091/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39704,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426103/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40375,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426120/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43664,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426130/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426143/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89216,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426159/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70521,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426188/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81955,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426208/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0556e924-104a-5552-a701-fc5b5327996f/0556e924-104a-5552-a701-fc5b5327996f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73021,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX68ORU/699426221/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'RENAULT KANGOO ML20 ZE 33KWH 44KW BUS.I-VAN Van',
'transmission': 'automatic',
'trim': 'ML20 ZE 33KWH 44KW BUS.I-VAN',
'vin': 'VF1FWEZBC60919631',
'year': 2018}
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX68%2520ORU%27 HTTP/1.1" 200 None
2026-03-29 22:02:53 [bca.uk] INFO: Saving data for LX68%20ORU: {'created_time': 1774821773.99615, 'last_price_update_time': 1774821773.996161, 'auction_closing_time': 1775037600.0}
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LX68%2520ORU') HTTP/1.1" 204 0
2026-03-29 22:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d69b9e39-94d5-5512-b4c2-1dbe0861f944 with identifier: BL15%20GPF
2026-03-29 22:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d69b9e39-94d5-5512-b4c2-1dbe0861f944 with identifier: BL15%20GPF
2026-03-29 22:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d69b9e39-94d5-5512-b4c2-1dbe0861f944 with identifier: BL15%20GPF to the API
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432955/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_expert_report_file_4a5d5833-62ff-46f2-8402-6981e9848439.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BL15%20GPF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd69b9e39-94d5-5512-b4c2-1dbe0861f944',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BL15 GPF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BL15%20GPF&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 38783,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39531,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432929/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40157,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432938/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37473,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432955/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36352,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432975/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33978,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699432991/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34294,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433009/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101436,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433036/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84481,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433051/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90191,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433068/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69b9e39-94d5-5512-b4c2-1dbe0861f944/d69b9e39-94d5-5512-b4c2-1dbe0861f944_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80637,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL15GPF/699433087/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.3 VVT-I ICON Hatchback',
'transmission': 'manual',
'trim': 'VVT-I ICON',
'vin': 'VNKKJ3D340A297352',
'year': 2015}
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL15%2520GPF%27 HTTP/1.1" 200 None
2026-03-29 22:02:54 [bca.uk] INFO: Saving data for BL15%20GPF: {'created_time': 1774821774.396331, 'last_price_update_time': 1774821774.39637, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BL15%2520GPF') HTTP/1.1" 204 0
2026-03-29 22:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1059463b-3c93-584e-a414-d6327bf60ecc with identifier: DS67%20KOJ
2026-03-29 22:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1059463b-3c93-584e-a414-d6327bf60ecc with identifier: DS67%20KOJ
2026-03-29 22:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1059463b-3c93-584e-a414-d6327bf60ecc with identifier: DS67%20KOJ to the API
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422947/600>
{'auction_title': '',
'c_o_2_emission_value': 95,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_expert_report_file_f1c423d2-7084-43d5-afa4-113deae7b875.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DS67%20KOJ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1059463b-3c93-584e-a414-d6327bf60ecc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DS67 KOJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DS67%20KOJ&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'TOYOTA',
'model': 'AYGO',
'odometer': 14847,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37389,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422942/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38044,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422947/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37786,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422952/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36430,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422958/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34714,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422965/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35502,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422972/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80718,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422980/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56697,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422991/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80816,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699422998/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1059463b-3c93-584e-a414-d6327bf60ecc/1059463b-3c93-584e-a414-d6327bf60ecc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83435,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS67KOJ/699423003/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'TOYOTA AYGO 1.0 VVT-I X-PRESS Hatchback',
'transmission': 'manual',
'trim': 'VVT-I X-PRESS',
'vin': 'JTDKGNEC70N316857',
'year': 2018}
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS67%2520KOJ%27 HTTP/1.1" 200 None
2026-03-29 22:02:54 [bca.uk] INFO: Saving data for DS67%20KOJ: {'created_time': 1774821774.7899, 'last_price_update_time': 1774821774.78991, 'auction_closing_time': 1774951200.0}
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DS67%2520KOJ') HTTP/1.1" 204 0
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145989%27 HTTP/1.1" 200 None
2026-03-29 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145989 not downloaded yet
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699442157%27 HTTP/1.1" 200 None
2026-03-29 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442157 not downloaded yet
2026-03-29 22:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250229/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX05YUG/42800121?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=MySGDJ66pbFCM8Of63GwPM4lST90Oc%2FUCupYTeM%2FDJ0%3D)
2026-03-29 22:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251813/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66SVX/42805972?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=yl9q46AoV3wQNjXIFCNniksZeCLN9BE%2FANgZ6Iluhps%3D)
2026-03-29 22:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211063/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699211063>
2026-03-29 22:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC71UFN/42812218?sv=2020-08-04&st=2026-03-29T22%3A02%3A53Z&se=2026-03-29T22%3A27%3A53Z&sr=b&sp=r&sig=4FihtkCt%2FGp5LKhMzARTnnzdiAI5VokxYNeoPhaBiEI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC71%20UFN-GB>
2026-03-29 22:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234651/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234651>
2026-03-29 22:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388397/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68OTW/42811886?sv=2020-08-04&st=2026-03-29T22%3A01%3A29Z&se=2026-03-29T22%3A26%3A29Z&sr=b&sp=r&sig=fuk2ajppUL%2BpY5Jq%2BLDEOSIJIqcNrPdxnkllkXnrnUc%3D)
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145992%27 HTTP/1.1" 200 None
2026-03-29 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145992 not downloaded yet
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699442163%27 HTTP/1.1" 200 None
2026-03-29 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442163 not downloaded yet
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146001%27 HTTP/1.1" 200 None
2026-03-29 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146001 not downloaded yet
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699442172%27 HTTP/1.1" 200 None
2026-03-29 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442172 not downloaded yet
2026-03-29 22:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10JMO/42812403?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=CQfUomljMmNtx7dhqdwz4%2BFvuhlesuPaIQvEJxPtfik%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146008%27 HTTP/1.1" 200 None
2026-03-29 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146008 not downloaded yet
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699442178%27 HTTP/1.1" 200 None
2026-03-29 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442178 not downloaded yet
2026-03-29 22:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10CHY/42812355?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=4pZij%2Fr47Dgf3Dc7560BMlrvdsRK0FCKRnvXZEH489Q%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146013%27 HTTP/1.1" 200 None
2026-03-29 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146013 not downloaded yet
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699442186%27 HTTP/1.1" 200 None
2026-03-29 22:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442186 not downloaded yet
2026-03-29 22:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636ea7d0>
2026-03-29 22:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX05YUG%252F699250229%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250229/600 saved to cache
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f8e435e-d477-50a3-aea7-4952aa2ce397
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6151af10>
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66SVX%252F699251813%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251813/600 saved to cache
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 392ba6d2-142e-521e-9c14-6f3c87e57d15
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636a4b50>
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68OTW%252F699388397%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388397/600 saved to cache
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4
2026-03-29 22:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388445/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU68OTW/42811886?sv=2020-08-04&st=2026-03-29T22%3A01%3A29Z&se=2026-03-29T22%3A26%3A29Z&sr=b&sp=r&sig=fuk2ajppUL%2BpY5Jq%2BLDEOSIJIqcNrPdxnkllkXnrnUc%3D)
2026-03-29 22:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073235/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF17VPN/42811060?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=YkLrcIHkwtrZsjUa2prubREuXQStMy8DMOWlaZjCM6o%3D)
2026-03-29 22:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251805/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66SVX/42805972?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=yl9q46AoV3wQNjXIFCNniksZeCLN9BE%2FANgZ6Iluhps%3D)
2026-03-29 22:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251800/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66SVX/42805972?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=yl9q46AoV3wQNjXIFCNniksZeCLN9BE%2FANgZ6Iluhps%3D)
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146026%27 HTTP/1.1" 200 None
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146026 not downloaded yet
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699442195%27 HTTP/1.1" 200 None
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442195 not downloaded yet
2026-03-29 22:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250223/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX05YUG/42800121?sv=2020-08-04&st=2026-03-29T22%3A01%3A36Z&se=2026-03-29T22%3A26%3A36Z&sr=b&sp=r&sig=MySGDJ66pbFCM8Of63GwPM4lST90Oc%2FUCupYTeM%2FDJ0%3D)
2026-03-29 22:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242956/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58XVG/42790595?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=vcjXHy%2BXcxnL8fVcBSIy1zRUfNwdkYA77TQSDd3JyNw%3D)
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146036%27 HTTP/1.1" 200 None
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146036 not downloaded yet
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699442203%27 HTTP/1.1" 200 None
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442203 not downloaded yet
2026-03-29 22:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG58WEO/42812332?sv=2020-08-04&st=2026-03-29T22%3A02%3A52Z&se=2026-03-29T22%3A27%3A52Z&sr=b&sp=r&sig=Ie8d2tzUK3GLWM0ldRErFf8UqLGM13BDsRwEgjAZqZk%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML12ZHW/42812414?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=V4QZ9w7hBnm%2FMYbVuMY%2BCH2XPiov1C3DLRxZaI6iSc4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146047%27 HTTP/1.1" 200 None
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146047 not downloaded yet
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699442211%27 HTTP/1.1" 200 None
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442211 not downloaded yet
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636b42d0>
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_expert_report_file_1ae110d1-e7b1-4f2a-a345-661eafa71560.pdf HTTP/1.1" 201 0
2026-03-29 22:02:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ac4d9299-bbf0-53f0-9801-f000c8d0940d
2026-03-29 22:02:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac4d9299-bbf0-53f0-9801-f000c8d0940d, skipping ID generation
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac4d9299-bbf0-53f0-9801-f000c8d0940d
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGU10JMO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU10JMO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636a5a90>
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_expert_report_file_641b5c22-926b-42cb-b1c1-ce492e3c48e9.pdf HTTP/1.1" 201 0
2026-03-29 22:02:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0
2026-03-29 22:02:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0, skipping ID generation
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAJ10CHY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AJ10CHY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699145989/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145989>
2026-03-29 22:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442157/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442157>
2026-03-29 22:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442152/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BT73RVP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC71UFN/42812218?sv=2020-08-04&st=2026-03-29T22%3A02%3A53Z&se=2026-03-29T22%3A27%3A53Z&sr=b&sp=r&sig=4FihtkCt%2FGp5LKhMzARTnnzdiAI5VokxYNeoPhaBiEI%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146056%27 HTTP/1.1" 200 None
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146056 not downloaded yet
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699442220%27 HTTP/1.1" 200 None
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442220 not downloaded yet
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022807%27 HTTP/1.1" 200 None
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022807 not downloaded yet
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022722%27 HTTP/1.1" 200 None
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022722 not downloaded yet
2026-03-29 22:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234651/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK55EXG/42758130?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=zNKuCsXwY5YBweBL8fGiYSmIg6c7hmRzF6E4Qyh0WVI%3D)
2026-03-29 22:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211063/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO08HUA/42769935?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=UrTho4OU5emtGOfXKZ0dWvPhmltT%2BxjdBAxxllTvFdc%3D)
2026-03-29 22:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442163/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442163>
2026-03-29 22:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442172/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442172>
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022817%27 HTTP/1.1" 200 None
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022817 not downloaded yet
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022738%27 HTTP/1.1" 200 None
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022738 not downloaded yet
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62078150>
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU68OTW%252F699388445%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388445/600 saved to cache
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4
2026-03-29 22:02:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4, skipping ID generation
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4 sending to next pipeline
2026-03-29 22:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4, identifier: DU68%20OTW
2026-03-29 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a1a7d0>
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF17VPN%252F699073235%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073235/600 saved to cache
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5439021f-449a-5c9e-a193-64352e476208
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61588c10>
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66SVX%252F699251805%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251805/600 saved to cache
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 392ba6d2-142e-521e-9c14-6f3c87e57d15
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636e9ad0>
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66SVX%252F699251800%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251800/600 saved to cache
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 392ba6d2-142e-521e-9c14-6f3c87e57d15
2026-03-29 22:02:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 392ba6d2-142e-521e-9c14-6f3c87e57d15, skipping ID generation
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 392ba6d2-142e-521e-9c14-6f3c87e57d15 sending to next pipeline
2026-03-29 22:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 392ba6d2-142e-521e-9c14-6f3c87e57d15, identifier: LP66%20SVX
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615ed290>
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX05YUG%252F699250223%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250223/600 saved to cache
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f8e435e-d477-50a3-aea7-4952aa2ce397
2026-03-29 22:02:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f8e435e-d477-50a3-aea7-4952aa2ce397, skipping ID generation
2026-03-29 22:02:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f8e435e-d477-50a3-aea7-4952aa2ce397 sending to next pipeline
2026-03-29 22:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9f8e435e-d477-50a3-aea7-4952aa2ce397, identifier: CX05%20YUG
2026-03-29 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6176c0d0>
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58XVG%252F699242956%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242956/600 saved to cache
2026-03-29 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cdbe3643-d056-5481-b487-6a8e20861864
2026-03-29 22:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63574b50>
2026-03-29 22:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_expert_report_file_13e1b916-625c-4782-9466-6591f26b3fa3.pdf HTTP/1.1" 201 0
2026-03-29 22:02:56 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ac73288d-b563-5983-b5d9-ecc76436c89b
2026-03-29 22:02:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac73288d-b563-5983-b5d9-ecc76436c89b, skipping ID generation
2026-03-29 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac73288d-b563-5983-b5d9-ecc76436c89b
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYG58WEO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YG58WEO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a53d90>
2026-03-29 22:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_expert_report_file_41fb0fac-bc52-413c-92b9-6dfe36cf299a.pdf HTTP/1.1" 201 0
2026-03-29 22:02:56 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item affe99a9-0b91-5662-a514-563a71ce6efc
2026-03-29 22:02:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: affe99a9-0b91-5662-a514-563a71ce6efc, skipping ID generation
2026-03-29 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item affe99a9-0b91-5662-a514-563a71ce6efc
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DML12ZHW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ML12ZHW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4 with identifier: DU68%20OTW
2026-03-29 22:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4 with identifier: DU68%20OTW
2026-03-29 22:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4 with identifier: DU68%20OTW to the API
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388445/600>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_expert_report_file_2a2f3f2d-3047-4271-9dc3-2549008fb989.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DU68%20OTW-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DU68 OTW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DU68%20OTW&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'VIVARO 2.9T',
'odometer': 109914,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43982,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388325/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41755,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388344/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37361,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388358/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39474,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388379/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39038,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388397/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36836,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388445/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91048,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388471/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53659,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388482/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91870,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388498/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4/a41cfd1e-1034-55e2-9f6b-4dcfc6c0f2d4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67340,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU68OTW/699388507/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VAUXHALL VIVARO 2.9T 1.6 CDTI 120 LWB SPORTIVE PanelVan',
'transmission': 'manual',
'trim': 'CDTI 120 LWB SPORTIVE',
'vin': 'W0VF7G604KV608606',
'year': 2018}
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU68%2520OTW%27 HTTP/1.1" 200 None
2026-03-29 22:02:56 [bca.uk] INFO: Saving data for DU68%20OTW: {'created_time': 1774821776.499097, 'last_price_update_time': 1774821776.499108, 'auction_closing_time': 1775037600.0}
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DU68%2520OTW') HTTP/1.1" 204 0
2026-03-29 22:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 392ba6d2-142e-521e-9c14-6f3c87e57d15 with identifier: LP66%20SVX
2026-03-29 22:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 392ba6d2-142e-521e-9c14-6f3c87e57d15 with identifier: LP66%20SVX
2026-03-29 22:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 392ba6d2-142e-521e-9c14-6f3c87e57d15 with identifier: LP66%20SVX to the API
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251800/600>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_expert_report_file_6e537952-ed79-4392-90c5-ec140f41d90a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LP66%20SVX-GB',
'category': 'LightCommercialVehicle',
'color': 'blue',
'currency': 'GBP',
'doors_number': 6,
'engine': '1.5L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '392ba6d2-142e-521e-9c14-6f3c87e57d15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LP66 SVX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LP66%20SVX&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'TRANSIT CONNECT',
'odometer': 135063,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41422,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251800/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251805/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38101,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251813/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40420,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251818/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40645,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251827/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36792,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251834/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114741,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251845/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58130,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251858/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80357,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251875/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392ba6d2-142e-521e-9c14-6f3c87e57d15/392ba6d2-142e-521e-9c14-6f3c87e57d15_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79660,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66SVX/699251890/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FORD TRANSIT CONNECT 1.5 TDCI 100 230 L2 L/R CrewCab Van',
'transmission': 'manual',
'trim': 'TDCI 100 230 L2 L/R',
'vin': 'WF05XXWPG5GE23702',
'year': 2017}
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP66%2520SVX%27 HTTP/1.1" 200 None
2026-03-29 22:02:56 [bca.uk] INFO: Saving data for LP66%20SVX: {'created_time': 1774821776.890323, 'last_price_update_time': 1774821776.890334, 'auction_closing_time': 1775037600.0}
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LP66%2520SVX') HTTP/1.1" 204 0
2026-03-29 22:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9f8e435e-d477-50a3-aea7-4952aa2ce397 with identifier: CX05%20YUG
2026-03-29 22:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9f8e435e-d477-50a3-aea7-4952aa2ce397 with identifier: CX05%20YUG
2026-03-29 22:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9f8e435e-d477-50a3-aea7-4952aa2ce397 with identifier: CX05%20YUG to the API
2026-03-29 22:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250223/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_expert_report_file_a0dd377e-60d6-4b67-b577-9358a3a77113.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CX05%20YUG-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9f8e435e-d477-50a3-aea7-4952aa2ce397',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CX05 YUG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CX05%20YUG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 125601,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36522,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250212/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37148,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250223/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35982,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250229/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36134,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250242/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35267,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250248/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35191,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250259/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74330,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250273/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68909,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250294/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69981,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250312/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8e435e-d477-50a3-aea7-4952aa2ce397/9f8e435e-d477-50a3-aea7-4952aa2ce397_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75730,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX05YUG/699250332/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.4 TDCI Van',
'transmission': 'manual',
'trim': 'TDCI',
'vin': 'WF0CXXGAJC4L77864',
'year': 2005}
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX05%2520YUG%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [bca.uk] INFO: Saving data for CX05%20YUG: {'created_time': 1774821777.269765, 'last_price_update_time': 1774821777.269777, 'auction_closing_time': 1775124000.0}
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CX05%2520YUG') HTTP/1.1" 204 0
2026-03-29 22:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442186/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442186>
2026-03-29 22:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146013/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146013>
2026-03-29 22:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442178/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442178>
2026-03-29 22:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146008/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146008>
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022831%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022831 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022750%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022750 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031078%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031078 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443629%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443629 not downloaded yet
2026-03-29 22:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146001/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146001>
2026-03-29 22:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146036/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146036>
2026-03-29 22:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442203/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442203>
2026-03-29 22:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699145992/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145992>
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022839%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022839 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022855%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022855 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031101%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031101 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443635%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443635 not downloaded yet
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61925650>
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_expert_report_file_e4ef1add-2300-45e3-9693-bc3bc829d0cb.pdf HTTP/1.1" 201 0
2026-03-29 22:02:57 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c7b2a772-2b80-593a-be28-f56b16c4aace
2026-03-29 22:02:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7b2a772-2b80-593a-be28-f56b16c4aace, skipping ID generation
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c7b2a772-2b80-593a-be28-f56b16c4aace
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLC71UFN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LC71UFN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:02:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a022d0>
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK55EXG%252F699234651%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234651/600 saved to cache
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0991f76e-fa68-5257-8869-29bbc185bed6
2026-03-29 22:02:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61924dd0>
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO08HUA%252F699211063%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211063/600 saved to cache
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9816a6af-47f8-5106-89d9-6d77d25fd0f4
2026-03-29 22:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699145989/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV62WYY/42811368?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=%2F4Jt0259hVVH95OU2b8Hd%2Bcz1OsgoLKZWHm7TE8pYYg%3D)
2026-03-29 22:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442152/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT73RVP/42812415?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=1%2BC%2BZTSvvIkeTnD4KAhn2Pua0yv439rpv7qE86fFBKw%3D)
2026-03-29 22:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442163/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT73RVP/42812415?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=1%2BC%2BZTSvvIkeTnD4KAhn2Pua0yv439rpv7qE86fFBKw%3D)
2026-03-29 22:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442157/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT73RVP/42812415?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=1%2BC%2BZTSvvIkeTnD4KAhn2Pua0yv439rpv7qE86fFBKw%3D)
2026-03-29 22:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442172/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT73RVP/42812415?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=1%2BC%2BZTSvvIkeTnD4KAhn2Pua0yv439rpv7qE86fFBKw%3D)
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022853%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022853 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022880%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022880 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031125%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031125 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443642%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443642 not downloaded yet
2026-03-29 22:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022722/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022722>
2026-03-29 22:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AJ10CHY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022807/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022807>
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414647%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414647 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022874%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022874 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022892%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022892 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031136%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031136 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443646%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443646 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414669%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414669 not downloaded yet
2026-03-29 22:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699145992/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV62WYY/42811368?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=%2F4Jt0259hVVH95OU2b8Hd%2Bcz1OsgoLKZWHm7TE8pYYg%3D)
2026-03-29 22:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146013/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV62WYY/42811368?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=%2F4Jt0259hVVH95OU2b8Hd%2Bcz1OsgoLKZWHm7TE8pYYg%3D)
2026-03-29 22:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442186/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT73RVP/42812415?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=1%2BC%2BZTSvvIkeTnD4KAhn2Pua0yv439rpv7qE86fFBKw%3D)
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022895%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022895 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022919%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022919 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031145%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031145 not downloaded yet
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443651%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443651 not downloaded yet
2026-03-29 22:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146008/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV62WYY/42811368?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=%2F4Jt0259hVVH95OU2b8Hd%2Bcz1OsgoLKZWHm7TE8pYYg%3D)
2026-03-29 22:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442178/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT73RVP/42812415?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=1%2BC%2BZTSvvIkeTnD4KAhn2Pua0yv439rpv7qE86fFBKw%3D)
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414692%27 HTTP/1.1" 200 None
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414692 not downloaded yet
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620c2990>
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV62WYY%252F699145989%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699145989/600 saved to cache
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24ad4fc7-54b2-5a7b-9fae-16e0849e8972
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61046a90>
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT73RVP%252F699442152%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442152/600 saved to cache
2026-03-29 22:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85fa43ad-0cd8-5fcb-8570-724bee64deae
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618f6190>
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT73RVP%252F699442163%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442163/600 saved to cache
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 85fa43ad-0cd8-5fcb-8570-724bee64deae
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637af550>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT73RVP%252F699442157%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442157/600 saved to cache
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 85fa43ad-0cd8-5fcb-8570-724bee64deae
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611e3f10>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT73RVP%252F699442172%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442172/600 saved to cache
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 85fa43ad-0cd8-5fcb-8570-724bee64deae
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146001/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV62WYY/42811368?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=%2F4Jt0259hVVH95OU2b8Hd%2Bcz1OsgoLKZWHm7TE8pYYg%3D)
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022918%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022918 not downloaded yet
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022949%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022949 not downloaded yet
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031173%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031173 not downloaded yet
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443662%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443662 not downloaded yet
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442203/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT73RVP/42812415?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=1%2BC%2BZTSvvIkeTnD4KAhn2Pua0yv439rpv7qE86fFBKw%3D)
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146036/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV62WYY/42811368?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=%2F4Jt0259hVVH95OU2b8Hd%2Bcz1OsgoLKZWHm7TE8pYYg%3D)
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414709%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414709 not downloaded yet
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022855/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022855>
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031101/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031101>
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443629/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443629>
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022839/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022839>
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443635/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443635>
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022944%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022944 not downloaded yet
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022969%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022969 not downloaded yet
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031196%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031196 not downloaded yet
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443670%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443670 not downloaded yet
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414724%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414724 not downloaded yet
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022722/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10CHY/42812355?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=4pZij%2Fr47Dgf3Dc7560BMlrvdsRK0FCKRnvXZEH489Q%3D)
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10CHY/42812355?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=4pZij%2Fr47Dgf3Dc7560BMlrvdsRK0FCKRnvXZEH489Q%3D)
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022807/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10JMO/42812403?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=CQfUomljMmNtx7dhqdwz4%2BFvuhlesuPaIQvEJxPtfik%3D)
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031221%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031221 not downloaded yet
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443677%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443677 not downloaded yet
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b5e50>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV62WYY%252F699145992%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699145992/600 saved to cache
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24ad4fc7-54b2-5a7b-9fae-16e0849e8972
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62135550>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV62WYY%252F699146013%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146013/600 saved to cache
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24ad4fc7-54b2-5a7b-9fae-16e0849e8972
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69add2d0>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT73RVP%252F699442186%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442186/600 saved to cache
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 85fa43ad-0cd8-5fcb-8570-724bee64deae
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63631a10>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV62WYY%252F699146008%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146008/600 saved to cache
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24ad4fc7-54b2-5a7b-9fae-16e0849e8972
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62107010>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT73RVP%252F699442178%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442178/600 saved to cache
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 85fa43ad-0cd8-5fcb-8570-724bee64deae
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414747%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414747 not downloaded yet
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443646/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443646>
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022874/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022874>
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022892/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022892>
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414669/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414669>
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031136/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031136>
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699031236%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031236 not downloaded yet
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699443684%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443684 not downloaded yet
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6365d7d0>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV62WYY%252F699146001%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146001/600 saved to cache
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24ad4fc7-54b2-5a7b-9fae-16e0849e8972
2026-03-29 22:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6207f4d0>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT73RVP%252F699442203%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442203/600 saved to cache
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 85fa43ad-0cd8-5fcb-8570-724bee64deae
2026-03-29 22:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618f3450>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV62WYY%252F699146036%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146036/600 saved to cache
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24ad4fc7-54b2-5a7b-9fae-16e0849e8972
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414768%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414768 not downloaded yet
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031145/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031145>
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414692/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414692>
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443651/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443651>
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414787%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414787 not downloaded yet
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6365f790>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10CHY%252F699022722%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022722/600 saved to cache
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63673890>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10CHY%252F699022705%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022705/600 saved to cache
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63318890>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10JMO%252F699022807%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022807/600 saved to cache
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac4d9299-bbf0-53f0-9801-f000c8d0940d
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022855/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10CHY/42812355?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=4pZij%2Fr47Dgf3Dc7560BMlrvdsRK0FCKRnvXZEH489Q%3D)
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022839/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10JMO/42812403?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=CQfUomljMmNtx7dhqdwz4%2BFvuhlesuPaIQvEJxPtfik%3D)
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443635/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML12ZHW/42812414?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=V4QZ9w7hBnm%2FMYbVuMY%2BCH2XPiov1C3DLRxZaI6iSc4%3D)
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031101/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG58WEO/42812332?sv=2020-08-04&st=2026-03-29T22%3A02%3A52Z&se=2026-03-29T22%3A27%3A52Z&sr=b&sp=r&sig=Ie8d2tzUK3GLWM0ldRErFf8UqLGM13BDsRwEgjAZqZk%3D)
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443629/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML12ZHW/42812414?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=V4QZ9w7hBnm%2FMYbVuMY%2BCH2XPiov1C3DLRxZaI6iSc4%3D)
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414812%27 HTTP/1.1" 200 None
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414812 not downloaded yet
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022969/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022969>
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443670/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443670>
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031196/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031196>
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443646/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML12ZHW/42812414?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=V4QZ9w7hBnm%2FMYbVuMY%2BCH2XPiov1C3DLRxZaI6iSc4%3D)
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414669/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC71UFN/42812218?sv=2020-08-04&st=2026-03-29T22%3A02%3A53Z&se=2026-03-29T22%3A27%3A53Z&sr=b&sp=r&sig=4FihtkCt%2FGp5LKhMzARTnnzdiAI5VokxYNeoPhaBiEI%3D)
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022874/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10JMO/42812403?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=CQfUomljMmNtx7dhqdwz4%2BFvuhlesuPaIQvEJxPtfik%3D)
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031136/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG58WEO/42812332?sv=2020-08-04&st=2026-03-29T22%3A02%3A52Z&se=2026-03-29T22%3A27%3A52Z&sr=b&sp=r&sig=Ie8d2tzUK3GLWM0ldRErFf8UqLGM13BDsRwEgjAZqZk%3D)
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022892/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10CHY/42812355?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=4pZij%2Fr47Dgf3Dc7560BMlrvdsRK0FCKRnvXZEH489Q%3D)
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62098690>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10CHY%252F699022855%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022855/600 saved to cache
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443651/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML12ZHW/42812414?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=V4QZ9w7hBnm%2FMYbVuMY%2BCH2XPiov1C3DLRxZaI6iSc4%3D)
2026-03-29 22:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031145/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG58WEO/42812332?sv=2020-08-04&st=2026-03-29T22%3A02%3A52Z&se=2026-03-29T22%3A27%3A52Z&sr=b&sp=r&sig=Ie8d2tzUK3GLWM0ldRErFf8UqLGM13BDsRwEgjAZqZk%3D)
2026-03-29 22:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414787/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414787>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636714d0>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10JMO%252F699022839%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022839/600 saved to cache
2026-03-29 22:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac4d9299-bbf0-53f0-9801-f000c8d0940d
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637ecfd0>
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML12ZHW%252F699443635%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443635/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item affe99a9-0b91-5662-a514-563a71ce6efc
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637eb9d0>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG58WEO%252F699031101%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031101/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac73288d-b563-5983-b5d9-ecc76436c89b
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6372c150>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML12ZHW%252F699443629%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443629/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item affe99a9-0b91-5662-a514-563a71ce6efc
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414692/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC71UFN/42812218?sv=2020-08-04&st=2026-03-29T22%3A02%3A53Z&se=2026-03-29T22%3A27%3A53Z&sr=b&sp=r&sig=4FihtkCt%2FGp5LKhMzARTnnzdiAI5VokxYNeoPhaBiEI%3D)
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414768/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414768>
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443684/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443684>
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031236/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031236>
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414747/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414747>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637ecad0>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML12ZHW%252F699443646%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443646/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item affe99a9-0b91-5662-a514-563a71ce6efc
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6107f950>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC71UFN%252F699414669%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414669/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7b2a772-2b80-593a-be28-f56b16c4aace
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6a8a49d0>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10JMO%252F699022874%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022874/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac4d9299-bbf0-53f0-9801-f000c8d0940d
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6107d510>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG58WEO%252F699031136%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031136/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac73288d-b563-5983-b5d9-ecc76436c89b
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611d6350>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10CHY%252F699022892%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022892/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617f55d0>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML12ZHW%252F699443651%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443651/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item affe99a9-0b91-5662-a514-563a71ce6efc
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6107e410>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG58WEO%252F699031145%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031145/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac73288d-b563-5983-b5d9-ecc76436c89b
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031196/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG58WEO/42812332?sv=2020-08-04&st=2026-03-29T22%3A02%3A52Z&se=2026-03-29T22%3A27%3A52Z&sr=b&sp=r&sig=Ie8d2tzUK3GLWM0ldRErFf8UqLGM13BDsRwEgjAZqZk%3D)
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414812/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414812>
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031221/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031221>
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414724/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414724>
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443677/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443677>
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022944/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022944>
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022969/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10CHY/42812355?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=4pZij%2Fr47Dgf3Dc7560BMlrvdsRK0FCKRnvXZEH489Q%3D)
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443670/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML12ZHW/42812414?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=V4QZ9w7hBnm%2FMYbVuMY%2BCH2XPiov1C3DLRxZaI6iSc4%3D)
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6173e350>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC71UFN%252F699414692%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414692/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7b2a772-2b80-593a-be28-f56b16c4aace
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031236/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG58WEO/42812332?sv=2020-08-04&st=2026-03-29T22%3A02%3A52Z&se=2026-03-29T22%3A27%3A52Z&sr=b&sp=r&sig=Ie8d2tzUK3GLWM0ldRErFf8UqLGM13BDsRwEgjAZqZk%3D)
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414787/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC71UFN/42812218?sv=2020-08-04&st=2026-03-29T22%3A02%3A53Z&se=2026-03-29T22%3A27%3A53Z&sr=b&sp=r&sig=4FihtkCt%2FGp5LKhMzARTnnzdiAI5VokxYNeoPhaBiEI%3D)
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6371bd50>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG58WEO%252F699031196%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031196/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac73288d-b563-5983-b5d9-ecc76436c89b
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031173/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031173>
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414709/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414709>
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443662/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443662>
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632f1ad0>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10CHY%252F699022969%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022969/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61634d10>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML12ZHW%252F699443670%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443670/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item affe99a9-0b91-5662-a514-563a71ce6efc
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443684/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML12ZHW/42812414?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=V4QZ9w7hBnm%2FMYbVuMY%2BCH2XPiov1C3DLRxZaI6iSc4%3D)
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022944/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10JMO/42812403?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=CQfUomljMmNtx7dhqdwz4%2BFvuhlesuPaIQvEJxPtfik%3D)
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414768/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC71UFN/42812218?sv=2020-08-04&st=2026-03-29T22%3A02%3A53Z&se=2026-03-29T22%3A27%3A53Z&sr=b&sp=r&sig=4FihtkCt%2FGp5LKhMzARTnnzdiAI5VokxYNeoPhaBiEI%3D)
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443677/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML12ZHW/42812414?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=V4QZ9w7hBnm%2FMYbVuMY%2BCH2XPiov1C3DLRxZaI6iSc4%3D)
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414747/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC71UFN/42812218?sv=2020-08-04&st=2026-03-29T22%3A02%3A53Z&se=2026-03-29T22%3A27%3A53Z&sr=b&sp=r&sig=4FihtkCt%2FGp5LKhMzARTnnzdiAI5VokxYNeoPhaBiEI%3D)
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031221/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG58WEO/42812332?sv=2020-08-04&st=2026-03-29T22%3A02%3A52Z&se=2026-03-29T22%3A27%3A52Z&sr=b&sp=r&sig=Ie8d2tzUK3GLWM0ldRErFf8UqLGM13BDsRwEgjAZqZk%3D)
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414812/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC71UFN/42812218?sv=2020-08-04&st=2026-03-29T22%3A02%3A53Z&se=2026-03-29T22%3A27%3A53Z&sr=b&sp=r&sig=4FihtkCt%2FGp5LKhMzARTnnzdiAI5VokxYNeoPhaBiEI%3D)
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414724/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC71UFN/42812218?sv=2020-08-04&st=2026-03-29T22%3A02%3A53Z&se=2026-03-29T22%3A27%3A53Z&sr=b&sp=r&sig=4FihtkCt%2FGp5LKhMzARTnnzdiAI5VokxYNeoPhaBiEI%3D)
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610b4150>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG58WEO%252F699031236%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031236/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac73288d-b563-5983-b5d9-ecc76436c89b
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620ab5d0>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC71UFN%252F699414787%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414787/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7b2a772-2b80-593a-be28-f56b16c4aace
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61847d90>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML12ZHW%252F699443684%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443684/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item affe99a9-0b91-5662-a514-563a71ce6efc
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62084350>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10JMO%252F699022944%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022944/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac4d9299-bbf0-53f0-9801-f000c8d0940d
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61972150>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC71UFN%252F699414768%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414768/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7b2a772-2b80-593a-be28-f56b16c4aace
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414709/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC71UFN/42812218?sv=2020-08-04&st=2026-03-29T22%3A02%3A53Z&se=2026-03-29T22%3A27%3A53Z&sr=b&sp=r&sig=4FihtkCt%2FGp5LKhMzARTnnzdiAI5VokxYNeoPhaBiEI%3D)
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022919/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022919>
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62086350>
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML12ZHW%252F699443677%252F600') HTTP/1.1" 204 0
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443677/600 saved to cache
2026-03-29 22:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item affe99a9-0b91-5662-a514-563a71ce6efc
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022918/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022918>
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031173/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG58WEO/42812332?sv=2020-08-04&st=2026-03-29T22%3A02%3A52Z&se=2026-03-29T22%3A27%3A52Z&sr=b&sp=r&sig=Ie8d2tzUK3GLWM0ldRErFf8UqLGM13BDsRwEgjAZqZk%3D)
2026-03-29 22:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443662/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML12ZHW/42812414?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=V4QZ9w7hBnm%2FMYbVuMY%2BCH2XPiov1C3DLRxZaI6iSc4%3D)
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022949/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022949>
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022895/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022895>
2026-03-29 22:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414647/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414647>
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6360c450>
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC71UFN%252F699414747%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414747/600 saved to cache
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7b2a772-2b80-593a-be28-f56b16c4aace
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61924e10>
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG58WEO%252F699031221%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031221/600 saved to cache
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac73288d-b563-5983-b5d9-ecc76436c89b
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c6d1d0>
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC71UFN%252F699414812%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414812/600 saved to cache
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7b2a772-2b80-593a-be28-f56b16c4aace
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611a3d10>
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC71UFN%252F699414724%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414724/600 saved to cache
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7b2a772-2b80-593a-be28-f56b16c4aace
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031125/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031125>
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443642/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699443642>
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6368ced0>
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC71UFN%252F699414709%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414709/600 saved to cache
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7b2a772-2b80-593a-be28-f56b16c4aace
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636f5090>
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG58WEO%252F699031173%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031173/600 saved to cache
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac73288d-b563-5983-b5d9-ecc76436c89b
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61634a50>
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML12ZHW%252F699443662%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443662/600 saved to cache
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item affe99a9-0b91-5662-a514-563a71ce6efc
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022750/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022750>
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022880/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022880>
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031078/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699031078>
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414623/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LC71UFN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022853/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022853>
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022831/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022831>
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443623/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ML12ZHW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022919/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10CHY/42812355?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=4pZij%2Fr47Dgf3Dc7560BMlrvdsRK0FCKRnvXZEH489Q%3D)
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022738/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022738>
2026-03-29 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031125/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG58WEO/42812332?sv=2020-08-04&st=2026-03-29T22%3A02%3A52Z&se=2026-03-29T22%3A27%3A52Z&sr=b&sp=r&sig=Ie8d2tzUK3GLWM0ldRErFf8UqLGM13BDsRwEgjAZqZk%3D)
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031054/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YG58WEO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443642/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML12ZHW/42812414?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=V4QZ9w7hBnm%2FMYbVuMY%2BCH2XPiov1C3DLRxZaI6iSc4%3D)
2026-03-29 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022949/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10CHY/42812355?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=4pZij%2Fr47Dgf3Dc7560BMlrvdsRK0FCKRnvXZEH489Q%3D)
2026-03-29 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022918/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10JMO/42812403?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=CQfUomljMmNtx7dhqdwz4%2BFvuhlesuPaIQvEJxPtfik%3D)
2026-03-29 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022895/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10JMO/42812403?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=CQfUomljMmNtx7dhqdwz4%2BFvuhlesuPaIQvEJxPtfik%3D)
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636f5b90>
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10CHY%252F699022919%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022919/600 saved to cache
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0
2026-03-29 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443623/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML12ZHW/42812414?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=V4QZ9w7hBnm%2FMYbVuMY%2BCH2XPiov1C3DLRxZaI6iSc4%3D)
2026-03-29 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022831/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10JMO/42812403?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=CQfUomljMmNtx7dhqdwz4%2BFvuhlesuPaIQvEJxPtfik%3D)
2026-03-29 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414623/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC71UFN/42812218?sv=2020-08-04&st=2026-03-29T22%3A02%3A53Z&se=2026-03-29T22%3A27%3A53Z&sr=b&sp=r&sig=4FihtkCt%2FGp5LKhMzARTnnzdiAI5VokxYNeoPhaBiEI%3D)
2026-03-29 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022853/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10JMO/42812403?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=CQfUomljMmNtx7dhqdwz4%2BFvuhlesuPaIQvEJxPtfik%3D)
2026-03-29 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031078/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG58WEO/42812332?sv=2020-08-04&st=2026-03-29T22%3A02%3A52Z&se=2026-03-29T22%3A27%3A52Z&sr=b&sp=r&sig=Ie8d2tzUK3GLWM0ldRErFf8UqLGM13BDsRwEgjAZqZk%3D)
2026-03-29 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022880/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10CHY/42812355?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=4pZij%2Fr47Dgf3Dc7560BMlrvdsRK0FCKRnvXZEH489Q%3D)
2026-03-29 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022750/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10CHY/42812355?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=4pZij%2Fr47Dgf3Dc7560BMlrvdsRK0FCKRnvXZEH489Q%3D)
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a02350>
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG58WEO%252F699031125%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031125/600 saved to cache
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac73288d-b563-5983-b5d9-ecc76436c89b
2026-03-29 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414647/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC71UFN/42812218?sv=2020-08-04&st=2026-03-29T22%3A02%3A53Z&se=2026-03-29T22%3A27%3A53Z&sr=b&sp=r&sig=4FihtkCt%2FGp5LKhMzARTnnzdiAI5VokxYNeoPhaBiEI%3D)
2026-03-29 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022738/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AJ10CHY/42812355?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=4pZij%2Fr47Dgf3Dc7560BMlrvdsRK0FCKRnvXZEH489Q%3D)
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618f2e50>
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML12ZHW%252F699443642%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443642/600 saved to cache
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item affe99a9-0b91-5662-a514-563a71ce6efc
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6158f990>
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10CHY%252F699022949%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022949/600 saved to cache
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610b4d10>
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10JMO%252F699022918%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022918/600 saved to cache
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac4d9299-bbf0-53f0-9801-f000c8d0940d
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632f0650>
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10JMO%252F699022895%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022895/600 saved to cache
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac4d9299-bbf0-53f0-9801-f000c8d0940d
2026-03-29 22:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031054/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG58WEO/42812332?sv=2020-08-04&st=2026-03-29T22%3A02%3A52Z&se=2026-03-29T22%3A27%3A52Z&sr=b&sp=r&sig=Ie8d2tzUK3GLWM0ldRErFf8UqLGM13BDsRwEgjAZqZk%3D)
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442211/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442211>
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022817/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022817>
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442220/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442220>
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146056/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146056>
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU10JMO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146047/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146047>
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611c8250>
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML12ZHW%252F699443623%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443623/600 saved to cache
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item affe99a9-0b91-5662-a514-563a71ce6efc
2026-03-29 22:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: affe99a9-0b91-5662-a514-563a71ce6efc, skipping ID generation
2026-03-29 22:03:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item affe99a9-0b91-5662-a514-563a71ce6efc sending to next pipeline
2026-03-29 22:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: affe99a9-0b91-5662-a514-563a71ce6efc, identifier: ML12%20ZHW
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61003d50>
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10JMO%252F699022831%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022831/600 saved to cache
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac4d9299-bbf0-53f0-9801-f000c8d0940d
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6353bbd0>
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC71UFN%252F699414623%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414623/600 saved to cache
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7b2a772-2b80-593a-be28-f56b16c4aace
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637db9d0>
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10JMO%252F699022853%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022853/600 saved to cache
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac4d9299-bbf0-53f0-9801-f000c8d0940d
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617f6910>
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG58WEO%252F699031078%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031078/600 saved to cache
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac73288d-b563-5983-b5d9-ecc76436c89b
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac635590d0>
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10CHY%252F699022880%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022880/600 saved to cache
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6353a450>
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10CHY%252F699022750%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022750/600 saved to cache
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614b85d0>
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC71UFN%252F699414647%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414647/600 saved to cache
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7b2a772-2b80-593a-be28-f56b16c4aace
2026-03-29 22:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7b2a772-2b80-593a-be28-f56b16c4aace, skipping ID generation
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7b2a772-2b80-593a-be28-f56b16c4aace sending to next pipeline
2026-03-29 22:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c7b2a772-2b80-593a-be28-f56b16c4aace, identifier: LC71%20UFN
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616aef50>
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAJ10CHY%252F699022738%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022738/600 saved to cache
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0
2026-03-29 22:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0, skipping ID generation
2026-03-29 22:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0 sending to next pipeline
2026-03-29 22:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0, identifier: AJ10%20CHY
2026-03-29 22:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: affe99a9-0b91-5662-a514-563a71ce6efc with identifier: ML12%20ZHW
2026-03-29 22:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: affe99a9-0b91-5662-a514-563a71ce6efc with identifier: ML12%20ZHW
2026-03-29 22:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: affe99a9-0b91-5662-a514-563a71ce6efc with identifier: ML12%20ZHW to the API
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443623/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_expert_report_file_41fb0fac-bc52-413c-92b9-6dfe36cf299a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML12%20ZHW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'affe99a9-0b91-5662-a514-563a71ce6efc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML12 ZHW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML12%20ZHW&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'CITROEN',
'model': 'C3',
'odometer': 91149,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37141,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443623/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36151,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443629/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35647,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443635/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35643,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443642/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34109,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443646/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34277,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443651/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67814,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443662/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61756,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443670/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68494,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443677/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affe99a9-0b91-5662-a514-563a71ce6efc/affe99a9-0b91-5662-a514-563a71ce6efc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72153,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML12ZHW/699443684/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'CITROEN C3 1.4 WHITE Hatchback',
'transmission': 'manual',
'trim': 'WHITE',
'vin': 'VF7SCKFT0CA538267',
'year': 2012}
2026-03-29 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML12%2520ZHW%27 HTTP/1.1" 200 None
2026-03-29 22:03:02 [bca.uk] INFO: Saving data for ML12%20ZHW: {'created_time': 1774821782.105093, 'last_price_update_time': 1774821782.105106, 'auction_closing_time': 1774951200.0}
2026-03-29 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML12%2520ZHW') HTTP/1.1" 204 0
2026-03-29 22:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c7b2a772-2b80-593a-be28-f56b16c4aace with identifier: LC71%20UFN
2026-03-29 22:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c7b2a772-2b80-593a-be28-f56b16c4aace with identifier: LC71%20UFN
2026-03-29 22:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c7b2a772-2b80-593a-be28-f56b16c4aace with identifier: LC71%20UFN to the API
2026-03-29 22:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414647/600>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_expert_report_file_e4ef1add-2300-45e3-9693-bc3bc829d0cb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC71%20UFN-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c7b2a772-2b80-593a-be28-f56b16c4aace',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC71 UFN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LC71%20UFN&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'CITROEN',
'model': 'BERLINGO M',
'odometer': 78702,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43333,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414623/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41647,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414647/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39331,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414669/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41066,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414692/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43720,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414709/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42273,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414724/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93454,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414747/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64346,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414768/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68533,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414787/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b2a772-2b80-593a-be28-f56b16c4aace/c7b2a772-2b80-593a-be28-f56b16c4aace_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67673,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC71UFN/699414812/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'CITROEN BERLINGO M 1.5 BLUEHDI 75 650 ENTERPRISE PRO Van',
'transmission': 'manual',
'trim': 'BLUEHDI 75 650 ENTERPRISE PRO',
'vin': 'VR7EFYHWCMJ837076',
'year': 2021}
2026-03-29 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC71%2520UFN%27 HTTP/1.1" 200 None
2026-03-29 22:03:02 [bca.uk] INFO: Saving data for LC71%20UFN: {'created_time': 1774821782.707142, 'last_price_update_time': 1774821782.707153, 'auction_closing_time': 1775037600.0}
2026-03-29 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LC71%2520UFN') HTTP/1.1" 204 0
2026-03-29 22:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0 with identifier: AJ10%20CHY
2026-03-29 22:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0 with identifier: AJ10%20CHY
2026-03-29 22:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 66098e6d-ec3f-5a2f-9cd9-6f43f01244f0 with identifier: AJ10%20CHY to the API
2026-03-29 22:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022738/600>
{'auction_title': '',
'c_o_2_emission_value': 244,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_expert_report_file_641b5c22-926b-42cb-b1c1-ce492e3c48e9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AJ10%20CHY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '66098e6d-ec3f-5a2f-9cd9-6f43f01244f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AJ10 CHY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AJ10%20CHY&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'DISCOVERY 4',
'odometer': 169620,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50720,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49322,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022722/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44983,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022738/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45705,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022750/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45653,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022855/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47092,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022880/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93743,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022892/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74431,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022919/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102491,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022949/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66098e6d-ec3f-5a2f-9cd9-6f43f01244f0/66098e6d-ec3f-5a2f-9cd9-6f43f01244f0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64354,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AJ10CHY/699022969/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY 4 3.0 TD V6 HSE StationWagon',
'transmission': 'automatic',
'trim': 'TD V6 HSE',
'vin': 'SALLAAAF3AA539511',
'year': 2010}
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ10%2520CHY%27 HTTP/1.1" 200 None
2026-03-29 22:03:03 [bca.uk] INFO: Saving data for AJ10%20CHY: {'created_time': 1774821783.065149, 'last_price_update_time': 1774821783.065161, 'auction_closing_time': 1774951200.0}
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AJ10%2520CHY') HTTP/1.1" 204 0
2026-03-29 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442195/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699442195>
2026-03-29 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234612/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234612>
2026-03-29 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073196/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073196>
2026-03-29 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242922/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242922>
2026-03-29 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211035/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699211035>
2026-03-29 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023418/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023418>
2026-03-29 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699145981/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV62WYY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146026/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146026>
2026-03-29 22:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a1d5d0>
2026-03-29 22:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG58WEO%252F699031054%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031054/600 saved to cache
2026-03-29 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac73288d-b563-5983-b5d9-ecc76436c89b
2026-03-29 22:03:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac73288d-b563-5983-b5d9-ecc76436c89b, skipping ID generation
2026-03-29 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac73288d-b563-5983-b5d9-ecc76436c89b sending to next pipeline
2026-03-29 22:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ac73288d-b563-5983-b5d9-ecc76436c89b, identifier: YG58%20WEO
2026-03-29 22:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ac73288d-b563-5983-b5d9-ecc76436c89b with identifier: YG58%20WEO
2026-03-29 22:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ac73288d-b563-5983-b5d9-ecc76436c89b with identifier: YG58%20WEO
2026-03-29 22:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ac73288d-b563-5983-b5d9-ecc76436c89b with identifier: YG58%20WEO to the API
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031054/600>
{'auction_title': '',
'c_o_2_emission_value': 156,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_expert_report_file_13e1b916-625c-4782-9466-6591f26b3fa3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YG58%20WEO-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ac73288d-b563-5983-b5d9-ecc76436c89b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YG58 WEO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YG58%20WEO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MINI',
'model': 'COOPER',
'odometer': 90081,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51046,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031054/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48454,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031078/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46054,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031101/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47591,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031125/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45657,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031136/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45110,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031145/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106087,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031173/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49110,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031196/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85303,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031221/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac73288d-b563-5983-b5d9-ecc76436c89b/ac73288d-b563-5983-b5d9-ecc76436c89b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86809,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG58WEO/699031236/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.6 Hatchback',
'transmission': 'automatic',
'trim': '',
'vin': 'WMWMF32070TW22704',
'year': 2008}
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG58%2520WEO%27 HTTP/1.1" 200 None
2026-03-29 22:03:03 [bca.uk] INFO: Saving data for YG58%20WEO: {'created_time': 1774821783.617278, 'last_price_update_time': 1774821783.61729, 'auction_closing_time': 1774951200.0}
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YG58%2520WEO') HTTP/1.1" 204 0
2026-03-29 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022817/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10JMO/42812403?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=CQfUomljMmNtx7dhqdwz4%2BFvuhlesuPaIQvEJxPtfik%3D)
2026-03-29 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU10JMO/42812403?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=CQfUomljMmNtx7dhqdwz4%2BFvuhlesuPaIQvEJxPtfik%3D)
2026-03-29 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212624/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212624>
2026-03-29 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699240050/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699240050>
2026-03-29 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442211/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT73RVP/42812415?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=1%2BC%2BZTSvvIkeTnD4KAhn2Pua0yv439rpv7qE86fFBKw%3D)
2026-03-29 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146047/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV62WYY/42811368?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=%2F4Jt0259hVVH95OU2b8Hd%2Bcz1OsgoLKZWHm7TE8pYYg%3D)
2026-03-29 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146056/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV62WYY/42811368?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=%2F4Jt0259hVVH95OU2b8Hd%2Bcz1OsgoLKZWHm7TE8pYYg%3D)
2026-03-29 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442220/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT73RVP/42812415?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=1%2BC%2BZTSvvIkeTnD4KAhn2Pua0yv439rpv7qE86fFBKw%3D)
2026-03-29 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073196/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF17VPN/42811060?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=YkLrcIHkwtrZsjUa2prubREuXQStMy8DMOWlaZjCM6o%3D)
2026-03-29 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023418/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12WNS/42810774?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=tTo%2B0xotySQc25NFgljm0ZLwDTnsvqG5v%2FSimEvL7PM%3D)
2026-03-29 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242922/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58XVG/42790595?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=vcjXHy%2BXcxnL8fVcBSIy1zRUfNwdkYA77TQSDd3JyNw%3D)
2026-03-29 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234612/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK55EXG/42758130?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=zNKuCsXwY5YBweBL8fGiYSmIg6c7hmRzF6E4Qyh0WVI%3D)
2026-03-29 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699145981/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV62WYY/42811368?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=%2F4Jt0259hVVH95OU2b8Hd%2Bcz1OsgoLKZWHm7TE8pYYg%3D)
2026-03-29 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211035/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO08HUA/42769935?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=UrTho4OU5emtGOfXKZ0dWvPhmltT%2BxjdBAxxllTvFdc%3D)
2026-03-29 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146026/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV62WYY/42811368?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=%2F4Jt0259hVVH95OU2b8Hd%2Bcz1OsgoLKZWHm7TE8pYYg%3D)
2026-03-29 22:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a1d0d0>
2026-03-29 22:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10JMO%252F699022817%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022817/600 saved to cache
2026-03-29 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac4d9299-bbf0-53f0-9801-f000c8d0940d
2026-03-29 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457249/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457249>
2026-03-29 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699252047/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252047>
2026-03-29 22:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6365cd50>
2026-03-29 22:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU10JMO%252F699022782%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022782/600 saved to cache
2026-03-29 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac4d9299-bbf0-53f0-9801-f000c8d0940d
2026-03-29 22:03:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac4d9299-bbf0-53f0-9801-f000c8d0940d, skipping ID generation
2026-03-29 22:03:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac4d9299-bbf0-53f0-9801-f000c8d0940d sending to next pipeline
2026-03-29 22:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ac4d9299-bbf0-53f0-9801-f000c8d0940d, identifier: GU10%20JMO
2026-03-29 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246761/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246761>
2026-03-29 22:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699240050/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KD15FPU/42809529?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=fvJF7ucpRX0E%2BAJp%2BX9CWPAyJRKbO%2FRJwWNOYDHIzAs%3D)
2026-03-29 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073189/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073189>
2026-03-29 22:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023406/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023406>
2026-03-29 22:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ac4d9299-bbf0-53f0-9801-f000c8d0940d with identifier: GU10%20JMO
2026-03-29 22:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ac4d9299-bbf0-53f0-9801-f000c8d0940d with identifier: GU10%20JMO
2026-03-29 22:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ac4d9299-bbf0-53f0-9801-f000c8d0940d with identifier: GU10%20JMO to the API
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022782/600>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_expert_report_file_1ae110d1-e7b1-4f2a-a345-661eafa71560.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU10%20JMO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ac4d9299-bbf0-53f0-9801-f000c8d0940d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU10 JMO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU10%20JMO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 133886,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49980,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022782/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45884,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022807/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44073,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022817/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47275,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022831/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41965,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022839/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41454,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022853/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78101,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022874/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78088,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022895/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94342,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022918/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac4d9299-bbf0-53f0-9801-f000c8d0940d/ac4d9299-bbf0-53f0-9801-f000c8d0940d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66116,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU10JMO/699022944/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'JAGUAR XF 3.0 D V6 S 275 LUXURY Saloon',
'transmission': 'automatic',
'trim': 'D V6 S 275 LUXURY',
'vin': 'SAJAC0529BNR80714',
'year': 2010}
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU10%2520JMO%27 HTTP/1.1" 200 None
2026-03-29 22:03:04 [bca.uk] INFO: Saving data for GU10%20JMO: {'created_time': 1774821784.333932, 'last_price_update_time': 1774821784.333943, 'auction_closing_time': 1774951200.0}
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU10%2520JMO') HTTP/1.1" 204 0
2026-03-29 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442195/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT73RVP/42812415?sv=2020-08-04&st=2026-03-29T22%3A02%3A51Z&se=2026-03-29T22%3A27%3A51Z&sr=b&sp=r&sig=1%2BC%2BZTSvvIkeTnD4KAhn2Pua0yv439rpv7qE86fFBKw%3D)
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62106110>
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT73RVP%252F699442211%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442211/600 saved to cache
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 85fa43ad-0cd8-5fcb-8570-724bee64deae
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620fdd90>
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV62WYY%252F699146047%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146047/600 saved to cache
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24ad4fc7-54b2-5a7b-9fae-16e0849e8972
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62139b90>
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV62WYY%252F699146056%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146056/600 saved to cache
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24ad4fc7-54b2-5a7b-9fae-16e0849e8972
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620fcf90>
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT73RVP%252F699442220%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442220/600 saved to cache
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 85fa43ad-0cd8-5fcb-8570-724bee64deae
2026-03-29 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242917/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242917>
2026-03-29 22:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211016/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699211016>
2026-03-29 22:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212624/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL11KPY/42783241?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=Q5R98DxLk%2FIyOrHb6oSyVq%2Bq9sVfHG45AhfvPKzaek4%3D)
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac697efb50>
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF17VPN%252F699073196%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073196/600 saved to cache
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5439021f-449a-5c9e-a193-64352e476208
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610869d0>
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12WNS%252F699023418%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023418/600 saved to cache
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e630b36-cd01-5007-b4b4-e80c316bb326
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636ae250>
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58XVG%252F699242922%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242922/600 saved to cache
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cdbe3643-d056-5481-b487-6a8e20861864
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6223c390>
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK55EXG%252F699234612%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234612/600 saved to cache
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0991f76e-fa68-5257-8869-29bbc185bed6
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636ae910>
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV62WYY%252F699145981%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699145981/600 saved to cache
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24ad4fc7-54b2-5a7b-9fae-16e0849e8972
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636ae0d0>
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO08HUA%252F699211035%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211035/600 saved to cache
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9816a6af-47f8-5106-89d9-6d77d25fd0f4
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62150510>
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV62WYY%252F699146026%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146026/600 saved to cache
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24ad4fc7-54b2-5a7b-9fae-16e0849e8972
2026-03-29 22:03:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24ad4fc7-54b2-5a7b-9fae-16e0849e8972, skipping ID generation
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24ad4fc7-54b2-5a7b-9fae-16e0849e8972 sending to next pipeline
2026-03-29 22:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 24ad4fc7-54b2-5a7b-9fae-16e0849e8972, identifier: OV62%20WYY
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6367ac10>
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKD15FPU%252F699240050%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699240050/600 saved to cache
2026-03-29 22:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78
2026-03-29 22:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 24ad4fc7-54b2-5a7b-9fae-16e0849e8972 with identifier: OV62%20WYY
2026-03-29 22:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 24ad4fc7-54b2-5a7b-9fae-16e0849e8972 with identifier: OV62%20WYY
2026-03-29 22:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 24ad4fc7-54b2-5a7b-9fae-16e0849e8972 with identifier: OV62%20WYY to the API
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146026/600>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_expert_report_file_d8a8e61f-f9bb-4253-9f1b-db00d8cdec1f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV62%20WYY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '24ad4fc7-54b2-5a7b-9fae-16e0849e8972',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV62 WYY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV62%20WYY&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': 'X1',
'odometer': 105024,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699145981/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45799,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699145989/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46885,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699145992/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48536,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146001/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45820,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146008/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42507,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146013/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84395,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146026/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67393,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146036/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75933,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146047/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ad4fc7-54b2-5a7b-9fae-16e0849e8972/24ad4fc7-54b2-5a7b-9fae-16e0849e8972_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71236,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV62WYY/699146056/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'BMW X1 2.0 SDRIVE 18D M SPORT StationWagon',
'transmission': 'manual',
'trim': 'SDRIVE 18D M SPORT',
'vin': 'WBAVN72090VR58826',
'year': 2012}
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV62%2520WYY%27 HTTP/1.1" 200 None
2026-03-29 22:03:05 [bca.uk] INFO: Saving data for OV62%20WYY: {'created_time': 1774821785.283249, 'last_price_update_time': 1774821785.28326, 'auction_closing_time': 1774951200.0}
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV62%2520WYY') HTTP/1.1" 204 0
2026-03-29 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234595/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234595>
2026-03-29 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212610/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212610>
2026-03-29 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699240036/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699240036>
2026-03-29 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457248/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457248>
2026-03-29 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699252032/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252032>
2026-03-29 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457249/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO58EBF/42810110?sv=2020-08-04&st=2026-03-29T22%3A01%3A02Z&se=2026-03-29T22%3A26%3A02Z&sr=b&sp=r&sig=l1yGxyGiXjxmhLTIgBa00vRGvOItb%2B7FOLk9BOk0TjI%3D)
2026-03-29 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246750/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246750>
2026-03-29 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62132ed0>
2026-03-29 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT73RVP%252F699442195%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442195/600 saved to cache
2026-03-29 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 85fa43ad-0cd8-5fcb-8570-724bee64deae
2026-03-29 22:03:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85fa43ad-0cd8-5fcb-8570-724bee64deae, skipping ID generation
2026-03-29 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85fa43ad-0cd8-5fcb-8570-724bee64deae sending to next pipeline
2026-03-29 22:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 85fa43ad-0cd8-5fcb-8570-724bee64deae, identifier: BT73%20RVP
2026-03-29 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69adaf90>
2026-03-29 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL11KPY%252F699212624%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212624/600 saved to cache
2026-03-29 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c
2026-03-29 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699252047/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MC14KAE/42809755?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=DG6b3zLT1DRX51p27qxjR95H%2BdTJAJxRv%2B3BMmM%2BaS4%3D)
2026-03-29 22:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 85fa43ad-0cd8-5fcb-8570-724bee64deae with identifier: BT73%20RVP
2026-03-29 22:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 85fa43ad-0cd8-5fcb-8570-724bee64deae with identifier: BT73%20RVP
2026-03-29 22:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 85fa43ad-0cd8-5fcb-8570-724bee64deae with identifier: BT73%20RVP to the API
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442195/600>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_expert_report_file_47e847ee-a73b-4bdd-8eff-d4a3033146e6.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT73%20RVP-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '85fa43ad-0cd8-5fcb-8570-724bee64deae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BT73 RVP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BT73%20RVP&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'MOKKA',
'odometer': 10304,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38327,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442152/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38455,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442157/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38167,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442163/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37193,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442172/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33608,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442178/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34273,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442186/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71078,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442195/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50865,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442203/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79844,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442211/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85fa43ad-0cd8-5fcb-8570-724bee64deae/85fa43ad-0cd8-5fcb-8570-724bee64deae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87964,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT73RVP/699442220/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'VAUXHALL MOKKA 1.2 TURBO 100 DESIGN Hatchback',
'transmission': 'manual',
'trim': 'TURBO 100 DESIGN',
'vin': 'VXKUSHPVKPW102742',
'year': 2023}
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT73%2520RVP%27 HTTP/1.1" 200 None
2026-03-29 22:03:05 [bca.uk] INFO: Saving data for BT73%20RVP: {'created_time': 1774821785.896121, 'last_price_update_time': 1774821785.896134, 'auction_closing_time': 1774951200.0}
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BT73%2520RVP') HTTP/1.1" 204 0
2026-03-29 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073189/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF17VPN/42811060?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=YkLrcIHkwtrZsjUa2prubREuXQStMy8DMOWlaZjCM6o%3D)
2026-03-29 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242917/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58XVG/42790595?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=vcjXHy%2BXcxnL8fVcBSIy1zRUfNwdkYA77TQSDd3JyNw%3D)
2026-03-29 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023406/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12WNS/42810774?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=tTo%2B0xotySQc25NFgljm0ZLwDTnsvqG5v%2FSimEvL7PM%3D)
2026-03-29 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246761/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST62SYF/42809590?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=r1Z4o1RO41%2Frbsi6j2NujNSq2CIa1MRr3E0xDNV9JdE%3D)
2026-03-29 22:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211016/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO08HUA/42769935?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=UrTho4OU5emtGOfXKZ0dWvPhmltT%2BxjdBAxxllTvFdc%3D)
2026-03-29 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023397/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023397>
2026-03-29 22:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073179/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073179>
2026-03-29 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611cb910>
2026-03-29 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO58EBF%252F699457249%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457249/600 saved to cache
2026-03-29 22:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 779863fc-56f0-5718-9334-675ca35049bb
2026-03-29 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63512f10>
2026-03-29 22:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMC14KAE%252F699252047%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699252047/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97c5232d-22c9-5728-b6fd-84d8da4f8949
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246750/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST62SYF/42809590?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=r1Z4o1RO41%2Frbsi6j2NujNSq2CIa1MRr3E0xDNV9JdE%3D)
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD21EYG/42811881?sv=2020-08-04&st=2026-03-29T22%3A03%3A05Z&se=2026-03-29T22%3A28%3A05Z&sr=b&sp=r&sig=bnMJQKaIj4tEQlQpGjCj33Ul6l1Ct09lX1OCbY5VgkA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD21%20EYG-GB>
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242909/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242909>
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457248/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO58EBF/42810110?sv=2020-08-04&st=2026-03-29T22%3A01%3A02Z&se=2026-03-29T22%3A26%3A02Z&sr=b&sp=r&sig=l1yGxyGiXjxmhLTIgBa00vRGvOItb%2B7FOLk9BOk0TjI%3D)
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699252032/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MC14KAE/42809755?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=DG6b3zLT1DRX51p27qxjR95H%2BdTJAJxRv%2B3BMmM%2BaS4%3D)
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234595/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK55EXG/42758130?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=zNKuCsXwY5YBweBL8fGiYSmIg6c7hmRzF6E4Qyh0WVI%3D)
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212610/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL11KPY/42783241?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=Q5R98DxLk%2FIyOrHb6oSyVq%2Bq9sVfHG45AhfvPKzaek4%3D)
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699240036/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KD15FPU/42809529?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=fvJF7ucpRX0E%2BAJp%2BX9CWPAyJRKbO%2FRJwWNOYDHIzAs%3D)
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6867b610>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF17VPN%252F699073189%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073189/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5439021f-449a-5c9e-a193-64352e476208
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63672210>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58XVG%252F699242917%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242917/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cdbe3643-d056-5481-b487-6a8e20861864
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611ba5d0>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12WNS%252F699023406%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023406/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e630b36-cd01-5007-b4b4-e80c316bb326
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611a3190>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST62SYF%252F699246761%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246761/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b294b559-83e7-5079-b89e-3524dea19cc0
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61538ad0>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO08HUA%252F699211016%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211016/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9816a6af-47f8-5106-89d9-6d77d25fd0f4
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63679150>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST62SYF%252F699246750%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246750/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b294b559-83e7-5079-b89e-3524dea19cc0
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b9d10>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO58EBF%252F699457248%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457248/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 779863fc-56f0-5718-9334-675ca35049bb
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617ed9d0>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMC14KAE%252F699252032%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699252032/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97c5232d-22c9-5728-b6fd-84d8da4f8949
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637aca50>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK55EXG%252F699234595%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234595/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0991f76e-fa68-5257-8869-29bbc185bed6
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617edb50>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL11KPY%252F699212610%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212610/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620845d0>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKD15FPU%252F699240036%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699240036/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023397/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12WNS/42810774?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=tTo%2B0xotySQc25NFgljm0ZLwDTnsvqG5v%2FSimEvL7PM%3D)
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073179/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF17VPN/42811060?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=YkLrcIHkwtrZsjUa2prubREuXQStMy8DMOWlaZjCM6o%3D)
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211010/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699211010>
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212596/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212596>
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699240020/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699240020>
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK13HHL/42812139?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=RAKNklYi74eIxrqRafi9qwqj0BnBsh5ug7iIvVuOhHs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK13%20HHL-GB>
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699252019/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252019>
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234576/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234576>
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023386/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023386>
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210999/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699210999>
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457247/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VO58EBF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242902/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242902>
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073164/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073164>
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246741/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699246741>
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242909/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58XVG/42790595?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=vcjXHy%2BXcxnL8fVcBSIy1zRUfNwdkYA77TQSDd3JyNw%3D)
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6179bd50>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12WNS%252F699023397%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023397/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e630b36-cd01-5007-b4b4-e80c316bb326
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD21EYG/42811881?sv=2020-08-04&st=2026-03-29T22%3A03%3A05Z&se=2026-03-29T22%3A28%3A05Z&sr=b&sp=r&sig=bnMJQKaIj4tEQlQpGjCj33Ul6l1Ct09lX1OCbY5VgkA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234576/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK55EXG/42758130?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=zNKuCsXwY5YBweBL8fGiYSmIg6c7hmRzF6E4Qyh0WVI%3D)
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69973050>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF17VPN%252F699073179%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073179/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5439021f-449a-5c9e-a193-64352e476208
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234566/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234566>
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699240020/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KD15FPU/42809529?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=fvJF7ucpRX0E%2BAJp%2BX9CWPAyJRKbO%2FRJwWNOYDHIzAs%3D)
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212596/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL11KPY/42783241?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=Q5R98DxLk%2FIyOrHb6oSyVq%2Bq9sVfHG45AhfvPKzaek4%3D)
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211010/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO08HUA/42769935?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=UrTho4OU5emtGOfXKZ0dWvPhmltT%2BxjdBAxxllTvFdc%3D)
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699252019/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MC14KAE/42809755?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=DG6b3zLT1DRX51p27qxjR95H%2BdTJAJxRv%2B3BMmM%2BaS4%3D)
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615a2090>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58XVG%252F699242909%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242909/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cdbe3643-d056-5481-b487-6a8e20861864
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK13HHL/42812139?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=RAKNklYi74eIxrqRafi9qwqj0BnBsh5ug7iIvVuOhHs%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212581/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212581>
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073164/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF17VPN/42811060?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=YkLrcIHkwtrZsjUa2prubREuXQStMy8DMOWlaZjCM6o%3D)
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457247/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO58EBF/42810110?sv=2020-08-04&st=2026-03-29T22%3A01%3A02Z&se=2026-03-29T22%3A26%3A02Z&sr=b&sp=r&sig=l1yGxyGiXjxmhLTIgBa00vRGvOItb%2B7FOLk9BOk0TjI%3D)
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242902/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58XVG/42790595?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=vcjXHy%2BXcxnL8fVcBSIy1zRUfNwdkYA77TQSDd3JyNw%3D)
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210999/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO08HUA/42769935?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=UrTho4OU5emtGOfXKZ0dWvPhmltT%2BxjdBAxxllTvFdc%3D)
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c784d0>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_expert_report_file_8c4b7725-45e8-4f78-90cd-ce034b5471ea.pdf HTTP/1.1" 201 0
2026-03-29 22:03:06 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d394566c-2f64-5973-8159-519cccf81ad9
2026-03-29 22:03:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d394566c-2f64-5973-8159-519cccf81ad9, skipping ID generation
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d394566c-2f64-5973-8159-519cccf81ad9
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLD21EYG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD21EYG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616dd710>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK55EXG%252F699234576%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234576/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0991f76e-fa68-5257-8869-29bbc185bed6
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246741/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST62SYF/42809590?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=r1Z4o1RO41%2Frbsi6j2NujNSq2CIa1MRr3E0xDNV9JdE%3D)
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023386/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12WNS/42810774?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=tTo%2B0xotySQc25NFgljm0ZLwDTnsvqG5v%2FSimEvL7PM%3D)
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699240002/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699240002>
2026-03-29 22:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234566/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK55EXG/42758130?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=zNKuCsXwY5YBweBL8fGiYSmIg6c7hmRzF6E4Qyh0WVI%3D)
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699252004/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252004>
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023372/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MT12WNS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246734/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ST62SYF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388287%27 HTTP/1.1" 200 None
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388287 not downloaded yet
2026-03-29 22:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HJ73TXT/42812092?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=z%2BNxAmfXoDqPId%2BCuPHmnpw3AllP9HAw35myvwbm5qE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HJ73%20TXT-GB>
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388305%27 HTTP/1.1" 200 None
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388305 not downloaded yet
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637a4990>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKD15FPU%252F699240020%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699240020/600 saved to cache
2026-03-29 22:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6209a850>
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL11KPY%252F699212596%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212596/600 saved to cache
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6208ba50>
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO08HUA%252F699211010%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211010/600 saved to cache
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9816a6af-47f8-5106-89d9-6d77d25fd0f4
2026-03-29 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620990d0>
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMC14KAE%252F699252019%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699252019/600 saved to cache
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97c5232d-22c9-5728-b6fd-84d8da4f8949
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614bab90>
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_expert_report_file_815d130f-b93b-4170-9f7c-0aa6be4367e2.pdf HTTP/1.1" 201 0
2026-03-29 22:03:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a1e4cdef-f735-5359-9a05-4d45d8b45964
2026-03-29 22:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1e4cdef-f735-5359-9a05-4d45d8b45964, skipping ID generation
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1e4cdef-f735-5359-9a05-4d45d8b45964
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPK13HHL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PK13HHL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6209b890>
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF17VPN%252F699073164%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073164/600 saved to cache
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5439021f-449a-5c9e-a193-64352e476208
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620c2910>
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO58EBF%252F699457247%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457247/600 saved to cache
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 779863fc-56f0-5718-9334-675ca35049bb
2026-03-29 22:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 779863fc-56f0-5718-9334-675ca35049bb, skipping ID generation
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 779863fc-56f0-5718-9334-675ca35049bb sending to next pipeline
2026-03-29 22:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 779863fc-56f0-5718-9334-675ca35049bb, identifier: VO58%20EBF
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63510090>
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58XVG%252F699242902%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242902/600 saved to cache
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cdbe3643-d056-5481-b487-6a8e20861864
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63622b10>
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO08HUA%252F699210999%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210999/600 saved to cache
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9816a6af-47f8-5106-89d9-6d77d25fd0f4
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388321%27 HTTP/1.1" 200 None
2026-03-29 22:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388321 not downloaded yet
2026-03-29 22:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 779863fc-56f0-5718-9334-675ca35049bb with identifier: VO58%20EBF
2026-03-29 22:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 779863fc-56f0-5718-9334-675ca35049bb with identifier: VO58%20EBF
2026-03-29 22:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 779863fc-56f0-5718-9334-675ca35049bb with identifier: VO58%20EBF to the API
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457247/600>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_expert_report_file_454b36be-2fc0-4155-a5ff-7668c6749ff3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO58%20EBF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': '779863fc-56f0-5718-9334-675ca35049bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO58 EBF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO58%20EBF&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 119270,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40017,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457247/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39695,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457248/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38607,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457249/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40633,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457250/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39271,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457251/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36433,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457252/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90869,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457253/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67543,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457254/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81983,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457256/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_779863fc-56f0-5718-9334-675ca35049bb/779863fc-56f0-5718-9334-675ca35049bb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93235,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO58EBF/699457259/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 SW 1.6 HDI 90 S MPV',
'transmission': 'manual',
'trim': 'HDI 90 S',
'vin': 'VF34E9HXC55299088',
'year': 2008}
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO58%2520EBF%27 HTTP/1.1" 200 None
2026-03-29 22:03:07 [bca.uk] INFO: Saving data for VO58%20EBF: {'created_time': 1774821787.940511, 'last_price_update_time': 1774821787.940528, 'auction_closing_time': 1775210400.0}
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO58%2520EBF') HTTP/1.1" 204 0
2026-03-29 22:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242897/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699242897>
2026-03-29 22:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210991/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699210991>
2026-03-29 22:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411831/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411831>
2026-03-29 22:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406390>
2026-03-29 22:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073149/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073149>
2026-03-29 22:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234555/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234555>
2026-03-29 22:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040295/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040295>
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400436%27 HTTP/1.1" 200 None
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400436 not downloaded yet
2026-03-29 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212581/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL11KPY/42783241?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=Q5R98DxLk%2FIyOrHb6oSyVq%2Bq9sVfHG45AhfvPKzaek4%3D)
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388331%27 HTTP/1.1" 200 None
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388331 not downloaded yet
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400444%27 HTTP/1.1" 200 None
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400444 not downloaded yet
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388343%27 HTTP/1.1" 200 None
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388343 not downloaded yet
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6179d590>
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST62SYF%252F699246741%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246741/600 saved to cache
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b294b559-83e7-5079-b89e-3524dea19cc0
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636bf850>
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12WNS%252F699023386%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023386/600 saved to cache
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e630b36-cd01-5007-b4b4-e80c316bb326
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63727b50>
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK55EXG%252F699234566%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234566/600 saved to cache
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0991f76e-fa68-5257-8869-29bbc185bed6
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400451%27 HTTP/1.1" 200 None
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400451 not downloaded yet
2026-03-29 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246734/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ST62SYF/42809590?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=r1Z4o1RO41%2Frbsi6j2NujNSq2CIa1MRr3E0xDNV9JdE%3D)
2026-03-29 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023372/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT12WNS/42810774?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=tTo%2B0xotySQc25NFgljm0ZLwDTnsvqG5v%2FSimEvL7PM%3D)
2026-03-29 22:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212569/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212569>
2026-03-29 22:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239980/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699239980>
2026-03-29 22:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388275/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD21EYG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HJ73TXT/42812092?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=z%2BNxAmfXoDqPId%2BCuPHmnpw3AllP9HAw35myvwbm5qE%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388356%27 HTTP/1.1" 200 None
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388356 not downloaded yet
2026-03-29 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699240002/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KD15FPU/42809529?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=fvJF7ucpRX0E%2BAJp%2BX9CWPAyJRKbO%2FRJwWNOYDHIzAs%3D)
2026-03-29 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699252004/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MC14KAE/42809755?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=DG6b3zLT1DRX51p27qxjR95H%2BdTJAJxRv%2B3BMmM%2BaS4%3D)
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400455%27 HTTP/1.1" 200 None
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400455 not downloaded yet
2026-03-29 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61643590>
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL11KPY%252F699212581%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212581/600 saved to cache
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388390%27 HTTP/1.1" 200 None
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388390 not downloaded yet
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400460%27 HTTP/1.1" 200 None
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400460 not downloaded yet
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388415%27 HTTP/1.1" 200 None
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388415 not downloaded yet
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400474%27 HTTP/1.1" 200 None
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400474 not downloaded yet
2026-03-29 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242897/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58XVG/42790595?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=vcjXHy%2BXcxnL8fVcBSIy1zRUfNwdkYA77TQSDd3JyNw%3D)
2026-03-29 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073149/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF17VPN/42811060?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=YkLrcIHkwtrZsjUa2prubREuXQStMy8DMOWlaZjCM6o%3D)
2026-03-29 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210991/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO08HUA/42769935?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=UrTho4OU5emtGOfXKZ0dWvPhmltT%2BxjdBAxxllTvFdc%3D)
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388434%27 HTTP/1.1" 200 None
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388434 not downloaded yet
2026-03-29 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234555/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK55EXG/42758130?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=zNKuCsXwY5YBweBL8fGiYSmIg6c7hmRzF6E4Qyh0WVI%3D)
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400480%27 HTTP/1.1" 200 None
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400480 not downloaded yet
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637b6f10>
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FST62SYF%252F699246734%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246734/600 saved to cache
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b294b559-83e7-5079-b89e-3524dea19cc0
2026-03-29 22:03:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b294b559-83e7-5079-b89e-3524dea19cc0, skipping ID generation
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b294b559-83e7-5079-b89e-3524dea19cc0 sending to next pipeline
2026-03-29 22:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b294b559-83e7-5079-b89e-3524dea19cc0, identifier: ST62%20SYF
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63559990>
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT12WNS%252F699023372%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023372/600 saved to cache
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e630b36-cd01-5007-b4b4-e80c316bb326
2026-03-29 22:03:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e630b36-cd01-5007-b4b4-e80c316bb326, skipping ID generation
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e630b36-cd01-5007-b4b4-e80c316bb326 sending to next pipeline
2026-03-29 22:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4e630b36-cd01-5007-b4b4-e80c316bb326, identifier: MT12%20WNS
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61168e90>
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_expert_report_file_0abde917-2676-412a-bd86-fee1810734b1.pdf HTTP/1.1" 201 0
2026-03-29 22:03:08 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 888140b1-3c5d-5e43-a8ef-e5925368639e
2026-03-29 22:03:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 888140b1-3c5d-5e43-a8ef-e5925368639e, skipping ID generation
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 888140b1-3c5d-5e43-a8ef-e5925368639e
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHJ73TXT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HJ73TXT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63558bd0>
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKD15FPU%252F699240002%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699240002/600 saved to cache
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78
2026-03-29 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6368c650>
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMC14KAE%252F699252004%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699252004/600 saved to cache
2026-03-29 22:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97c5232d-22c9-5728-b6fd-84d8da4f8949
2026-03-29 22:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040295/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70YYW/42571204?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=3YETERDVJsfcYf9zoGQQnS8MvGAFRjTT6qcrLaHjjZg%3D)
2026-03-29 22:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388321/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388321>
2026-03-29 22:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b294b559-83e7-5079-b89e-3524dea19cc0 with identifier: ST62%20SYF
2026-03-29 22:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b294b559-83e7-5079-b89e-3524dea19cc0 with identifier: ST62%20SYF
2026-03-29 22:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b294b559-83e7-5079-b89e-3524dea19cc0 with identifier: ST62%20SYF to the API
2026-03-29 22:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246734/600>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_expert_report_file_0f77e131-f25f-4787-8534-55427fca004f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ST62%20SYF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b294b559-83e7-5079-b89e-3524dea19cc0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ST62 SYF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ST62%20SYF&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MINI',
'model': 'COUNTRYMAN',
'odometer': 82398,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38555,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246734/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39216,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246741/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37092,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246750/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37581,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246761/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36905,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246766/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35933,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246776/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84061,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246789/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69107,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246805/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83234,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246821/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b294b559-83e7-5079-b89e-3524dea19cc0/b294b559-83e7-5079-b89e-3524dea19cc0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90398,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ST62SYF/699246836/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'MINI COUNTRYMAN 1.6 ONE D Hatchback',
'transmission': 'manual',
'trim': 'ONE D',
'vin': 'WMWZD12030WM84562',
'year': 2013}
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST62%2520SYF%27 HTTP/1.1" 200 None
2026-03-29 22:03:09 [bca.uk] INFO: Saving data for ST62%20SYF: {'created_time': 1774821789.123391, 'last_price_update_time': 1774821789.123406, 'auction_closing_time': 1775210400.0}
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ST62%2520SYF') HTTP/1.1" 204 0
2026-03-29 22:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4e630b36-cd01-5007-b4b4-e80c316bb326 with identifier: MT12%20WNS
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=turquoise HTTP/1.1" 200 None
2026-03-29 22:03:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4e630b36-cd01-5007-b4b4-e80c316bb326 with identifier: MT12%20WNS
2026-03-29 22:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4e630b36-cd01-5007-b4b4-e80c316bb326 with identifier: MT12%20WNS to the API
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023372/600>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_expert_report_file_d3f089a6-8916-4291-8e92-9c3758449c69.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT12%20WNS-GB',
'category': 'Car',
'color': 'turquoise',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4e630b36-cd01-5007-b4b4-e80c316bb326',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT12 WNS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT12%20WNS&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 61057,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40845,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023372/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38669,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023386/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39730,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023397/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40579,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023406/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37397,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023418/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35897,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023429/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97325,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023450/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83794,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023478/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94242,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023576/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e630b36-cd01-5007-b4b4-e80c316bb326/4e630b36-cd01-5007-b4b4-e80c316bb326_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90860,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT12WNS/699023613/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.3 VVT-I TR M/DRIVE-S Hatchback',
'transmission': 'manual',
'trim': 'VVT-I TR M/DRIVE-S',
'vin': 'VNKKJ3D360A060698',
'year': 2012}
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT12%2520WNS%27 HTTP/1.1" 200 None
2026-03-29 22:03:09 [bca.uk] INFO: Saving data for MT12%20WNS: {'created_time': 1774821789.654907, 'last_price_update_time': 1774821789.65492, 'auction_closing_time': 1775210400.0}
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT12%2520WNS') HTTP/1.1" 204 0
2026-03-29 22:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411831/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP65LKN/42812099?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=YYiddic%2BqcqY2M0XPOfW0%2FrAPtac9opCHs6%2B5ikpuFw%3D)
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400485%27 HTTP/1.1" 200 None
2026-03-29 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400485 not downloaded yet
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395821%27 HTTP/1.1" 200 None
2026-03-29 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395821 not downloaded yet
2026-03-29 22:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212569/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL11KPY/42783241?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=Q5R98DxLk%2FIyOrHb6oSyVq%2Bq9sVfHG45AhfvPKzaek4%3D)
2026-03-29 22:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239980/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KD15FPU/42809529?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=fvJF7ucpRX0E%2BAJp%2BX9CWPAyJRKbO%2FRJwWNOYDHIzAs%3D)
2026-03-29 22:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388275/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD21EYG/42811881?sv=2020-08-04&st=2026-03-29T22%3A03%3A05Z&se=2026-03-29T22%3A28%3A05Z&sr=b&sp=r&sig=bnMJQKaIj4tEQlQpGjCj33Ul6l1Ct09lX1OCbY5VgkA%3D)
2026-03-29 22:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400451/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400451>
2026-03-29 22:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406390/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LA70NPE/42811995?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=1ymICcEKrtpKHFHLQTc1yKaMMeniIFUDVOMDF5neyAs%3D)
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400491%27 HTTP/1.1" 200 None
2026-03-29 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400491 not downloaded yet
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395838%27 HTTP/1.1" 200 None
2026-03-29 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395838 not downloaded yet
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611b9250>
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58XVG%252F699242897%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242897/600 saved to cache
2026-03-29 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cdbe3643-d056-5481-b487-6a8e20861864
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637d8e10>
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF17VPN%252F699073149%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073149/600 saved to cache
2026-03-29 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5439021f-449a-5c9e-a193-64352e476208
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61641e90>
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO08HUA%252F699210991%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210991/600 saved to cache
2026-03-29 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9816a6af-47f8-5106-89d9-6d77d25fd0f4
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617f5f50>
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK55EXG%252F699234555%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234555/600 saved to cache
2026-03-29 22:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0991f76e-fa68-5257-8869-29bbc185bed6
2026-03-29 22:03:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61972fd0>
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70YYW%252F699040295%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040295/600 saved to cache
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01b57636-ffd9-585f-9b00-e6ae7dbcc329
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388331/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388331>
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395856%27 HTTP/1.1" 200 None
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395856 not downloaded yet
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388343/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388343>
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63679910>
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP65LKN%252F699411831%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411831/600 saved to cache
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6062366a-77b0-5b3c-aa23-49414d769971
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6360cb50>
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL11KPY%252F699212569%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212569/600 saved to cache
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637c5a50>
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKD15FPU%252F699239980%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239980/600 saved to cache
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6360e3d0>
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD21EYG%252F699388275%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388275/600 saved to cache
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d394566c-2f64-5973-8159-519cccf81ad9
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61637950>
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLA70NPE%252F699406390%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406390/600 saved to cache
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4838ed0-a1bc-555f-ae17-73d79e29d1ac
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388415/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388415>
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400444/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400444>
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400436/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400436>
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400474/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400474>
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400460/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400460>
2026-03-29 22:03:10 [scrapy.extensions.logstats] INFO: Crawled 87 pages (at 30 pages/min), scraped 136 items (at 55 items/min)
2026-03-29 22:03:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395875%27 HTTP/1.1" 200 None
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395875 not downloaded yet
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388390>
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395894%27 HTTP/1.1" 200 None
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395894 not downloaded yet
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395923%27 HTTP/1.1" 200 None
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395923 not downloaded yet
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395940%27 HTTP/1.1" 200 None
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395940 not downloaded yet
2026-03-29 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388321/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD21EYG/42811881?sv=2020-08-04&st=2026-03-29T22%3A03%3A05Z&se=2026-03-29T22%3A28%3A05Z&sr=b&sp=r&sig=bnMJQKaIj4tEQlQpGjCj33Ul6l1Ct09lX1OCbY5VgkA%3D)
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395967%27 HTTP/1.1" 200 None
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395967 not downloaded yet
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395991%27 HTTP/1.1" 200 None
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395991 not downloaded yet
2026-03-29 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400451/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK13HHL/42812139?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=RAKNklYi74eIxrqRafi9qwqj0BnBsh5ug7iIvVuOhHs%3D)
2026-03-29 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388343/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD21EYG/42811881?sv=2020-08-04&st=2026-03-29T22%3A03%3A05Z&se=2026-03-29T22%3A28%3A05Z&sr=b&sp=r&sig=bnMJQKaIj4tEQlQpGjCj33Ul6l1Ct09lX1OCbY5VgkA%3D)
2026-03-29 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388331/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD21EYG/42811881?sv=2020-08-04&st=2026-03-29T22%3A03%3A05Z&se=2026-03-29T22%3A28%3A05Z&sr=b&sp=r&sig=bnMJQKaIj4tEQlQpGjCj33Ul6l1Ct09lX1OCbY5VgkA%3D)
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610028d0>
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD21EYG%252F699388321%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388321/600 saved to cache
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d394566c-2f64-5973-8159-519cccf81ad9
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61745b50>
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK13HHL%252F699400451%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400451/600 saved to cache
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1e4cdef-f735-5359-9a05-4d45d8b45964
2026-03-29 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400460/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK13HHL/42812139?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=RAKNklYi74eIxrqRafi9qwqj0BnBsh5ug7iIvVuOhHs%3D)
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61002790>
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD21EYG%252F699388343%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388343/600 saved to cache
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d394566c-2f64-5973-8159-519cccf81ad9
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6118db90>
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD21EYG%252F699388331%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388331/600 saved to cache
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d394566c-2f64-5973-8159-519cccf81ad9
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395798/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HJ73TXT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388356/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388356>
2026-03-29 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400474/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK13HHL/42812139?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=RAKNklYi74eIxrqRafi9qwqj0BnBsh5ug7iIvVuOhHs%3D)
2026-03-29 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400436/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK13HHL/42812139?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=RAKNklYi74eIxrqRafi9qwqj0BnBsh5ug7iIvVuOhHs%3D)
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400455/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400455>
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400480/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400480>
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388434/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388434>
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400430/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PK13HHL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637ee850>
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK13HHL%252F699400460%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400460/600 saved to cache
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1e4cdef-f735-5359-9a05-4d45d8b45964
2026-03-29 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388390/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD21EYG/42811881?sv=2020-08-04&st=2026-03-29T22%3A03%3A05Z&se=2026-03-29T22%3A28%3A05Z&sr=b&sp=r&sig=bnMJQKaIj4tEQlQpGjCj33Ul6l1Ct09lX1OCbY5VgkA%3D)
2026-03-29 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400444/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK13HHL/42812139?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=RAKNklYi74eIxrqRafi9qwqj0BnBsh5ug7iIvVuOhHs%3D)
2026-03-29 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388415/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD21EYG/42811881?sv=2020-08-04&st=2026-03-29T22%3A03%3A05Z&se=2026-03-29T22%3A28%3A05Z&sr=b&sp=r&sig=bnMJQKaIj4tEQlQpGjCj33Ul6l1Ct09lX1OCbY5VgkA%3D)
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617efcd0>
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK13HHL%252F699400474%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400474/600 saved to cache
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1e4cdef-f735-5359-9a05-4d45d8b45964
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395940/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395940>
2026-03-29 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395798/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HJ73TXT/42812092?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=z%2BNxAmfXoDqPId%2BCuPHmnpw3AllP9HAw35myvwbm5qE%3D)
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395991/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395991>
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395967/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395967>
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395923/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395923>
2026-03-29 22:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395894/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395894>
2026-03-29 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388356/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD21EYG/42811881?sv=2020-08-04&st=2026-03-29T22%3A03%3A05Z&se=2026-03-29T22%3A28%3A05Z&sr=b&sp=r&sig=bnMJQKaIj4tEQlQpGjCj33Ul6l1Ct09lX1OCbY5VgkA%3D)
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620ab110>
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK13HHL%252F699400436%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400436/600 saved to cache
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1e4cdef-f735-5359-9a05-4d45d8b45964
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61538bd0>
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD21EYG%252F699388390%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388390/600 saved to cache
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d394566c-2f64-5973-8159-519cccf81ad9
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616af5d0>
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK13HHL%252F699400444%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400444/600 saved to cache
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1e4cdef-f735-5359-9a05-4d45d8b45964
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63631950>
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD21EYG%252F699388415%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388415/600 saved to cache
2026-03-29 22:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d394566c-2f64-5973-8159-519cccf81ad9
2026-03-29 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400455/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK13HHL/42812139?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=RAKNklYi74eIxrqRafi9qwqj0BnBsh5ug7iIvVuOhHs%3D)
2026-03-29 22:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400430/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK13HHL/42812139?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=RAKNklYi74eIxrqRafi9qwqj0BnBsh5ug7iIvVuOhHs%3D)
2026-03-29 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400480/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK13HHL/42812139?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=RAKNklYi74eIxrqRafi9qwqj0BnBsh5ug7iIvVuOhHs%3D)
2026-03-29 22:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395875/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395875>
2026-03-29 22:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395838/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395838>
2026-03-29 22:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395856/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395856>
2026-03-29 22:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400491/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400491>
2026-03-29 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388434/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD21EYG/42811881?sv=2020-08-04&st=2026-03-29T22%3A03%3A05Z&se=2026-03-29T22%3A28%3A05Z&sr=b&sp=r&sig=bnMJQKaIj4tEQlQpGjCj33Ul6l1Ct09lX1OCbY5VgkA%3D)
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611c9210>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHJ73TXT%252F699395798%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395798/600 saved to cache
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 888140b1-3c5d-5e43-a8ef-e5925368639e
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6208af10>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD21EYG%252F699388356%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388356/600 saved to cache
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d394566c-2f64-5973-8159-519cccf81ad9
2026-03-29 22:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400485/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400485>
2026-03-29 22:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395821/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395821>
2026-03-29 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395967/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HJ73TXT/42812092?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=z%2BNxAmfXoDqPId%2BCuPHmnpw3AllP9HAw35myvwbm5qE%3D)
2026-03-29 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395991/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HJ73TXT/42812092?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=z%2BNxAmfXoDqPId%2BCuPHmnpw3AllP9HAw35myvwbm5qE%3D)
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617efa90>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK13HHL%252F699400455%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400455/600 saved to cache
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1e4cdef-f735-5359-9a05-4d45d8b45964
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62088390>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK13HHL%252F699400430%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400430/600 saved to cache
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1e4cdef-f735-5359-9a05-4d45d8b45964
2026-03-29 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395940/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HJ73TXT/42812092?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=z%2BNxAmfXoDqPId%2BCuPHmnpw3AllP9HAw35myvwbm5qE%3D)
2026-03-29 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395923/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HJ73TXT/42812092?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=z%2BNxAmfXoDqPId%2BCuPHmnpw3AllP9HAw35myvwbm5qE%3D)
2026-03-29 22:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388305/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388305>
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69cd2810>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK13HHL%252F699400480%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400480/600 saved to cache
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1e4cdef-f735-5359-9a05-4d45d8b45964
2026-03-29 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395856/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HJ73TXT/42812092?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=z%2BNxAmfXoDqPId%2BCuPHmnpw3AllP9HAw35myvwbm5qE%3D)
2026-03-29 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395875/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HJ73TXT/42812092?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=z%2BNxAmfXoDqPId%2BCuPHmnpw3AllP9HAw35myvwbm5qE%3D)
2026-03-29 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395894/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HJ73TXT/42812092?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=z%2BNxAmfXoDqPId%2BCuPHmnpw3AllP9HAw35myvwbm5qE%3D)
2026-03-29 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395838/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HJ73TXT/42812092?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=z%2BNxAmfXoDqPId%2BCuPHmnpw3AllP9HAw35myvwbm5qE%3D)
2026-03-29 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400491/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK13HHL/42812139?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=RAKNklYi74eIxrqRafi9qwqj0BnBsh5ug7iIvVuOhHs%3D)
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620c1bd0>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD21EYG%252F699388434%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388434/600 saved to cache
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d394566c-2f64-5973-8159-519cccf81ad9
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61814150>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHJ73TXT%252F699395967%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395967/600 saved to cache
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 888140b1-3c5d-5e43-a8ef-e5925368639e
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6179fa50>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHJ73TXT%252F699395991%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395991/600 saved to cache
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 888140b1-3c5d-5e43-a8ef-e5925368639e
2026-03-29 22:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251990/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251990>
2026-03-29 22:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388287/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388287>
2026-03-29 22:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR67NZG/42811985?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=pIAxLaG6p7818wlJOtvbmDmU4CemR7e2Qm%2FruKj4j8c%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YR67%20NZG-GB>
2026-03-29 22:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411816/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411816>
2026-03-29 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395821/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HJ73TXT/42812092?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=z%2BNxAmfXoDqPId%2BCuPHmnpw3AllP9HAw35myvwbm5qE%3D)
2026-03-29 22:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073138/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PF17VPN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040265/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040265>
2026-03-29 22:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400485/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK13HHL/42812139?sv=2020-08-04&st=2026-03-29T22%3A03%3A06Z&se=2026-03-29T22%3A28%3A06Z&sr=b&sp=r&sig=RAKNklYi74eIxrqRafi9qwqj0BnBsh5ug7iIvVuOhHs%3D)
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620c1d10>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHJ73TXT%252F699395940%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395940/600 saved to cache
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 888140b1-3c5d-5e43-a8ef-e5925368639e
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621b9710>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHJ73TXT%252F699395923%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395923/600 saved to cache
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 888140b1-3c5d-5e43-a8ef-e5925368639e
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637ad310>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHJ73TXT%252F699395856%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395856/600 saved to cache
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 888140b1-3c5d-5e43-a8ef-e5925368639e
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621ba8d0>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHJ73TXT%252F699395875%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395875/600 saved to cache
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 888140b1-3c5d-5e43-a8ef-e5925368639e
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61171d10>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHJ73TXT%252F699395894%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395894/600 saved to cache
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 888140b1-3c5d-5e43-a8ef-e5925368639e
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6368f8d0>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHJ73TXT%252F699395838%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395838/600 saved to cache
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 888140b1-3c5d-5e43-a8ef-e5925368639e
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6115ce10>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK13HHL%252F699400491%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400491/600 saved to cache
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1e4cdef-f735-5359-9a05-4d45d8b45964
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6115c6d0>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHJ73TXT%252F699395821%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395821/600 saved to cache
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 888140b1-3c5d-5e43-a8ef-e5925368639e
2026-03-29 22:03:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 888140b1-3c5d-5e43-a8ef-e5925368639e, skipping ID generation
2026-03-29 22:03:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 888140b1-3c5d-5e43-a8ef-e5925368639e sending to next pipeline
2026-03-29 22:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 888140b1-3c5d-5e43-a8ef-e5925368639e, identifier: HJ73%20TXT
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac684cad10>
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK13HHL%252F699400485%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400485/600 saved to cache
2026-03-29 22:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1e4cdef-f735-5359-9a05-4d45d8b45964
2026-03-29 22:03:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1e4cdef-f735-5359-9a05-4d45d8b45964, skipping ID generation
2026-03-29 22:03:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1e4cdef-f735-5359-9a05-4d45d8b45964 sending to next pipeline
2026-03-29 22:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a1e4cdef-f735-5359-9a05-4d45d8b45964, identifier: PK13%20HHL
2026-03-29 22:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 888140b1-3c5d-5e43-a8ef-e5925368639e with identifier: HJ73%20TXT
2026-03-29 22:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 888140b1-3c5d-5e43-a8ef-e5925368639e with identifier: HJ73%20TXT
2026-03-29 22:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 888140b1-3c5d-5e43-a8ef-e5925368639e with identifier: HJ73%20TXT to the API
2026-03-29 22:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395821/600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_expert_report_file_0abde917-2676-412a-bd86-fee1810734b1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HJ73%20TXT-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': '888140b1-3c5d-5e43-a8ef-e5925368639e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HJ73 TXT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HJ73%20TXT&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'DACIA',
'model': 'DUSTER',
'odometer': 29677,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47480,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395798/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46321,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395821/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46292,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395838/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47397,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395856/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45672,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395875/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44815,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395894/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82568,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395923/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57986,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395940/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70982,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395967/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_888140b1-3c5d-5e43-a8ef-e5925368639e/888140b1-3c5d-5e43-a8ef-e5925368639e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63905,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HJ73TXT/699395991/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'DACIA DUSTER 1.0 TCE ESSENTIAL Van',
'transmission': 'manual',
'trim': 'TCE ESSENTIAL',
'vin': 'VF1HJD20871341718',
'year': 2023}
2026-03-29 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ73%2520TXT%27 HTTP/1.1" 200 None
2026-03-29 22:03:12 [bca.uk] INFO: Saving data for HJ73%20TXT: {'created_time': 1774821792.509931, 'last_price_update_time': 1774821792.509942, 'auction_closing_time': 1775037600.0}
2026-03-29 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HJ73%2520TXT') HTTP/1.1" 204 0
2026-03-29 22:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a1e4cdef-f735-5359-9a05-4d45d8b45964 with identifier: PK13%20HHL
2026-03-29 22:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a1e4cdef-f735-5359-9a05-4d45d8b45964 with identifier: PK13%20HHL
2026-03-29 22:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a1e4cdef-f735-5359-9a05-4d45d8b45964 with identifier: PK13%20HHL to the API
2026-03-29 22:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400485/600>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_expert_report_file_815d130f-b93b-4170-9f7c-0aa6be4367e2.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK13%20HHL-GB',
'category': 'LightCommercialVehicle',
'color': 'blue',
'currency': 'GBP',
'doors_number': 6,
'engine': '1.6L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a1e4cdef-f735-5359-9a05-4d45d8b45964',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK13 HHL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PK13%20HHL&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'CADDY MAXI C20',
'odometer': 168974,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45462,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400430/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42975,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400436/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41662,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400444/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43553,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400451/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45396,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400455/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41731,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400460/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400474/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57212,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400480/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93747,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400485/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e4cdef-f735-5359-9a05-4d45d8b45964/a1e4cdef-f735-5359-9a05-4d45d8b45964_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57917,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK13HHL/699400491/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN CADDY MAXI C20 1.6 TDI 102 Van',
'transmission': 'manual',
'trim': 'TDI 102',
'vin': 'WV1ZZZ2KZDX124742',
'year': 2013}
2026-03-29 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK13%2520HHL%27 HTTP/1.1" 200 None
2026-03-29 22:03:12 [bca.uk] INFO: Saving data for PK13%20HHL: {'created_time': 1774821792.897321, 'last_price_update_time': 1774821792.897332, 'auction_closing_time': 1775124000.0}
2026-03-29 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PK13%2520HHL') HTTP/1.1" 204 0
2026-03-29 22:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388305/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD21EYG/42811881?sv=2020-08-04&st=2026-03-29T22%3A03%3A05Z&se=2026-03-29T22%3A28%3A05Z&sr=b&sp=r&sig=bnMJQKaIj4tEQlQpGjCj33Ul6l1Ct09lX1OCbY5VgkA%3D)
2026-03-29 22:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242887/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MK58XVG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN65OTA/42812298?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=HXci3LjOb3T4%2F91N2TEZkwx4YsEQW6Lkqy%2ByCGyzgK4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CN65%20OTA-GB>
2026-03-29 22:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406374/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406374>
2026-03-29 22:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210986/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699210986>
2026-03-29 22:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239969/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699239969>
2026-03-29 22:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212562/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212562>
2026-03-29 22:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234539/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234539>
2026-03-29 22:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388287/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD21EYG/42811881?sv=2020-08-04&st=2026-03-29T22%3A03%3A05Z&se=2026-03-29T22%3A28%3A05Z&sr=b&sp=r&sig=bnMJQKaIj4tEQlQpGjCj33Ul6l1Ct09lX1OCbY5VgkA%3D)
2026-03-29 22:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251990/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MC14KAE/42809755?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=DG6b3zLT1DRX51p27qxjR95H%2BdTJAJxRv%2B3BMmM%2BaS4%3D)
2026-03-29 22:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073138/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF17VPN/42811060?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=YkLrcIHkwtrZsjUa2prubREuXQStMy8DMOWlaZjCM6o%3D)
2026-03-29 22:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251980/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251980>
2026-03-29 22:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411816/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP65LKN/42812099?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=YYiddic%2BqcqY2M0XPOfW0%2FrAPtac9opCHs6%2B5ikpuFw%3D)
2026-03-29 22:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040265/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70YYW/42571204?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=3YETERDVJsfcYf9zoGQQnS8MvGAFRjTT6qcrLaHjjZg%3D)
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616438d0>
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD21EYG%252F699388305%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388305/600 saved to cache
2026-03-29 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d394566c-2f64-5973-8159-519cccf81ad9
2026-03-29 22:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR67NZG/42811985?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=pIAxLaG6p7818wlJOtvbmDmU4CemR7e2Qm%2FruKj4j8c%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435181/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435181>
2026-03-29 22:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234539/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK55EXG/42758130?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=zNKuCsXwY5YBweBL8fGiYSmIg6c7hmRzF6E4Qyh0WVI%3D)
2026-03-29 22:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210986/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO08HUA/42769935?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=UrTho4OU5emtGOfXKZ0dWvPhmltT%2BxjdBAxxllTvFdc%3D)
2026-03-29 22:03:13 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:03:13 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239969/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KD15FPU/42809529?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=fvJF7ucpRX0E%2BAJp%2BX9CWPAyJRKbO%2FRJwWNOYDHIzAs%3D)
2026-03-29 22:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212562/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL11KPY/42783241?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=Q5R98DxLk%2FIyOrHb6oSyVq%2Bq9sVfHG45AhfvPKzaek4%3D)
2026-03-29 22:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406374/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LA70NPE/42811995?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=1ymICcEKrtpKHFHLQTc1yKaMMeniIFUDVOMDF5neyAs%3D)
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6106c150>
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD21EYG%252F699388287%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388287/600 saved to cache
2026-03-29 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d394566c-2f64-5973-8159-519cccf81ad9
2026-03-29 22:03:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d394566c-2f64-5973-8159-519cccf81ad9, skipping ID generation
2026-03-29 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d394566c-2f64-5973-8159-519cccf81ad9 sending to next pipeline
2026-03-29 22:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d394566c-2f64-5973-8159-519cccf81ad9, identifier: LD21%20EYG
2026-03-29 22:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d394566c-2f64-5973-8159-519cccf81ad9 with identifier: LD21%20EYG
2026-03-29 22:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d394566c-2f64-5973-8159-519cccf81ad9 with identifier: LD21%20EYG
2026-03-29 22:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d394566c-2f64-5973-8159-519cccf81ad9 with identifier: LD21%20EYG to the API
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388287/600>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_expert_report_file_8c4b7725-45e8-4f78-90cd-ce034b5471ea.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD21%20EYG-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd394566c-2f64-5973-8159-519cccf81ad9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD21 EYG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD21%20EYG&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'CITROEN',
'model': 'BERLINGO M',
'odometer': 107308,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34945,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388275/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34645,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388287/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32400,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388305/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31380,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388321/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31477,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388331/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32949,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388343/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71290,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388356/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48832,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388390/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57395,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388415/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d394566c-2f64-5973-8159-519cccf81ad9/d394566c-2f64-5973-8159-519cccf81ad9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65257,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD21EYG/699388434/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'CITROEN BERLINGO M 1.5 BLUEHDI 75 650 ENTERPRISE Van',
'transmission': 'manual',
'trim': 'BLUEHDI 75 650 ENTERPRISE',
'vin': 'VR7EFYHWCMJ621794',
'year': 2021}
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD21%2520EYG%27 HTTP/1.1" 200 None
2026-03-29 22:03:13 [bca.uk] INFO: Saving data for LD21%20EYG: {'created_time': 1774821793.596044, 'last_price_update_time': 1774821793.596055, 'auction_closing_time': 1775037600.0}
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD21%2520EYG') HTTP/1.1" 204 0
2026-03-29 22:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN65OTA/42812298?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=HXci3LjOb3T4%2F91N2TEZkwx4YsEQW6Lkqy%2ByCGyzgK4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242887/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58XVG/42790595?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=vcjXHy%2BXcxnL8fVcBSIy1zRUfNwdkYA77TQSDd3JyNw%3D)
2026-03-29 22:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251980/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MC14KAE/42809755?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=DG6b3zLT1DRX51p27qxjR95H%2BdTJAJxRv%2B3BMmM%2BaS4%3D)
2026-03-29 22:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411666/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411666>
2026-03-29 22:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411803/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411803>
2026-03-29 22:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409299/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409299>
2026-03-29 22:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE21KSX/42812090?sv=2020-08-04&st=2026-03-29T22%3A03%3A13Z&se=2026-03-29T22%3A28%3A13Z&sr=b&sp=r&sig=jW4XIrEOeuzqki8Bi%2B65WYmtXCjdeo%2B%2FJX1pInSl5yA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE21%20KSX-GB>
2026-03-29 22:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040234/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040234>
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61971550>
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMC14KAE%252F699251990%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251990/600 saved to cache
2026-03-29 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97c5232d-22c9-5728-b6fd-84d8da4f8949
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616ba410>
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF17VPN%252F699073138%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073138/600 saved to cache
2026-03-29 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5439021f-449a-5c9e-a193-64352e476208
2026-03-29 22:03:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5439021f-449a-5c9e-a193-64352e476208, skipping ID generation
2026-03-29 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5439021f-449a-5c9e-a193-64352e476208 sending to next pipeline
2026-03-29 22:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5439021f-449a-5c9e-a193-64352e476208, identifier: PF17%20VPN
2026-03-29 22:03:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6223ca10>
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP65LKN%252F699411816%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411816/600 saved to cache
2026-03-29 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6062366a-77b0-5b3c-aa23-49414d769971
2026-03-29 22:03:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6117da10>
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70YYW%252F699040265%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040265/600 saved to cache
2026-03-29 22:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01b57636-ffd9-585f-9b00-e6ae7dbcc329
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6117c350>
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_expert_report_file_e7df3730-51d5-4683-a04e-4a4e308aaeab.pdf HTTP/1.1" 201 0
2026-03-29 22:03:14 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 94abe6e9-81d6-5688-9976-35bc84a70d4a
2026-03-29 22:03:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94abe6e9-81d6-5688-9976-35bc84a70d4a, skipping ID generation
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94abe6e9-81d6-5688-9976-35bc84a70d4a
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYR67NZG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YR67NZG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b9b10>
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK55EXG%252F699234539%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234539/600 saved to cache
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0991f76e-fa68-5257-8869-29bbc185bed6
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac684e2b90>
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO08HUA%252F699210986%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210986/600 saved to cache
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9816a6af-47f8-5106-89d9-6d77d25fd0f4
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6117ca90>
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKD15FPU%252F699239969%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239969/600 saved to cache
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620ec5d0>
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL11KPY%252F699212562%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212562/600 saved to cache
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c
2026-03-29 22:03:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6372d1d0>
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLA70NPE%252F699406374%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406374/600 saved to cache
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4838ed0-a1bc-555f-ae17-73d79e29d1ac
2026-03-29 22:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5439021f-449a-5c9e-a193-64352e476208 with identifier: PF17%20VPN
2026-03-29 22:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5439021f-449a-5c9e-a193-64352e476208 with identifier: PF17%20VPN
2026-03-29 22:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5439021f-449a-5c9e-a193-64352e476208 with identifier: PF17%20VPN to the API
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073138/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_expert_report_file_9ef49736-5ed5-4b64-a3cc-e31138f187cb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PF17%20VPN-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Electric',
'id': '5439021f-449a-5c9e-a193-64352e476208',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PF17 VPN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PF17%20VPN&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'RENAULT',
'model': 'ZOE',
'odometer': 96037,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38712,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073138/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38635,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073149/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38669,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073164/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40229,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073179/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39399,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073189/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37600,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073196/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93647,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073213/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64901,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073235/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94266,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073258/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5439021f-449a-5c9e-a193-64352e476208/5439021f-449a-5c9e-a193-64352e476208_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64970,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF17VPN/699073271/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'RENAULT ZOE 92 I-DYNAMIQUE Hatchback',
'transmission': 'automatic',
'trim': '92 I-DYNAMIQUE',
'vin': 'VF1AGVYC057962843',
'year': 2017}
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF17%2520VPN%27 HTTP/1.1" 200 None
2026-03-29 22:03:14 [bca.uk] INFO: Saving data for PF17%20VPN: {'created_time': 1774821794.586807, 'last_price_update_time': 1774821794.586817, 'auction_closing_time': 1775210400.0}
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PF17%2520VPN') HTTP/1.1" 204 0
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393069%27 HTTP/1.1" 200 None
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393069 not downloaded yet
2026-03-29 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406349/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406349>
2026-03-29 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234535>
2026-03-29 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251971/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251971>
2026-03-29 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239960/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699239960>
2026-03-29 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212555/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212555>
2026-03-29 22:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210979/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LO08HUA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61716450>
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_expert_report_file_03282953-f672-44f3-a32b-a1ff33746f17.pdf HTTP/1.1" 201 0
2026-03-29 22:03:14 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5796b214-f7e8-5915-afb7-c30027610219
2026-03-29 22:03:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5796b214-f7e8-5915-afb7-c30027610219, skipping ID generation
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5796b214-f7e8-5915-afb7-c30027610219
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCN65OTA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CN65OTA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61045710>
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58XVG%252F699242887%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242887/600 saved to cache
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cdbe3643-d056-5481-b487-6a8e20861864
2026-03-29 22:03:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdbe3643-d056-5481-b487-6a8e20861864, skipping ID generation
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cdbe3643-d056-5481-b487-6a8e20861864 sending to next pipeline
2026-03-29 22:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cdbe3643-d056-5481-b487-6a8e20861864, identifier: MK58%20XVG
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619357d0>
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMC14KAE%252F699251980%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251980/600 saved to cache
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97c5232d-22c9-5728-b6fd-84d8da4f8949
2026-03-29 22:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435181/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS68PYY/42812178?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=ilxdzGsr4IgRZDvqZmWhurm4pGkLnzxS3s4veY%2BdCjs%3D)
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393083%27 HTTP/1.1" 200 None
2026-03-29 22:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393083 not downloaded yet
2026-03-29 22:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cdbe3643-d056-5481-b487-6a8e20861864 with identifier: MK58%20XVG
2026-03-29 22:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cdbe3643-d056-5481-b487-6a8e20861864 with identifier: MK58%20XVG
2026-03-29 22:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cdbe3643-d056-5481-b487-6a8e20861864 with identifier: MK58%20XVG to the API
2026-03-29 22:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242887/600>
{'auction_title': '',
'c_o_2_emission_value': 247,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_expert_report_file_01cdec0f-8155-43c8-9a70-c4832e325af2.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MK58%20XVG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.8L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'cdbe3643-d056-5481-b487-6a8e20861864',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MK58 XVG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MK58%20XVG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'CHRYSLER',
'model': 'GRAND VOYAGER',
'odometer': 80374,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41339,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242887/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41252,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242897/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40623,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242902/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42671,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242909/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36044,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242917/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33412,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242922/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81179,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242935/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78824,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242956/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86078,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242976/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbe3643-d056-5481-b487-6a8e20861864/cdbe3643-d056-5481-b487-6a8e20861864_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75644,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58XVG/699242996/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'CHRYSLER GRAND VOYAGER 2.8 CRD LX MPV',
'transmission': 'automatic',
'trim': 'CRD LX',
'vin': '1A8HTH4918B176727',
'year': 2008}
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK58%2520XVG%27 HTTP/1.1" 200 None
2026-03-29 22:03:15 [bca.uk] INFO: Saving data for MK58%20XVG: {'created_time': 1774821795.235975, 'last_price_update_time': 1774821795.235987, 'auction_closing_time': 1775210400.0}
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MK58%2520XVG') HTTP/1.1" 204 0
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426194%27 HTTP/1.1" 200 None
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426194 not downloaded yet
2026-03-29 22:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409284/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409284>
2026-03-29 22:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435173/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435173>
2026-03-29 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411803/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP65LKN/42812099?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=YYiddic%2BqcqY2M0XPOfW0%2FrAPtac9opCHs6%2B5ikpuFw%3D)
2026-03-29 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE21KSX/42812090?sv=2020-08-04&st=2026-03-29T22%3A03%3A13Z&se=2026-03-29T22%3A28%3A13Z&sr=b&sp=r&sig=jW4XIrEOeuzqki8Bi%2B65WYmtXCjdeo%2B%2FJX1pInSl5yA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040234/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70YYW/42571204?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=3YETERDVJsfcYf9zoGQQnS8MvGAFRjTT6qcrLaHjjZg%3D)
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393096%27 HTTP/1.1" 200 None
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393096 not downloaded yet
2026-03-29 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411666/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE19AAK/42812078?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=MkdK1ykhsLQ%2B%2F2n1Irxn7evFumHYKKFZXmkQdpd8KgM%3D)
2026-03-29 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409299/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE18CHX/42812000?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=oyBRp8qHoowbCW9kieY0zUV46IZNjY3FwR8NKuxfaxo%3D)
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426204%27 HTTP/1.1" 200 None
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426204 not downloaded yet
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393113%27 HTTP/1.1" 200 None
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393113 not downloaded yet
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6170c5d0>
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS68PYY%252F699435181%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435181/600 saved to cache
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426218%27 HTTP/1.1" 200 None
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426218 not downloaded yet
2026-03-29 22:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411643/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411643>
2026-03-29 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239960/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KD15FPU/42809529?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=fvJF7ucpRX0E%2BAJp%2BX9CWPAyJRKbO%2FRJwWNOYDHIzAs%3D)
2026-03-29 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212555/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL11KPY/42783241?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=Q5R98DxLk%2FIyOrHb6oSyVq%2Bq9sVfHG45AhfvPKzaek4%3D)
2026-03-29 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK55EXG/42758130?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=zNKuCsXwY5YBweBL8fGiYSmIg6c7hmRzF6E4Qyh0WVI%3D)
2026-03-29 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210979/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO08HUA/42769935?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=UrTho4OU5emtGOfXKZ0dWvPhmltT%2BxjdBAxxllTvFdc%3D)
2026-03-29 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251971/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MC14KAE/42809755?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=DG6b3zLT1DRX51p27qxjR95H%2BdTJAJxRv%2B3BMmM%2BaS4%3D)
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393124%27 HTTP/1.1" 200 None
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393124 not downloaded yet
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426222%27 HTTP/1.1" 200 None
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426222 not downloaded yet
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6119be90>
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP65LKN%252F699411803%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411803/600 saved to cache
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6062366a-77b0-5b3c-aa23-49414d769971
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620c24d0>
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_expert_report_file_d007ca3f-feb8-4fbf-8288-5e2b51442f6f.pdf HTTP/1.1" 201 0
2026-03-29 22:03:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c562d387-49fb-5052-a994-67add14e4b74
2026-03-29 22:03:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c562d387-49fb-5052-a994-67add14e4b74, skipping ID generation
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c562d387-49fb-5052-a994-67add14e4b74
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAE21KSX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AE21KSX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6221d590>
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70YYW%252F699040234%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040234/600 saved to cache
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01b57636-ffd9-585f-9b00-e6ae7dbcc329
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611cb690>
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE19AAK%252F699411666%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411666/600 saved to cache
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff522792-d041-5ecb-b231-8bf72c190c1e
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a77dd0>
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE18CHX%252F699409299%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409299/600 saved to cache
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393140%27 HTTP/1.1" 200 None
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393140 not downloaded yet
2026-03-29 22:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426179/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CN65OTA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406349/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LA70NPE/42811995?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=1ymICcEKrtpKHFHLQTc1yKaMMeniIFUDVOMDF5neyAs%3D)
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426225%27 HTTP/1.1" 200 None
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426225 not downloaded yet
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395806%27 HTTP/1.1" 200 None
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395806 not downloaded yet
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393147%27 HTTP/1.1" 200 None
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393147 not downloaded yet
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6221e610>
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKD15FPU%252F699239960%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239960/600 saved to cache
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611ba810>
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL11KPY%252F699212555%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212555/600 saved to cache
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62099150>
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK55EXG%252F699234535%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234535/600 saved to cache
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0991f76e-fa68-5257-8869-29bbc185bed6
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6353a910>
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO08HUA%252F699210979%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210979/600 saved to cache
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9816a6af-47f8-5106-89d9-6d77d25fd0f4
2026-03-29 22:03:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9816a6af-47f8-5106-89d9-6d77d25fd0f4, skipping ID generation
2026-03-29 22:03:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9816a6af-47f8-5106-89d9-6d77d25fd0f4 sending to next pipeline
2026-03-29 22:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9816a6af-47f8-5106-89d9-6d77d25fd0f4, identifier: LO08%20HUA
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69802f10>
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMC14KAE%252F699251971%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251971/600 saved to cache
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97c5232d-22c9-5728-b6fd-84d8da4f8949
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426228%27 HTTP/1.1" 200 None
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426228 not downloaded yet
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395829%27 HTTP/1.1" 200 None
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395829 not downloaded yet
2026-03-29 22:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9816a6af-47f8-5106-89d9-6d77d25fd0f4 with identifier: LO08%20HUA
2026-03-29 22:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9816a6af-47f8-5106-89d9-6d77d25fd0f4 with identifier: LO08%20HUA
2026-03-29 22:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9816a6af-47f8-5106-89d9-6d77d25fd0f4 with identifier: LO08%20HUA to the API
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210979/600>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_expert_report_file_cfe144ea-f8c4-4fa6-b1ee-ff242e22a134.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO08%20HUA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9816a6af-47f8-5106-89d9-6d77d25fd0f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LO08 HUA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LO08%20HUA&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 179783,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40574,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210979/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37969,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210986/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36623,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210991/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37700,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699210999/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34335,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211010/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33751,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211016/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91683,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211035/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82139,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211049/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92574,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211063/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9816a6af-47f8-5106-89d9-6d77d25fd0f4/9816a6af-47f8-5106-89d9-6d77d25fd0f4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73658,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO08HUA/699211077/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 2.0 SDI S Hatchback',
'transmission': 'manual',
'trim': 'SDI S',
'vin': 'WVWZZZ1KZ9W023112',
'year': 2008}
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO08%2520HUA%27 HTTP/1.1" 200 None
2026-03-29 22:03:16 [bca.uk] INFO: Saving data for LO08%20HUA: {'created_time': 1774821796.431752, 'last_price_update_time': 1774821796.431766, 'auction_closing_time': 1775210400.0}
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LO08%2520HUA') HTTP/1.1" 204 0
2026-03-29 22:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393083/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393083>
2026-03-29 22:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393069/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393069>
2026-03-29 22:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393055/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YR67NZG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393096/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393096>
2026-03-29 22:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435173/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS68PYY/42812178?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=ilxdzGsr4IgRZDvqZmWhurm4pGkLnzxS3s4veY%2BdCjs%3D)
2026-03-29 22:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409284/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE18CHX/42812000?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=oyBRp8qHoowbCW9kieY0zUV46IZNjY3FwR8NKuxfaxo%3D)
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393150%27 HTTP/1.1" 200 None
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393150 not downloaded yet
2026-03-29 22:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426194/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426194>
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426231%27 HTTP/1.1" 200 None
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426231 not downloaded yet
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395857%27 HTTP/1.1" 200 None
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395857 not downloaded yet
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61abd2d0>
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLA70NPE%252F699406349%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406349/600 saved to cache
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4838ed0-a1bc-555f-ae17-73d79e29d1ac
2026-03-29 22:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411643/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE19AAK/42812078?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=MkdK1ykhsLQ%2B%2F2n1Irxn7evFumHYKKFZXmkQdpd8KgM%3D)
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393152%27 HTTP/1.1" 200 None
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393152 not downloaded yet
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426234%27 HTTP/1.1" 200 None
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426234 not downloaded yet
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395878%27 HTTP/1.1" 200 None
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395878 not downloaded yet
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426237%27 HTTP/1.1" 200 None
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426237 not downloaded yet
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395892%27 HTTP/1.1" 200 None
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395892 not downloaded yet
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61abd290>
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS68PYY%252F699435173%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435173/600 saved to cache
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b5a10>
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE18CHX%252F699409284%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409284/600 saved to cache
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad
2026-03-29 22:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393140/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393140>
2026-03-29 22:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426218/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426218>
2026-03-29 22:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430289/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430289>
2026-03-29 22:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426179/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN65OTA/42812298?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=HXci3LjOb3T4%2F91N2TEZkwx4YsEQW6Lkqy%2ByCGyzgK4%3D)
2026-03-29 22:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426204/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426204>
2026-03-29 22:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426194/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN65OTA/42812298?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=HXci3LjOb3T4%2F91N2TEZkwx4YsEQW6Lkqy%2ByCGyzgK4%3D)
2026-03-29 22:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430334/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430334>
2026-03-29 22:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393113/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393113>
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395935%27 HTTP/1.1" 200 None
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395935 not downloaded yet
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395949%27 HTTP/1.1" 200 None
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395949 not downloaded yet
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614b9150>
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE19AAK%252F699411643%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411643/600 saved to cache
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff522792-d041-5ecb-b231-8bf72c190c1e
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395972%27 HTTP/1.1" 200 None
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395972 not downloaded yet
2026-03-29 22:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426228/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426228>
2026-03-29 22:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393150/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393150>
2026-03-29 22:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393083/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR67NZG/42811985?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=pIAxLaG6p7818wlJOtvbmDmU4CemR7e2Qm%2FruKj4j8c%3D)
2026-03-29 22:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393055/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR67NZG/42811985?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=pIAxLaG6p7818wlJOtvbmDmU4CemR7e2Qm%2FruKj4j8c%3D)
2026-03-29 22:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393069/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR67NZG/42811985?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=pIAxLaG6p7818wlJOtvbmDmU4CemR7e2Qm%2FruKj4j8c%3D)
2026-03-29 22:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395829/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395829>
2026-03-29 22:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393096/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR67NZG/42811985?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=pIAxLaG6p7818wlJOtvbmDmU4CemR7e2Qm%2FruKj4j8c%3D)
2026-03-29 22:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393113/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR67NZG/42811985?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=pIAxLaG6p7818wlJOtvbmDmU4CemR7e2Qm%2FruKj4j8c%3D)
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395988%27 HTTP/1.1" 200 None
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395988 not downloaded yet
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611d4c10>
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN65OTA%252F699426179%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426179/600 saved to cache
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5796b214-f7e8-5915-afb7-c30027610219
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c7b9d0>
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN65OTA%252F699426194%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426194/600 saved to cache
2026-03-29 22:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5796b214-f7e8-5915-afb7-c30027610219
2026-03-29 22:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426204/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN65OTA/42812298?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=HXci3LjOb3T4%2F91N2TEZkwx4YsEQW6Lkqy%2ByCGyzgK4%3D)
2026-03-29 22:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426218/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN65OTA/42812298?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=HXci3LjOb3T4%2F91N2TEZkwx4YsEQW6Lkqy%2ByCGyzgK4%3D)
2026-03-29 22:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426237/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426237>
2026-03-29 22:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395892/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395892>
2026-03-29 22:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430334/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19VSX/42812111?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=qlSeQUbf83xHqWfD9mYZ2SCAALVwdddlxYHgmUNU2tY%3D)
2026-03-29 22:03:16 [bca.uk] INFO: Total items found: 100
2026-03-29 22:03:16 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded
2026-03-29 22:03:16 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:03:16 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69adf250>
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR67NZG%252F699393083%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393083/600 saved to cache
2026-03-29 22:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94abe6e9-81d6-5688-9976-35bc84a70d4a
2026-03-29 22:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637b7390>
2026-03-29 22:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR67NZG%252F699393055%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393055/600 saved to cache
2026-03-29 22:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94abe6e9-81d6-5688-9976-35bc84a70d4a
2026-03-29 22:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6117fe10>
2026-03-29 22:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR67NZG%252F699393069%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393069/600 saved to cache
2026-03-29 22:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94abe6e9-81d6-5688-9976-35bc84a70d4a
2026-03-29 22:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62115a50>
2026-03-29 22:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR67NZG%252F699393096%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393096/600 saved to cache
2026-03-29 22:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94abe6e9-81d6-5688-9976-35bc84a70d4a
2026-03-29 22:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620b6b50>
2026-03-29 22:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR67NZG%252F699393113%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393113/600 saved to cache
2026-03-29 22:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94abe6e9-81d6-5688-9976-35bc84a70d4a
2026-03-29 22:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430289/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA16ETX/42812131?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=67cSoD7yDAcPlVUXb6MtFxB8b%2F%2B%2FHPzK%2FRcqJHz%2FIwo%3D)
2026-03-29 22:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426228/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN65OTA/42812298?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=HXci3LjOb3T4%2F91N2TEZkwx4YsEQW6Lkqy%2ByCGyzgK4%3D)
2026-03-29 22:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393140/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR67NZG/42811985?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=pIAxLaG6p7818wlJOtvbmDmU4CemR7e2Qm%2FruKj4j8c%3D)
2026-03-29 22:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395829/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE21KSX/42812090?sv=2020-08-04&st=2026-03-29T22%3A03%3A13Z&se=2026-03-29T22%3A28%3A13Z&sr=b&sp=r&sig=jW4XIrEOeuzqki8Bi%2B65WYmtXCjdeo%2B%2FJX1pInSl5yA%3D)
2026-03-29 22:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395935/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395935>
2026-03-29 22:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395949/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395949>
2026-03-29 22:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395972/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395972>
2026-03-29 22:03:17 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:03:17 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:03:17 [bca.uk] INFO: Found listing with ID: VX71%20LGE
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX71%2520LGE%27 HTTP/1.1" 200 None
2026-03-29 22:03:17 [bca.uk] INFO: Scrape type for VX71%20LGE: 2
2026-03-29 22:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c276a733-42f4-5af7-8ad5-c7a477a69048 with identifier: VX71%20LGE
2026-03-29 22:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c276a733-42f4-5af7-8ad5-c7a477a69048 with scrape type 2
2026-03-29 22:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c276a733-42f4-5af7-8ad5-c7a477a69048 with scrape type 2
2026-03-29 22:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c276a733-42f4-5af7-8ad5-c7a477a69048, identifier: VX71%20LGE
2026-03-29 22:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393150/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR67NZG/42811985?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=pIAxLaG6p7818wlJOtvbmDmU4CemR7e2Qm%2FruKj4j8c%3D)
2026-03-29 22:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c276a733-42f4-5af7-8ad5-c7a477a69048 with identifier: VX71%20LGE
2026-03-29 22:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c276a733-42f4-5af7-8ad5-c7a477a69048 with identifier: VX71%20LGE
2026-03-29 22:03:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c276a733-42f4-5af7-8ad5-c7a477a69048 with identifier: VX71%20LGE to the API
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VX71%20LGE-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Electric',
'id': 'c276a733-42f4-5af7-8ad5-c7a477a69048',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VX71 LGE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VX71%20LGE&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'MERCEDES-BENZ',
'model': 'EQC 400',
'odometer': 27589,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ EQC 400 AMG LINE PREMIUM StationWagon',
'transmission': 'automatic',
'trim': 'AMG LINE PREMIUM',
'vin': 'W1K2938902F035687',
'year': 2021}
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX71%2520LGE%27 HTTP/1.1" 200 None
2026-03-29 22:03:17 [bca.uk] INFO: Saving data for VX71%20LGE: {'auction_closing_time': 1775124000.0, 'created_time': 1774534060.387215, 'last_price_update_time': 1774821797.610963}
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VX71%2520LGE') HTTP/1.1" 204 0
2026-03-29 22:03:17 [bca.uk] INFO: Found listing with ID: EY70%20RUA
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY70%2520RUA%27 HTTP/1.1" 200 None
2026-03-29 22:03:17 [bca.uk] INFO: Scrape type for EY70%20RUA: 2
2026-03-29 22:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 865cb917-4eed-5b99-83d3-357d614834f0 with identifier: EY70%20RUA
2026-03-29 22:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 865cb917-4eed-5b99-83d3-357d614834f0 with scrape type 2
2026-03-29 22:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 865cb917-4eed-5b99-83d3-357d614834f0 with scrape type 2
2026-03-29 22:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 865cb917-4eed-5b99-83d3-357d614834f0, identifier: EY70%20RUA
2026-03-29 22:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395892/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE21KSX/42812090?sv=2020-08-04&st=2026-03-29T22%3A03%3A13Z&se=2026-03-29T22%3A28%3A13Z&sr=b&sp=r&sig=jW4XIrEOeuzqki8Bi%2B65WYmtXCjdeo%2B%2FJX1pInSl5yA%3D)
2026-03-29 22:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395988/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395988>
2026-03-29 22:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393152/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393152>
2026-03-29 22:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395878/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395878>
2026-03-29 22:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426234/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426234>
2026-03-29 22:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395857/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395857>
2026-03-29 22:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 865cb917-4eed-5b99-83d3-357d614834f0 with identifier: EY70%20RUA
2026-03-29 22:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 865cb917-4eed-5b99-83d3-357d614834f0 with identifier: EY70%20RUA
2026-03-29 22:03:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 865cb917-4eed-5b99-83d3-357d614834f0 with identifier: EY70%20RUA to the API
2026-03-29 22:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 222,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY70%20RUA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '865cb917-4eed-5b99-83d3-357d614834f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY70 RUA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EY70%20RUA&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'AUDI',
'model': 'Q7',
'odometer': 33814,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'AUDI Q7 3.0 45 TDI QUATTRO SPORT TIP StationWagon',
'transmission': 'manual',
'trim': '45 TDI QUATTRO SPORT TIP',
'vin': 'WAUZZZ4M5LD002237',
'year': 2020}
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY70%2520RUA%27 HTTP/1.1" 200 None
2026-03-29 22:03:18 [bca.uk] INFO: Saving data for EY70%20RUA: {'auction_closing_time': 1774951200.0, 'created_time': 1774101920.415695, 'last_price_update_time': 1774821798.169462}
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EY70%2520RUA') HTTP/1.1" 204 0
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6185e9d0>
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN65OTA%252F699426204%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426204/600 saved to cache
2026-03-29 22:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5796b214-f7e8-5915-afb7-c30027610219
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6373b410>
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN65OTA%252F699426218%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426218/600 saved to cache
2026-03-29 22:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5796b214-f7e8-5915-afb7-c30027610219
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6185df50>
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19VSX%252F699430334%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430334/600 saved to cache
2026-03-29 22:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 732664ff-2041-53f2-83f7-e4a6aeaa1df2
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6374d850>
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA16ETX%252F699430289%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430289/600 saved to cache
2026-03-29 22:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6398c60-fe63-5a45-a148-79cf4bf62bcf
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63651150>
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN65OTA%252F699426228%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426228/600 saved to cache
2026-03-29 22:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5796b214-f7e8-5915-afb7-c30027610219
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611bb0d0>
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR67NZG%252F699393140%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393140/600 saved to cache
2026-03-29 22:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94abe6e9-81d6-5688-9976-35bc84a70d4a
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6373b3d0>
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE21KSX%252F699395829%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395829/600 saved to cache
2026-03-29 22:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c562d387-49fb-5052-a994-67add14e4b74
2026-03-29 22:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426231/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426231>
2026-03-29 22:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426237/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN65OTA/42812298?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=HXci3LjOb3T4%2F91N2TEZkwx4YsEQW6Lkqy%2ByCGyzgK4%3D)
2026-03-29 22:03:18 [bca.uk] INFO: Found listing with ID: DY59%20NHM
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY59%2520NHM%27 HTTP/1.1" 200 None
2026-03-29 22:03:18 [bca.uk] INFO: Scrape type for DY59%20NHM: 2
2026-03-29 22:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87480faa-88cc-50d5-8c30-0f2179666de8 with identifier: DY59%20NHM
2026-03-29 22:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87480faa-88cc-50d5-8c30-0f2179666de8 with scrape type 2
2026-03-29 22:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87480faa-88cc-50d5-8c30-0f2179666de8 with scrape type 2
2026-03-29 22:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 87480faa-88cc-50d5-8c30-0f2179666de8, identifier: DY59%20NHM
2026-03-29 22:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 87480faa-88cc-50d5-8c30-0f2179666de8 with identifier: DY59%20NHM
2026-03-29 22:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 87480faa-88cc-50d5-8c30-0f2179666de8 with identifier: DY59%20NHM
2026-03-29 22:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 87480faa-88cc-50d5-8c30-0f2179666de8 with identifier: DY59%20NHM to the API
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DY59%20NHM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '87480faa-88cc-50d5-8c30-0f2179666de8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DY59 NHM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DY59%20NHM&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 114154,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 VVT 115 ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'VVT 115 ACTIVE',
'vin': 'W0L0AHL48A5001425',
'year': 2009}
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY59%2520NHM%27 HTTP/1.1" 200 None
2026-03-29 22:03:18 [bca.uk] INFO: Saving data for DY59%20NHM: {'auction_closing_time': 1774951200.0, 'created_time': 1774476139.808474, 'last_price_update_time': 1774821798.92174}
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DY59%2520NHM') HTTP/1.1" 204 0
2026-03-29 22:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395806/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395806>
2026-03-29 22:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426225/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426225>
2026-03-29 22:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393147/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393147>
2026-03-29 22:03:18 [bca.uk] INFO: Found listing with ID: VHZ%208117
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VHZ%25208117%27 HTTP/1.1" 200 None
2026-03-29 22:03:18 [bca.uk] INFO: Scrape type for VHZ%208117: 0
2026-03-29 22:03:18 [bca.uk] INFO: Found listing with ID: HK74%20VDT
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK74%2520VDT%27 HTTP/1.1" 200 None
2026-03-29 22:03:18 [bca.uk] INFO: Scrape type for HK74%20VDT: 1
2026-03-29 22:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd5918ef-16dc-5dbe-90ef-20698b6a8126 with identifier: HK74%20VDT
2026-03-29 22:03:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item dd5918ef-16dc-5dbe-90ef-20698b6a8126
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62131490>
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR67NZG%252F699393150%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393150/600 saved to cache
2026-03-29 22:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 94abe6e9-81d6-5688-9976-35bc84a70d4a
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611d4d10>
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE21KSX%252F699395892%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395892/600 saved to cache
2026-03-29 22:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c562d387-49fb-5052-a994-67add14e4b74
2026-03-29 22:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395857/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE21KSX/42812090?sv=2020-08-04&st=2026-03-29T22%3A03%3A13Z&se=2026-03-29T22%3A28%3A13Z&sr=b&sp=r&sig=jW4XIrEOeuzqki8Bi%2B65WYmtXCjdeo%2B%2FJX1pInSl5yA%3D)
2026-03-29 22:03:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395780/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AE21KSX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395949/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE21KSX/42812090?sv=2020-08-04&st=2026-03-29T22%3A03%3A13Z&se=2026-03-29T22%3A28%3A13Z&sr=b&sp=r&sig=jW4XIrEOeuzqki8Bi%2B65WYmtXCjdeo%2B%2FJX1pInSl5yA%3D)
2026-03-29 22:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395972/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE21KSX/42812090?sv=2020-08-04&st=2026-03-29T22%3A03%3A13Z&se=2026-03-29T22%3A28%3A13Z&sr=b&sp=r&sig=jW4XIrEOeuzqki8Bi%2B65WYmtXCjdeo%2B%2FJX1pInSl5yA%3D)
2026-03-29 22:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395935/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE21KSX/42812090?sv=2020-08-04&st=2026-03-29T22%3A03%3A13Z&se=2026-03-29T22%3A28%3A13Z&sr=b&sp=r&sig=jW4XIrEOeuzqki8Bi%2B65WYmtXCjdeo%2B%2FJX1pInSl5yA%3D)
2026-03-29 22:03:19 [bca.uk] INFO: Found listing with ID: LA23%20XHC
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA23%2520XHC%27 HTTP/1.1" 200 None
2026-03-29 22:03:19 [bca.uk] INFO: Scrape type for LA23%20XHC: 2
2026-03-29 22:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0e4f9f0-c886-5b3f-aee6-fac2c267f191 with identifier: LA23%20XHC
2026-03-29 22:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0e4f9f0-c886-5b3f-aee6-fac2c267f191 with scrape type 2
2026-03-29 22:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0e4f9f0-c886-5b3f-aee6-fac2c267f191 with scrape type 2
2026-03-29 22:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f0e4f9f0-c886-5b3f-aee6-fac2c267f191, identifier: LA23%20XHC
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62133cd0>
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN65OTA%252F699426237%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426237/600 saved to cache
2026-03-29 22:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5796b214-f7e8-5915-afb7-c30027610219
2026-03-29 22:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f0e4f9f0-c886-5b3f-aee6-fac2c267f191 with identifier: LA23%20XHC
2026-03-29 22:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f0e4f9f0-c886-5b3f-aee6-fac2c267f191 with identifier: LA23%20XHC
2026-03-29 22:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f0e4f9f0-c886-5b3f-aee6-fac2c267f191 with identifier: LA23%20XHC to the API
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 35,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LA23%20XHC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'f0e4f9f0-c886-5b3f-aee6-fac2c267f191',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LA23 XHC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LA23%20XHC&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'GLA 250 E',
'odometer': 28203,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ GLA 250 E 1.3 AMG LINE PREM.PLUS NIGHT ED. '
'StationWagon',
'transmission': 'automatic',
'trim': 'AMG LINE PREM.PLUS NIGHT ED.',
'vin': 'W1N4N8GB1PJ501386',
'year': 2023}
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA23%2520XHC%27 HTTP/1.1" 200 None
2026-03-29 22:03:19 [bca.uk] INFO: Saving data for LA23%20XHC: {'auction_closing_time': 1775124000.0, 'created_time': 1774534274.669194, 'last_price_update_time': 1774821799.53244}
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LA23%2520XHC') HTTP/1.1" 204 0
2026-03-29 22:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395878/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE21KSX/42812090?sv=2020-08-04&st=2026-03-29T22%3A03%3A13Z&se=2026-03-29T22%3A28%3A13Z&sr=b&sp=r&sig=jW4XIrEOeuzqki8Bi%2B65WYmtXCjdeo%2B%2FJX1pInSl5yA%3D)
2026-03-29 22:03:19 [bca.uk] INFO: Found listing with ID: DC22%20HUO
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC22%2520HUO%27 HTTP/1.1" 200 None
2026-03-29 22:03:19 [bca.uk] INFO: Scrape type for DC22%20HUO: 1
2026-03-29 22:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c45461f-b816-537d-a25b-219757224249 with identifier: DC22%20HUO
2026-03-29 22:03:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6c45461f-b816-537d-a25b-219757224249
2026-03-29 22:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426231/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN65OTA/42812298?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=HXci3LjOb3T4%2F91N2TEZkwx4YsEQW6Lkqy%2ByCGyzgK4%3D)
2026-03-29 22:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395988/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE21KSX/42812090?sv=2020-08-04&st=2026-03-29T22%3A03%3A13Z&se=2026-03-29T22%3A28%3A13Z&sr=b&sp=r&sig=jW4XIrEOeuzqki8Bi%2B65WYmtXCjdeo%2B%2FJX1pInSl5yA%3D)
2026-03-29 22:03:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393124/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393124>
2026-03-29 22:03:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426222/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426222>
2026-03-29 22:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426234/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN65OTA/42812298?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=HXci3LjOb3T4%2F91N2TEZkwx4YsEQW6Lkqy%2ByCGyzgK4%3D)
2026-03-29 22:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393152/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR67NZG/42811985?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=pIAxLaG6p7818wlJOtvbmDmU4CemR7e2Qm%2FruKj4j8c%3D)
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61648090>
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE21KSX%252F699395857%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395857/600 saved to cache
2026-03-29 22:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c562d387-49fb-5052-a994-67add14e4b74
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616825d0>
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE21KSX%252F699395949%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395949/600 saved to cache
2026-03-29 22:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c562d387-49fb-5052-a994-67add14e4b74
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6374f250>
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE21KSX%252F699395972%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395972/600 saved to cache
2026-03-29 22:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c562d387-49fb-5052-a994-67add14e4b74
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63318610>
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE21KSX%252F699395935%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395935/600 saved to cache
2026-03-29 22:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c562d387-49fb-5052-a994-67add14e4b74
2026-03-29 22:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393147/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR67NZG/42811985?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=pIAxLaG6p7818wlJOtvbmDmU4CemR7e2Qm%2FruKj4j8c%3D)
2026-03-29 22:03:19 [bca.uk] INFO: Found listing with ID: RO20%20JLV
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO20%2520JLV%27 HTTP/1.1" 200 None
2026-03-29 22:03:19 [bca.uk] INFO: Scrape type for RO20%20JLV: 2
2026-03-29 22:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 378ca6e5-d408-523f-83e9-690c1ee405b2 with identifier: RO20%20JLV
2026-03-29 22:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 378ca6e5-d408-523f-83e9-690c1ee405b2 with scrape type 2
2026-03-29 22:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 378ca6e5-d408-523f-83e9-690c1ee405b2 with scrape type 2
2026-03-29 22:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 378ca6e5-d408-523f-83e9-690c1ee405b2, identifier: RO20%20JLV
2026-03-29 22:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 378ca6e5-d408-523f-83e9-690c1ee405b2 with identifier: RO20%20JLV
2026-03-29 22:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 378ca6e5-d408-523f-83e9-690c1ee405b2 with identifier: RO20%20JLV
2026-03-29 22:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 378ca6e5-d408-523f-83e9-690c1ee405b2 with identifier: RO20%20JLV to the API
2026-03-29 22:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 173,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO20%20JLV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': '378ca6e5-d408-523f-83e9-690c1ee405b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RO20 JLV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RO20%20JLV&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLVO',
'model': 'V90',
'odometer': 61292,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VOLVO V90 2.0 T4 190 R DESIGN PLUS G/T Estate',
'transmission': 'manual',
'trim': 'T4 190 R DESIGN PLUS G/T',
'vin': 'YV1PWAKVDL1124786',
'year': 2020}
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO20%2520JLV%27 HTTP/1.1" 200 None
2026-03-29 22:03:20 [bca.uk] INFO: Saving data for RO20%20JLV: {'auction_closing_time': 1775124000.0, 'created_time': 1774390471.380688, 'last_price_update_time': 1774821800.136548}
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RO20%2520JLV') HTTP/1.1" 204 0
2026-03-29 22:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395780/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE21KSX/42812090?sv=2020-08-04&st=2026-03-29T22%3A03%3A13Z&se=2026-03-29T22%3A28%3A13Z&sr=b&sp=r&sig=jW4XIrEOeuzqki8Bi%2B65WYmtXCjdeo%2B%2FJX1pInSl5yA%3D)
2026-03-29 22:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426225/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN65OTA/42812298?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=HXci3LjOb3T4%2F91N2TEZkwx4YsEQW6Lkqy%2ByCGyzgK4%3D)
2026-03-29 22:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395806/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE21KSX/42812090?sv=2020-08-04&st=2026-03-29T22%3A03%3A13Z&se=2026-03-29T22%3A28%3A13Z&sr=b&sp=r&sig=jW4XIrEOeuzqki8Bi%2B65WYmtXCjdeo%2B%2FJX1pInSl5yA%3D)
2026-03-29 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040206/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040206>
2026-03-29 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575421/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575421>
2026-03-29 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411792/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411792>
2026-03-29 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK74VDT/42809563?sv=2020-08-04&st=2026-03-29T22%3A03%3A19Z&se=2026-03-29T22%3A28%3A19Z&sr=b&sp=r&sig=WU6pM2L1dWJi3Ejn6IWyffxUL7z8BjuTgiWJku%2FGEIo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK74%20VDT-GB>
2026-03-29 22:03:20 [bca.uk] INFO: Found listing with ID: YC64%20ULZ
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC64%2520ULZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:20 [bca.uk] INFO: Scrape type for YC64%20ULZ: 1
2026-03-29 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7faeccc2-4423-53aa-a318-803e1d873f8c with identifier: YC64%20ULZ
2026-03-29 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7faeccc2-4423-53aa-a318-803e1d873f8c
2026-03-29 22:03:20 [bca.uk] INFO: Found listing with ID: LK65%20LDD
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK65%2520LDD%27 HTTP/1.1" 200 None
2026-03-29 22:03:20 [bca.uk] INFO: Scrape type for LK65%20LDD: 1
2026-03-29 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bbb7ce7-a50f-5792-918b-66476d234a65 with identifier: LK65%20LDD
2026-03-29 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1bbb7ce7-a50f-5792-918b-66476d234a65
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6374e410>
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE21KSX%252F699395878%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395878/600 saved to cache
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c562d387-49fb-5052-a994-67add14e4b74
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6187be50>
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN65OTA%252F699426231%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426231/600 saved to cache
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5796b214-f7e8-5915-afb7-c30027610219
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac635384d0>
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE21KSX%252F699395988%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395988/600 saved to cache
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c562d387-49fb-5052-a994-67add14e4b74
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618c46d0>
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN65OTA%252F699426234%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426234/600 saved to cache
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5796b214-f7e8-5915-afb7-c30027610219
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6353b9d0>
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR67NZG%252F699393152%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393152/600 saved to cache
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94abe6e9-81d6-5688-9976-35bc84a70d4a
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62099e10>
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR67NZG%252F699393147%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393147/600 saved to cache
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94abe6e9-81d6-5688-9976-35bc84a70d4a
2026-03-29 22:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426222/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN65OTA/42812298?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=HXci3LjOb3T4%2F91N2TEZkwx4YsEQW6Lkqy%2ByCGyzgK4%3D)
2026-03-29 22:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393124/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR67NZG/42811985?sv=2020-08-04&st=2026-03-29T22%3A03%3A11Z&se=2026-03-29T22%3A28%3A11Z&sr=b&sp=r&sig=pIAxLaG6p7818wlJOtvbmDmU4CemR7e2Qm%2FruKj4j8c%3D)
2026-03-29 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212548/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212548>
2026-03-29 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406328/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406328>
2026-03-29 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC22HUO/42806704?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=dQBCNh6w1rixkLp3DKgWlJpgfe3vccB%2F%2Fb6WAecmC7Q%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DC22%20HUO-GB>
2026-03-29 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239946/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699239946>
2026-03-29 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234524/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AK55EXG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE10BXU/42806585?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=0HeSSm6%2FyPGHrQi9lQ%2F5I1Qis0B5ucoXD25aBf9XYJU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OE10%20BXU-GB>
2026-03-29 22:03:20 [bca.uk] INFO: Found listing with ID: HY65%20YHZ
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY65%2520YHZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:20 [bca.uk] INFO: Scrape type for HY65%20YHZ: 1
2026-03-29 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5c6f7aa-8396-5873-84ff-36f777f94cac with identifier: HY65%20YHZ
2026-03-29 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d5c6f7aa-8396-5873-84ff-36f777f94cac
2026-03-29 22:03:20 [bca.uk] INFO: Found listing with ID: FY17%20UNZ
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY17%2520UNZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:20 [bca.uk] INFO: Scrape type for FY17%20UNZ: 1
2026-03-29 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a50a9ac2-1ae6-5dea-b91f-fba078bf92af with identifier: FY17%20UNZ
2026-03-29 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a50a9ac2-1ae6-5dea-b91f-fba078bf92af
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636cd6d0>
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE21KSX%252F699395780%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395780/600 saved to cache
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c562d387-49fb-5052-a994-67add14e4b74
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636cd790>
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN65OTA%252F699426225%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426225/600 saved to cache
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5796b214-f7e8-5915-afb7-c30027610219
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6353b710>
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE21KSX%252F699395806%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395806/600 saved to cache
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c562d387-49fb-5052-a994-67add14e4b74
2026-03-29 22:03:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c562d387-49fb-5052-a994-67add14e4b74, skipping ID generation
2026-03-29 22:03:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c562d387-49fb-5052-a994-67add14e4b74 sending to next pipeline
2026-03-29 22:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c562d387-49fb-5052-a994-67add14e4b74, identifier: AE21%20KSX
2026-03-29 22:03:20 [bca.uk] INFO: Found listing with ID: FX22%20ORL
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX22%2520ORL%27 HTTP/1.1" 200 None
2026-03-29 22:03:20 [bca.uk] INFO: Scrape type for FX22%20ORL: 1
2026-03-29 22:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 502e65dc-018f-56cc-9774-295a6ce3b96a with identifier: FX22%20ORL
2026-03-29 22:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 502e65dc-018f-56cc-9774-295a6ce3b96a
2026-03-29 22:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c562d387-49fb-5052-a994-67add14e4b74 with identifier: AE21%20KSX
2026-03-29 22:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c562d387-49fb-5052-a994-67add14e4b74 with identifier: AE21%20KSX
2026-03-29 22:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c562d387-49fb-5052-a994-67add14e4b74 with identifier: AE21%20KSX to the API
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395806/600>
{'auction_title': '',
'c_o_2_emission_value': 242,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_expert_report_file_d007ca3f-feb8-4fbf-8288-5e2b51442f6f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE21%20KSX-GB',
'category': 'LightCommercialVehicle',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c562d387-49fb-5052-a994-67add14e4b74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE21 KSX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AE21%20KSX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'RANGER',
'odometer': 41628,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49214,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395780/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45863,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395806/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44534,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395829/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46556,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395857/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43415,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395878/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40030,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395892/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101104,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395935/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77388,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395949/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78135,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395972/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c562d387-49fb-5052-a994-67add14e4b74/c562d387-49fb-5052-a994-67add14e4b74_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56250,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE21KSX/699395988/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'FORD RANGER 2.0 EBL 213 WILDTRAK CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'EBL 213 WILDTRAK',
'vin': '6FPPXXMJ2PMU73038',
'year': 2021}
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE21%2520KSX%27 HTTP/1.1" 200 None
2026-03-29 22:03:21 [bca.uk] INFO: Saving data for AE21%20KSX: {'created_time': 1774821801.086362, 'last_price_update_time': 1774821801.086373, 'auction_closing_time': 1774951200.0}
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AE21%2520KSX') HTTP/1.1" 204 0
2026-03-29 22:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251964/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251964>
2026-03-29 22:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435165/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435165>
2026-03-29 22:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409267/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409267>
2026-03-29 22:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040206/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70YYW/42571204?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=3YETERDVJsfcYf9zoGQQnS8MvGAFRjTT6qcrLaHjjZg%3D)
2026-03-29 22:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575421/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/P17LPT/42573216?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Cei94j6xTuVsYVAtMEIEaOIhWn8jpASCTY7XqjpVl64%3D)
2026-03-29 22:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411792/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP65LKN/42812099?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=YYiddic%2BqcqY2M0XPOfW0%2FrAPtac9opCHs6%2B5ikpuFw%3D)
2026-03-29 22:03:21 [bca.uk] INFO: Found listing with ID: BK68%20TLO
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK68%2520TLO%27 HTTP/1.1" 200 None
2026-03-29 22:03:21 [bca.uk] INFO: Scrape type for BK68%20TLO: 1
2026-03-29 22:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f9f2c24-88ea-52eb-8933-488e5868efc1 with identifier: BK68%20TLO
2026-03-29 22:03:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9f9f2c24-88ea-52eb-8933-488e5868efc1
2026-03-29 22:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK74VDT/42809563?sv=2020-08-04&st=2026-03-29T22%3A03%3A19Z&se=2026-03-29T22%3A28%3A19Z&sr=b&sp=r&sig=WU6pM2L1dWJi3Ejn6IWyffxUL7z8BjuTgiWJku%2FGEIo%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE10BXU/42806585?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=0HeSSm6%2FyPGHrQi9lQ%2F5I1Qis0B5ucoXD25aBf9XYJU%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:21 [bca.uk] INFO: Found listing with ID: OW19%20OFS
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW19%2520OFS%27 HTTP/1.1" 200 None
2026-03-29 22:03:21 [bca.uk] INFO: Scrape type for OW19%20OFS: 1
2026-03-29 22:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0c90534-4dbe-5982-85b5-b9b714d55606 with identifier: OW19%20OFS
2026-03-29 22:03:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a0c90534-4dbe-5982-85b5-b9b714d55606
2026-03-29 22:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6164bcd0>
2026-03-29 22:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN65OTA%252F699426222%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426222/600 saved to cache
2026-03-29 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5796b214-f7e8-5915-afb7-c30027610219
2026-03-29 22:03:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5796b214-f7e8-5915-afb7-c30027610219, skipping ID generation
2026-03-29 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5796b214-f7e8-5915-afb7-c30027610219 sending to next pipeline
2026-03-29 22:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5796b214-f7e8-5915-afb7-c30027610219, identifier: CN65%20OTA
2026-03-29 22:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6331a3d0>
2026-03-29 22:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR67NZG%252F699393124%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393124/600 saved to cache
2026-03-29 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94abe6e9-81d6-5688-9976-35bc84a70d4a
2026-03-29 22:03:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94abe6e9-81d6-5688-9976-35bc84a70d4a, skipping ID generation
2026-03-29 22:03:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94abe6e9-81d6-5688-9976-35bc84a70d4a sending to next pipeline
2026-03-29 22:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 94abe6e9-81d6-5688-9976-35bc84a70d4a, identifier: YR67%20NZG
2026-03-29 22:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5796b214-f7e8-5915-afb7-c30027610219 with identifier: CN65%20OTA
2026-03-29 22:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5796b214-f7e8-5915-afb7-c30027610219 with identifier: CN65%20OTA
2026-03-29 22:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5796b214-f7e8-5915-afb7-c30027610219 with identifier: CN65%20OTA to the API
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426222/600>
{'auction_title': '',
'c_o_2_emission_value': 220,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_expert_report_file_03282953-f672-44f3-a32b-a1ff33746f17.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CN65%20OTA-GB',
'category': 'LightCommercialVehicle',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5796b214-f7e8-5915-afb7-c30027610219',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CN65 OTA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CN65%20OTA&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'ISUZU',
'model': 'D-MAX',
'odometer': 176876,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37290,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426179/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36885,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426194/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34382,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426204/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33326,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426218/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30560,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426222/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31094,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426225/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72960,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426228/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61005,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426231/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84568,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426234/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5796b214-f7e8-5915-afb7-c30027610219/5796b214-f7e8-5915-afb7-c30027610219_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79395,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN65OTA/699426237/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'ISUZU D-MAX 2.5 TD BLADE 4X4 CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'TD BLADE 4X4',
'vin': 'MPATFS86JFT013572',
'year': 2015}
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN65%2520OTA%27 HTTP/1.1" 200 None
2026-03-29 22:03:21 [bca.uk] INFO: Saving data for CN65%20OTA: {'created_time': 1774821801.925219, 'last_price_update_time': 1774821801.925231, 'auction_closing_time': 1774951200.0}
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CN65%2520OTA') HTTP/1.1" 204 0
2026-03-29 22:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 94abe6e9-81d6-5688-9976-35bc84a70d4a with identifier: YR67%20NZG
2026-03-29 22:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 94abe6e9-81d6-5688-9976-35bc84a70d4a with identifier: YR67%20NZG
2026-03-29 22:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 94abe6e9-81d6-5688-9976-35bc84a70d4a with identifier: YR67%20NZG to the API
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393124/600>
{'auction_title': '',
'c_o_2_emission_value': 228,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_expert_report_file_e7df3730-51d5-4683-a04e-4a4e308aaeab.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YR67%20NZG-GB',
'category': 'LightCommercialVehicle',
'color': 'orange',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '94abe6e9-81d6-5688-9976-35bc84a70d4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YR67 NZG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YR67%20NZG&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'RANGER',
'odometer': 118371,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53048,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393055/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47223,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393069/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44860,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393083/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47739,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393096/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47497,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393113/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42861,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393124/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122623,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393140/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82005,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393147/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90686,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393150/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94abe6e9-81d6-5688-9976-35bc84a70d4a/94abe6e9-81d6-5688-9976-35bc84a70d4a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66777,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR67NZG/699393152/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FORD RANGER 3.2 TDCI 200 WILDTRAK 4WD CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'TDCI 200 WILDTRAK 4WD',
'vin': '6FPPXXMJ2PHG08189',
'year': 2017}
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR67%2520NZG%27 HTTP/1.1" 200 None
2026-03-29 22:03:22 [bca.uk] INFO: Saving data for YR67%20NZG: {'created_time': 1774821802.308139, 'last_price_update_time': 1774821802.308151, 'auction_closing_time': 1774951200.0}
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YR67%2520NZG') HTTP/1.1" 204 0
2026-03-29 22:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239946/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KD15FPU/42809529?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=fvJF7ucpRX0E%2BAJp%2BX9CWPAyJRKbO%2FRJwWNOYDHIzAs%3D)
2026-03-29 22:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234524/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK55EXG/42758130?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=zNKuCsXwY5YBweBL8fGiYSmIg6c7hmRzF6E4Qyh0WVI%3D)
2026-03-29 22:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212548/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL11KPY/42783241?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=Q5R98DxLk%2FIyOrHb6oSyVq%2Bq9sVfHG45AhfvPKzaek4%3D)
2026-03-29 22:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK65LDD/42812399?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=Jmfc85tb0kYx50%2BURzquG39JrqJ2lb%2BDkV6aqrYcOoI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LK65%20LDD-GB>
2026-03-29 22:03:22 [bca.uk] INFO: Found listing with ID: BR21%20UPK
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BR21%2520UPK%27 HTTP/1.1" 200 None
2026-03-29 22:03:22 [bca.uk] INFO: Scrape type for BR21%20UPK: 2
2026-03-29 22:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d84afb8f-b94e-5539-bad4-8e5e2c8b92e8 with identifier: BR21%20UPK
2026-03-29 22:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d84afb8f-b94e-5539-bad4-8e5e2c8b92e8 with scrape type 2
2026-03-29 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d84afb8f-b94e-5539-bad4-8e5e2c8b92e8 with scrape type 2
2026-03-29 22:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d84afb8f-b94e-5539-bad4-8e5e2c8b92e8, identifier: BR21%20UPK
2026-03-29 22:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC64ULZ/42812318?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=FgK9URJPQRCwQJ0o8NKxE9CnVWlkhUweJFUTtZ6LlnY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC64%20ULZ-GB>
2026-03-29 22:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406328/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LA70NPE/42811995?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=1ymICcEKrtpKHFHLQTc1yKaMMeniIFUDVOMDF5neyAs%3D)
2026-03-29 22:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d84afb8f-b94e-5539-bad4-8e5e2c8b92e8 with identifier: BR21%20UPK
2026-03-29 22:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d84afb8f-b94e-5539-bad4-8e5e2c8b92e8 with identifier: BR21%20UPK
2026-03-29 22:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d84afb8f-b94e-5539-bad4-8e5e2c8b92e8 with identifier: BR21%20UPK to the API
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BR21%20UPK-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '0.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Electric',
'id': 'd84afb8f-b94e-5539-bad4-8e5e2c8b92e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BR21 UPK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BR21%20UPK&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow',
'make': 'AUDI',
'model': 'E-TRON GT RS',
'odometer': 42022,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'AUDI E-TRON GT RS 475KW 93KWH Q CARBON BLACK Coupe',
'transmission': 'automatic',
'trim': '475KW 93KWH Q CARBON BLACK',
'vin': 'WAUZZZFW1N7901273',
'year': 2021}
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BR21%2520UPK%27 HTTP/1.1" 200 None
2026-03-29 22:03:22 [bca.uk] INFO: Saving data for BR21%20UPK: {'auction_closing_time': 1775037600.0, 'created_time': 1773832963.456605, 'last_price_update_time': 1774821802.797982}
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BR21%2520UPK') HTTP/1.1" 204 0
2026-03-29 22:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC22HUO/42806704?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=dQBCNh6w1rixkLp3DKgWlJpgfe3vccB%2F%2Fb6WAecmC7Q%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409267/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE18CHX/42812000?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=oyBRp8qHoowbCW9kieY0zUV46IZNjY3FwR8NKuxfaxo%3D)
2026-03-29 22:03:22 [bca.uk] INFO: Found listing with ID: SF68%20ZZH
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF68%2520ZZH%27 HTTP/1.1" 200 None
2026-03-29 22:03:22 [bca.uk] INFO: Scrape type for SF68%20ZZH: 0
2026-03-29 22:03:22 [bca.uk] INFO: Found listing with ID: FD15%20FKB
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD15%2520FKB%27 HTTP/1.1" 200 None
2026-03-29 22:03:22 [bca.uk] INFO: Scrape type for FD15%20FKB: 0
2026-03-29 22:03:22 [bca.uk] INFO: Found listing with ID: HG08%20FRX
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG08%2520FRX%27 HTTP/1.1" 200 None
2026-03-29 22:03:22 [bca.uk] INFO: Scrape type for HG08%20FRX: 0
2026-03-29 22:03:22 [bca.uk] INFO: Found listing with ID: RX24%20YZN
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX24%2520YZN%27 HTTP/1.1" 200 None
2026-03-29 22:03:22 [bca.uk] INFO: Scrape type for RX24%20YZN: 1
2026-03-29 22:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9edc33d7-192a-5fcd-8823-b4e8eb0a8391 with identifier: RX24%20YZN
2026-03-29 22:03:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9edc33d7-192a-5fcd-8823-b4e8eb0a8391
2026-03-29 22:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6192ef10>
2026-03-29 22:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70YYW%252F699040206%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040206/600 saved to cache
2026-03-29 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01b57636-ffd9-585f-9b00-e6ae7dbcc329
2026-03-29 22:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6353a650>
2026-03-29 22:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FP17LPT%252F686575421%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575421/600 saved to cache
2026-03-29 22:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9
2026-03-29 22:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621b9490>
2026-03-29 22:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP65LKN%252F699411792%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411792/600 saved to cache
2026-03-29 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6062366a-77b0-5b3c-aa23-49414d769971
2026-03-29 22:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636b7dd0>
2026-03-29 22:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_expert_report_file_7f23d172-db57-4f13-895e-21ec8e9946e8.pdf HTTP/1.1" 201 0
2026-03-29 22:03:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item dd5918ef-16dc-5dbe-90ef-20698b6a8126
2026-03-29 22:03:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd5918ef-16dc-5dbe-90ef-20698b6a8126, skipping ID generation
2026-03-29 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd5918ef-16dc-5dbe-90ef-20698b6a8126
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHK74VDT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HK74VDT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617fb090>
2026-03-29 22:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_expert_report_file_fc945a10-52c0-4a5e-8caf-6a7bd5a7f7d7.pdf HTTP/1.1" 201 0
2026-03-29 22:03:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 95589f3c-887c-5311-a841-cf63432d8df5
2026-03-29 22:03:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95589f3c-887c-5311-a841-cf63432d8df5, skipping ID generation
2026-03-29 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95589f3c-887c-5311-a841-cf63432d8df5
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOE10BXU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OE10BXU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251964/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MC14KAE/42809755?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=DG6b3zLT1DRX51p27qxjR95H%2BdTJAJxRv%2B3BMmM%2BaS4%3D)
2026-03-29 22:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX22ORL/42812368?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=4JuKCAILMz4%2BQPnM96C2XazYcd%2BQuDP%2F3FUZiLkKst4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FX22%20ORL-GB>
2026-03-29 22:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY17UNZ/42812181?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=hFBTsS2nuxHG%2FPLDcHvb2CJWogkhUN7WPevhBflvZ2A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY17%20UNZ-GB>
2026-03-29 22:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435165/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS68PYY/42812178?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=ilxdzGsr4IgRZDvqZmWhurm4pGkLnzxS3s4veY%2BdCjs%3D)
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: HN16%20FEM
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN16%2520FEM%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for HN16%20FEM: 0
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: YF16%20VUJ
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF16%2520VUJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for YF16%20VUJ: 0
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: GK16%20EPE
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK16%2520EPE%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for GK16%20EPE: 0
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: LX66%20KVO
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX66%2520KVO%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for LX66%20KVO: 0
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: YT64%20TZR
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT64%2520TZR%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for YT64%20TZR: 0
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: DF13%20OAN
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF13%2520OAN%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for DF13%20OAN: 0
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: KT15%20GYV
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT15%2520GYV%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for KT15%20GYV: 0
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: BF63%20HVL
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF63%2520HVL%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for BF63%20HVL: 0
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: EA12%20KGK
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA12%2520KGK%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for EA12%20KGK: 0
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: VE10%20LDK
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE10%2520LDK%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for VE10%20LDK: 0
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: DS15%20CXK
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS15%2520CXK%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for DS15%20CXK: 0
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: FG63%20FHC
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG63%2520FHC%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for FG63%20FHC: 0
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: KU63%20OUW
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU63%2520OUW%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for KU63%20OUW: 0
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: PJ11%20AKP
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ11%2520AKP%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for PJ11%20AKP: 0
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: RJ18%20UXW
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ18%2520UXW%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for RJ18%20UXW: 0
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: SM13%20YUF
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM13%2520YUF%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for SM13%20YUF: 0
2026-03-29 22:03:23 [bca.uk] INFO: Found listing with ID: SM67%20VNV
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM67%2520VNV%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Scrape type for SM67%20VNV: 2
2026-03-29 22:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4b35cfb-486e-55d8-b302-6ece660ab632 with identifier: SM67%20VNV
2026-03-29 22:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4b35cfb-486e-55d8-b302-6ece660ab632 with scrape type 2
2026-03-29 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4b35cfb-486e-55d8-b302-6ece660ab632 with scrape type 2
2026-03-29 22:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e4b35cfb-486e-55d8-b302-6ece660ab632, identifier: SM67%20VNV
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699117057%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117057 not downloaded yet
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183729%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183729 not downloaded yet
2026-03-29 22:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e4b35cfb-486e-55d8-b302-6ece660ab632 with identifier: SM67%20VNV
2026-03-29 22:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e4b35cfb-486e-55d8-b302-6ece660ab632 with identifier: SM67%20VNV
2026-03-29 22:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e4b35cfb-486e-55d8-b302-6ece660ab632 with identifier: SM67%20VNV to the API
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 101,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SM67%20VNV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e4b35cfb-486e-55d8-b302-6ece660ab632',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SM67 VNV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SM67%20VNV&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'SKODA',
'model': 'FABIA',
'odometer': 61500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'SKODA FABIA 1.0 TSI 95 SE Hatchback',
'transmission': 'manual',
'trim': 'TSI 95 SE',
'vin': 'TMBFP6NJ1JZ044841',
'year': 2018}
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM67%2520VNV%27 HTTP/1.1" 200 None
2026-03-29 22:03:23 [bca.uk] INFO: Saving data for SM67%20VNV: {'auction_closing_time': 1774864800.0, 'created_time': 1774706572.176619, 'last_price_update_time': 1774821803.888066}
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SM67%2520VNV') HTTP/1.1" 204 0
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618781d0>
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKD15FPU%252F699239946%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239946/600 saved to cache
2026-03-29 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615445d0>
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK55EXG%252F699234524%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234524/600 saved to cache
2026-03-29 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0991f76e-fa68-5257-8869-29bbc185bed6
2026-03-29 22:03:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0991f76e-fa68-5257-8869-29bbc185bed6, skipping ID generation
2026-03-29 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0991f76e-fa68-5257-8869-29bbc185bed6 sending to next pipeline
2026-03-29 22:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0991f76e-fa68-5257-8869-29bbc185bed6, identifier: AK55%20EXG
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6102df50>
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL11KPY%252F699212548%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212548/600 saved to cache
2026-03-29 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c
2026-03-29 22:03:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636b5850>
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLA70NPE%252F699406328%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406328/600 saved to cache
2026-03-29 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4838ed0-a1bc-555f-ae17-73d79e29d1ac
2026-03-29 22:03:24 [bca.uk] INFO: Total items found: 100
2026-03-29 22:03:24 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded
2026-03-29 22:03:24 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:03:24 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61011490>
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_expert_report_file_01cb4cc3-87a7-4ca2-b152-6bdfe944d6c9.pdf HTTP/1.1" 201 0
2026-03-29 22:03:24 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6c45461f-b816-537d-a25b-219757224249
2026-03-29 22:03:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c45461f-b816-537d-a25b-219757224249, skipping ID generation
2026-03-29 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c45461f-b816-537d-a25b-219757224249
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDC22HUO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DC22HUO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632c8b50>
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE18CHX%252F699409267%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409267/600 saved to cache
2026-03-29 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad
2026-03-29 22:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411617/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411617>
2026-03-29 22:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65YHZ/42811357?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=1baiIOWHbM%2F4%2BVRoR2beDOige2RqCphS0OiGBDMOKRw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY65%20YHZ-GB>
2026-03-29 22:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430314/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430314>
2026-03-29 22:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430267/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430267>
2026-03-29 22:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19OFS/42810083?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=ORlwvGpwXL94ftG8FnSaSukIEGA5e2xLjQOEIZpRK9A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OW19%20OFS-GB>
2026-03-29 22:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK68TLO/42810527?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=LWWZ9ibgdpr0XB%2BZxka5%2Ba4QP2LsFip8WLiRMCnKMzE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BK68%20TLO-GB>
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: BJ13%20WXR
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ13%2520WXR%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for BJ13%20WXR: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: SD13%20ZKS
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD13%2520ZKS%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for SD13%20ZKS: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: CK64%20JOH
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK64%2520JOH%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for CK64%20JOH: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: FT63%20LWA
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT63%2520LWA%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for FT63%20LWA: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: KU63%20RYR
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU63%2520RYR%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for KU63%20RYR: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: LK08%20VFO
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK08%2520VFO%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for LK08%20VFO: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: PF59%20HHJ
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF59%2520HHJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for PF59%20HHJ: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: PO61%20YTU
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO61%2520YTU%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for PO61%20YTU: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: FH66%20SFV
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH66%2520SFV%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for FH66%20SFV: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: YF13%20MDZ
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF13%2520MDZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for YF13%20MDZ: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: DF66%20HMU
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF66%2520HMU%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for DF66%20HMU: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: HG15%20FWC
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG15%2520FWC%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for HG15%20FWC: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: KM61%20BXB
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM61%2520BXB%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for KM61%20BXB: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: GJ13%20TFE
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ13%2520TFE%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for GJ13%20TFE: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: DV14%20UMS
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV14%2520UMS%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for DV14%20UMS: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: FR62%20KCZ
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR62%2520KCZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for FR62%20KCZ: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: MX13%20XNM
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX13%2520XNM%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for MX13%20XNM: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: WM63%20VKD
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM63%2520VKD%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for WM63%20VKD: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: WUI%209939
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WUI%25209939%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for WUI%209939: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: BA16%20XGY
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BA16%2520XGY%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for BA16%20XGY: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: NJ17%20XBA
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ17%2520XBA%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for NJ17%20XBA: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: Y33%20LJS
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y33%2520LJS%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for Y33%20LJS: 0
2026-03-29 22:03:24 [bca.uk] INFO: Found listing with ID: WR15%20RXK
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR15%2520RXK%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [bca.uk] INFO: Scrape type for WR15%20RXK: 2
2026-03-29 22:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acc8feec-1312-5463-bc82-1b4e1d3182d4 with identifier: WR15%20RXK
2026-03-29 22:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acc8feec-1312-5463-bc82-1b4e1d3182d4 with scrape type 2
2026-03-29 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acc8feec-1312-5463-bc82-1b4e1d3182d4 with scrape type 2
2026-03-29 22:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: acc8feec-1312-5463-bc82-1b4e1d3182d4, identifier: WR15%20RXK
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699117059%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117059 not downloaded yet
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183735%27 HTTP/1.1" 200 None
2026-03-29 22:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183735 not downloaded yet
2026-03-29 22:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0991f76e-fa68-5257-8869-29bbc185bed6 with identifier: AK55%20EXG
2026-03-29 22:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0991f76e-fa68-5257-8869-29bbc185bed6 with identifier: AK55%20EXG
2026-03-29 22:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0991f76e-fa68-5257-8869-29bbc185bed6 with identifier: AK55%20EXG to the API
2026-03-29 22:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234524/600>
{'auction_title': '',
'c_o_2_emission_value': 168,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_expert_report_file_a50aae8b-8091-4c17-9a82-e25c6b7c3068.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK55%20EXG-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0991f76e-fa68-5257-8869-29bbc185bed6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AK55 EXG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AK55%20EXG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 61103,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38351,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234524/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37559,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234535/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35982,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234539/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38241,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234555/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36985,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234566/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34542,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234576/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234595/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69583,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234612/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80741,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234634/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0991f76e-fa68-5257-8869-29bbc185bed6/0991f76e-fa68-5257-8869-29bbc185bed6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83855,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK55EXG/699234651/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.4 S Hatchback',
'transmission': 'manual',
'trim': 'S',
'vin': 'WVWZZZ1KZ6B084766',
'year': 2005}
2026-03-29 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK55%2520EXG%27 HTTP/1.1" 200 None
2026-03-29 22:03:25 [bca.uk] INFO: Saving data for AK55%20EXG: {'created_time': 1774821805.366836, 'last_price_update_time': 1774821805.366847, 'auction_closing_time': 1775210400.0}
2026-03-29 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AK55%2520EXG') HTTP/1.1" 204 0
2026-03-29 22:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: acc8feec-1312-5463-bc82-1b4e1d3182d4 with identifier: WR15%20RXK
2026-03-29 22:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:03:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=purple HTTP/1.1" 200 None
2026-03-29 22:03:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: acc8feec-1312-5463-bc82-1b4e1d3182d4 with identifier: WR15%20RXK
2026-03-29 22:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: acc8feec-1312-5463-bc82-1b4e1d3182d4 with identifier: WR15%20RXK to the API
2026-03-29 22:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WR15%20RXK-GB',
'category': 'Car',
'color': 'purple',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'acc8feec-1312-5463-bc82-1b4e1d3182d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WR15 RXK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WR15%20RXK&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'CITROEN',
'model': 'C4 CACTUS',
'odometer': 78781,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'CITROEN C4 CACTUS 1.2 P/T 110 FLAIR Hatchback',
'transmission': 'manual',
'trim': 'P/T 110 FLAIR',
'vin': 'VF70PHNZBFE510220',
'year': 2015}
2026-03-29 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR15%2520RXK%27 HTTP/1.1" 200 None
2026-03-29 22:03:25 [bca.uk] INFO: Saving data for WR15%20RXK: {'auction_closing_time': 1774864800.0, 'created_time': 1774610904.077904, 'last_price_update_time': 1774821805.987836}
2026-03-29 22:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WR15%2520RXK') HTTP/1.1" 204 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: VU65%20FPP
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU65%2520FPP%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for VU65%20FPP: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: HN54%20ZBG
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN54%2520ZBG%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for HN54%20ZBG: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: BV68%20KXR
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV68%2520KXR%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for BV68%20KXR: 2
2026-03-29 22:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99a827d8-172d-56d6-81e0-6a15f753fbcb with identifier: BV68%20KXR
2026-03-29 22:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a827d8-172d-56d6-81e0-6a15f753fbcb with scrape type 2
2026-03-29 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99a827d8-172d-56d6-81e0-6a15f753fbcb with scrape type 2
2026-03-29 22:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 99a827d8-172d-56d6-81e0-6a15f753fbcb, identifier: BV68%20KXR
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699236614%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236614 not downloaded yet
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: YX19%20VMG
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX19%2520VMG%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for YX19%20VMG: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: VN60%20CDO
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN60%2520CDO%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for VN60%20CDO: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: BXZ%204666
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BXZ%25204666%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for BXZ%204666: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: KY65%20SXP
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY65%2520SXP%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for KY65%20SXP: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: EK60%20ONZ
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK60%2520ONZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for EK60%20ONZ: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: LO09%20ZCU
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO09%2520ZCU%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for LO09%20ZCU: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: WR67%20PEO
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR67%2520PEO%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for WR67%20PEO: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: MX68%20KYT
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX68%2520KYT%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for MX68%20KYT: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: LM68%20YDH
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM68%2520YDH%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for LM68%20YDH: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: MF18%20AYJ
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF18%2520AYJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for MF18%20AYJ: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: DC16%20NVK
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC16%2520NVK%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for DC16%20NVK: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: BJ67%20RFF
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ67%2520RFF%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for BJ67%20RFF: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: BW15%20ORL
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW15%2520ORL%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for BW15%20ORL: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: CK17%20ZKE
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK17%2520ZKE%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for CK17%20ZKE: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: YE15%20LBK
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE15%2520LBK%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for YE15%20LBK: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: DN13%20GUA
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN13%2520GUA%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for DN13%20GUA: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: KR08%20PHX
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR08%2520PHX%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for KR08%20PHX: 0
2026-03-29 22:03:26 [bca.uk] INFO: Found listing with ID: GU68%20BPY
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU68%2520BPY%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Scrape type for GU68%20BPY: 2
2026-03-29 22:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25267618-47b0-57cc-8f0f-3534cdaeed27 with identifier: GU68%20BPY
2026-03-29 22:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25267618-47b0-57cc-8f0f-3534cdaeed27 with scrape type 2
2026-03-29 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25267618-47b0-57cc-8f0f-3534cdaeed27 with scrape type 2
2026-03-29 22:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 25267618-47b0-57cc-8f0f-3534cdaeed27, identifier: GU68%20BPY
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699117063%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117063 not downloaded yet
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183741%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183741 not downloaded yet
2026-03-29 22:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 99a827d8-172d-56d6-81e0-6a15f753fbcb with identifier: BV68%20KXR
2026-03-29 22:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 99a827d8-172d-56d6-81e0-6a15f753fbcb with identifier: BV68%20KXR
2026-03-29 22:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 99a827d8-172d-56d6-81e0-6a15f753fbcb with identifier: BV68%20KXR to the API
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV68%20KXR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '99a827d8-172d-56d6-81e0-6a15f753fbcb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BV68 KXR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BV68%20KXR&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'VAUXHALL',
'model': 'CROSSLAND X',
'odometer': 67542,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VAUXHALL CROSSLAND X 1.2 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'W0V7D9EE5K4143197',
'year': 2018}
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV68%2520KXR%27 HTTP/1.1" 200 None
2026-03-29 22:03:26 [bca.uk] INFO: Saving data for BV68%20KXR: {'auction_closing_time': 1774864800.0, 'created_time': 1774390850.444456, 'last_price_update_time': 1774821806.922643}
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BV68%2520KXR') HTTP/1.1" 204 0
2026-03-29 22:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632da390>
2026-03-29 22:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMC14KAE%252F699251964%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251964/600 saved to cache
2026-03-29 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97c5232d-22c9-5728-b6fd-84d8da4f8949
2026-03-29 22:03:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63647810>
2026-03-29 22:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS68PYY%252F699435165%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435165/600 saved to cache
2026-03-29 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73
2026-03-29 22:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK65LDD/42812399?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=Jmfc85tb0kYx50%2BURzquG39JrqJ2lb%2BDkV6aqrYcOoI%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575406/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575406>
2026-03-29 22:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427855/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427855>
2026-03-29 22:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411837/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411837>
2026-03-29 22:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427908/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427908>
2026-03-29 22:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 25267618-47b0-57cc-8f0f-3534cdaeed27 with identifier: GU68%20BPY
2026-03-29 22:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 25267618-47b0-57cc-8f0f-3534cdaeed27 with identifier: GU68%20BPY
2026-03-29 22:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 25267618-47b0-57cc-8f0f-3534cdaeed27 with identifier: GU68%20BPY to the API
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 197,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU68%20BPY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '25267618-47b0-57cc-8f0f-3534cdaeed27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU68 BPY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU68%20BPY&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'LAND ROVER',
'model': 'DISCOVERY',
'odometer': 92985,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY 2.0 SD4 240 HSE StationWagon',
'transmission': 'automatic',
'trim': 'SD4 240 HSE',
'vin': 'SALRA2AN3KA084623',
'year': 2018}
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU68%2520BPY%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [bca.uk] INFO: Saving data for GU68%20BPY: {'auction_closing_time': 1774864800.0, 'created_time': 1774303378.157033, 'last_price_update_time': 1774821807.592092}
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU68%2520BPY') HTTP/1.1" 204 0
2026-03-29 22:03:27 [bca.uk] INFO: Found listing with ID: GV18%20EXP
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV18%2520EXP%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [bca.uk] INFO: Scrape type for GV18%20EXP: 2
2026-03-29 22:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2645e8a7-9f08-55dd-9d06-2ef82515449a with identifier: GV18%20EXP
2026-03-29 22:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2645e8a7-9f08-55dd-9d06-2ef82515449a with scrape type 2
2026-03-29 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2645e8a7-9f08-55dd-9d06-2ef82515449a with scrape type 2
2026-03-29 22:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2645e8a7-9f08-55dd-9d06-2ef82515449a, identifier: GV18%20EXP
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699236622%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236622 not downloaded yet
2026-03-29 22:03:27 [bca.uk] INFO: Found listing with ID: VU18%20ACY
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU18%2520ACY%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [bca.uk] INFO: Scrape type for VU18%20ACY: 0
2026-03-29 22:03:27 [bca.uk] INFO: Found listing with ID: CV68%20XCO
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV68%2520XCO%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [bca.uk] INFO: Scrape type for CV68%20XCO: 0
2026-03-29 22:03:27 [bca.uk] INFO: Found listing with ID: BT68%20WJK
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT68%2520WJK%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [bca.uk] INFO: Scrape type for BT68%20WJK: 0
2026-03-29 22:03:27 [bca.uk] INFO: Found listing with ID: MT18%20EXX
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT18%2520EXX%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [bca.uk] INFO: Scrape type for MT18%20EXX: 0
2026-03-29 22:03:27 [bca.uk] INFO: Found listing with ID: YS18%20GXM
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS18%2520GXM%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [bca.uk] INFO: Scrape type for YS18%20GXM: 0
2026-03-29 22:03:27 [bca.uk] INFO: Found listing with ID: KN70%20HLO
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN70%2520HLO%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [bca.uk] INFO: Scrape type for KN70%20HLO: 0
2026-03-29 22:03:27 [bca.uk] INFO: Found listing with ID: FM62%20OZH
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM62%2520OZH%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [bca.uk] INFO: Scrape type for FM62%20OZH: 0
2026-03-29 22:03:27 [bca.uk] INFO: Found listing with ID: NU59%20UOF
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU59%2520UOF%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [bca.uk] INFO: Scrape type for NU59%20UOF: 0
2026-03-29 22:03:27 [bca.uk] INFO: Found listing with ID: YT09%20PVL
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT09%2520PVL%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [bca.uk] INFO: Scrape type for YT09%20PVL: 0
2026-03-29 22:03:27 [bca.uk] INFO: Found listing with ID: BJ08%20VPE
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ08%2520VPE%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [bca.uk] INFO: Scrape type for BJ08%20VPE: 0
2026-03-29 22:03:27 [bca.uk] INFO: Found listing with ID: BK16%20SVA
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK16%2520SVA%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [bca.uk] INFO: Scrape type for BK16%20SVA: 0
2026-03-29 22:03:27 [bca.uk] INFO: Found listing with ID: BT65%20DVV
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT65%2520DVV%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [bca.uk] INFO: Scrape type for BT65%20DVV: 0
2026-03-29 22:03:27 [bca.uk] INFO: Found listing with ID: DC16%20EVN
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC16%2520EVN%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [bca.uk] INFO: Scrape type for DC16%20EVN: 0
2026-03-29 22:03:27 [bca.uk] INFO: Found listing with ID: DW17%20HOA
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DW17%2520HOA%27 HTTP/1.1" 200 None
2026-03-29 22:03:27 [bca.uk] INFO: Scrape type for DW17%20HOA: 2
2026-03-29 22:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87ef9587-5533-59b0-8ea3-0f5483dca5ab with identifier: DW17%20HOA
2026-03-29 22:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87ef9587-5533-59b0-8ea3-0f5483dca5ab with scrape type 2
2026-03-29 22:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87ef9587-5533-59b0-8ea3-0f5483dca5ab with scrape type 2
2026-03-29 22:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 87ef9587-5533-59b0-8ea3-0f5483dca5ab, identifier: DW17%20HOA
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699117065%27 HTTP/1.1" 200 None
2026-03-29 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117065 not downloaded yet
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183748%27 HTTP/1.1" 200 None
2026-03-29 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183748 not downloaded yet
2026-03-29 22:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2645e8a7-9f08-55dd-9d06-2ef82515449a with identifier: GV18%20EXP
2026-03-29 22:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2645e8a7-9f08-55dd-9d06-2ef82515449a with identifier: GV18%20EXP
2026-03-29 22:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2645e8a7-9f08-55dd-9d06-2ef82515449a with identifier: GV18%20EXP to the API
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GV18%20EXP-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2645e8a7-9f08-55dd-9d06-2ef82515449a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GV18 EXP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GV18%20EXP&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'VOLVO',
'model': 'XC90',
'odometer': 61434,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VOLVO XC90 2.0 D5 PP 235 AWD INSCRIPTION G/T StationWagon',
'transmission': 'manual',
'trim': 'D5 PP 235 AWD INSCRIPTION G/T',
'vin': 'YV1LF68UCK1419794',
'year': 2018}
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV18%2520EXP%27 HTTP/1.1" 200 None
2026-03-29 22:03:28 [bca.uk] INFO: Saving data for GV18%20EXP: {'auction_closing_time': 1774864800.0, 'created_time': 1774391035.667489, 'last_price_update_time': 1774821808.487514}
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GV18%2520EXP') HTTP/1.1" 204 0
2026-03-29 22:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX22ORL/42812368?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=4JuKCAILMz4%2BQPnM96C2XazYcd%2BQuDP%2F3FUZiLkKst4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 87ef9587-5533-59b0-8ea3-0f5483dca5ab with identifier: DW17%20HOA
2026-03-29 22:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 87ef9587-5533-59b0-8ea3-0f5483dca5ab with identifier: DW17%20HOA
2026-03-29 22:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 87ef9587-5533-59b0-8ea3-0f5483dca5ab with identifier: DW17%20HOA to the API
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DW17%20HOA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '87ef9587-5533-59b0-8ea3-0f5483dca5ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DW17 HOA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DW17%20HOA&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 72835,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.2 DIG-T 113 N-CONNECTA Hatchback',
'transmission': 'manual',
'trim': 'DIG-T 113 N-CONNECTA',
'vin': 'SJNFEAF15U7373125',
'year': 2017}
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DW17%2520HOA%27 HTTP/1.1" 200 None
2026-03-29 22:03:28 [bca.uk] INFO: Saving data for DW17%20HOA: {'auction_closing_time': 1774864800.0, 'created_time': 1774706992.750578, 'last_price_update_time': 1774821808.914891}
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DW17%2520HOA') HTTP/1.1" 204 0
2026-03-29 22:03:28 [bca.uk] INFO: Found listing with ID: LJ68%20TTK
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ68%2520TTK%27 HTTP/1.1" 200 None
2026-03-29 22:03:28 [bca.uk] INFO: Scrape type for LJ68%20TTK: 2
2026-03-29 22:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6313037-6a21-51e4-bd8d-6e44e6fba45b with identifier: LJ68%20TTK
2026-03-29 22:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6313037-6a21-51e4-bd8d-6e44e6fba45b with scrape type 2
2026-03-29 22:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6313037-6a21-51e4-bd8d-6e44e6fba45b with scrape type 2
2026-03-29 22:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e6313037-6a21-51e4-bd8d-6e44e6fba45b, identifier: LJ68%20TTK
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699236629%27 HTTP/1.1" 200 None
2026-03-29 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236629 not downloaded yet
2026-03-29 22:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC64ULZ/42812318?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=FgK9URJPQRCwQJ0o8NKxE9CnVWlkhUweJFUTtZ6LlnY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY17UNZ/42812181?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=hFBTsS2nuxHG%2FPLDcHvb2CJWogkhUN7WPevhBflvZ2A%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411781/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411781>
2026-03-29 22:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183725/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OE10BXU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:29 [bca.uk] INFO: Found listing with ID: LL66%20JRX
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL66%2520JRX%27 HTTP/1.1" 200 None
2026-03-29 22:03:29 [bca.uk] INFO: Scrape type for LL66%20JRX: 0
2026-03-29 22:03:29 [bca.uk] INFO: Found listing with ID: LO17%20DVV
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO17%2520DVV%27 HTTP/1.1" 200 None
2026-03-29 22:03:29 [bca.uk] INFO: Scrape type for LO17%20DVV: 0
2026-03-29 22:03:29 [bca.uk] INFO: Found listing with ID: SB15%20ZPJ
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB15%2520ZPJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:29 [bca.uk] INFO: Scrape type for SB15%20ZPJ: 2
2026-03-29 22:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d8360e3-a541-58b3-8f63-2cf585362783 with identifier: SB15%20ZPJ
2026-03-29 22:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d8360e3-a541-58b3-8f63-2cf585362783 with scrape type 2
2026-03-29 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d8360e3-a541-58b3-8f63-2cf585362783 with scrape type 2
2026-03-29 22:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1d8360e3-a541-58b3-8f63-2cf585362783, identifier: SB15%20ZPJ
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699117070%27 HTTP/1.1" 200 None
2026-03-29 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117070 not downloaded yet
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183754%27 HTTP/1.1" 200 None
2026-03-29 22:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183754 not downloaded yet
2026-03-29 22:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e6313037-6a21-51e4-bd8d-6e44e6fba45b with identifier: LJ68%20TTK
2026-03-29 22:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e6313037-6a21-51e4-bd8d-6e44e6fba45b with identifier: LJ68%20TTK
2026-03-29 22:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e6313037-6a21-51e4-bd8d-6e44e6fba45b with identifier: LJ68%20TTK to the API
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 57,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LJ68%20TTK-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'e6313037-6a21-51e4-bd8d-6e44e6fba45b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LJ68 TTK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LJ68%20TTK&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'BMW',
'model': '2 ACTIVE TOURER',
'odometer': 98409,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'BMW 2 ACTIVE TOURER 1.5 225XE M SPORT PREMIUM Hatchback',
'transmission': 'automatic',
'trim': '225XE M SPORT PREMIUM',
'vin': 'WBA6Y320807D12110',
'year': 2018}
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ68%2520TTK%27 HTTP/1.1" 200 None
2026-03-29 22:03:29 [bca.uk] INFO: Saving data for LJ68%20TTK: {'auction_closing_time': 1774864800.0, 'created_time': 1774044810.129902, 'last_price_update_time': 1774821809.579952}
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LJ68%2520TTK') HTTP/1.1" 204 0
2026-03-29 22:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430267/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA16ETX/42812131?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=67cSoD7yDAcPlVUXb6MtFxB8b%2F%2B%2FHPzK%2FRcqJHz%2FIwo%3D)
2026-03-29 22:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1d8360e3-a541-58b3-8f63-2cf585362783 with identifier: SB15%20ZPJ
2026-03-29 22:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1d8360e3-a541-58b3-8f63-2cf585362783 with identifier: SB15%20ZPJ
2026-03-29 22:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1d8360e3-a541-58b3-8f63-2cf585362783 with identifier: SB15%20ZPJ to the API
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB15%20ZPJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1d8360e3-a541-58b3-8f63-2cf585362783',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB15 ZPJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB15%20ZPJ&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 96833,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 90 E/F EXCITE Hatchback',
'transmission': 'manual',
'trim': '90 E/F EXCITE',
'vin': 'W0L0XEP68F4217979',
'year': 2015}
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB15%2520ZPJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:29 [bca.uk] INFO: Saving data for SB15%20ZPJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774706992.283481, 'last_price_update_time': 1774821809.934948}
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB15%2520ZPJ') HTTP/1.1" 204 0
2026-03-29 22:03:29 [bca.uk] INFO: Found listing with ID: MJ19%20UHC
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ19%2520UHC%27 HTTP/1.1" 200 None
2026-03-29 22:03:29 [bca.uk] INFO: Scrape type for MJ19%20UHC: 0
2026-03-29 22:03:29 [bca.uk] INFO: Found listing with ID: YH14%20PZJ
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH14%2520PZJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:29 [bca.uk] INFO: Scrape type for YH14%20PZJ: 0
2026-03-29 22:03:29 [bca.uk] INFO: Found listing with ID: YX64%20PZC
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX64%2520PZC%27 HTTP/1.1" 200 None
2026-03-29 22:03:30 [bca.uk] INFO: Scrape type for YX64%20PZC: 2
2026-03-29 22:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce7a5f53-c2d3-514a-ad12-77d2867e59cc with identifier: YX64%20PZC
2026-03-29 22:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce7a5f53-c2d3-514a-ad12-77d2867e59cc with scrape type 2
2026-03-29 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce7a5f53-c2d3-514a-ad12-77d2867e59cc with scrape type 2
2026-03-29 22:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ce7a5f53-c2d3-514a-ad12-77d2867e59cc, identifier: YX64%20PZC
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699236638%27 HTTP/1.1" 200 None
2026-03-29 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236638 not downloaded yet
2026-03-29 22:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615f2c50>
2026-03-29 22:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_expert_report_file_1bdb7e8d-81b8-4b60-9f3d-85c971aadbda.pdf HTTP/1.1" 201 0
2026-03-29 22:03:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1bbb7ce7-a50f-5792-918b-66476d234a65
2026-03-29 22:03:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1bbb7ce7-a50f-5792-918b-66476d234a65, skipping ID generation
2026-03-29 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1bbb7ce7-a50f-5792-918b-66476d234a65
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLK65LDD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LK65LDD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:30 [bca.uk] INFO: Found listing with ID: BG16%20VPU
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG16%2520VPU%27 HTTP/1.1" 200 None
2026-03-29 22:03:30 [bca.uk] INFO: Scrape type for BG16%20VPU: 2
2026-03-29 22:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 477bab74-dc05-5a7b-9859-e3241d0cdc6e with identifier: BG16%20VPU
2026-03-29 22:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 477bab74-dc05-5a7b-9859-e3241d0cdc6e with scrape type 2
2026-03-29 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 477bab74-dc05-5a7b-9859-e3241d0cdc6e with scrape type 2
2026-03-29 22:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 477bab74-dc05-5a7b-9859-e3241d0cdc6e, identifier: BG16%20VPU
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699117075%27 HTTP/1.1" 200 None
2026-03-29 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117075 not downloaded yet
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183769%27 HTTP/1.1" 200 None
2026-03-29 22:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183769 not downloaded yet
2026-03-29 22:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ce7a5f53-c2d3-514a-ad12-77d2867e59cc with identifier: YX64%20PZC
2026-03-29 22:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ce7a5f53-c2d3-514a-ad12-77d2867e59cc with identifier: YX64%20PZC
2026-03-29 22:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ce7a5f53-c2d3-514a-ad12-77d2867e59cc with identifier: YX64%20PZC to the API
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YX64%20PZC-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ce7a5f53-c2d3-514a-ad12-77d2867e59cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YX64 PZC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YX64%20PZC&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 91625,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 TITANIUM NAVIGATOR Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM NAVIGATOR',
'vin': 'WF0KXXGCBKEB81555',
'year': 2014}
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX64%2520PZC%27 HTTP/1.1" 200 None
2026-03-29 22:03:30 [bca.uk] INFO: Saving data for YX64%20PZC: {'auction_closing_time': 1774864800.0, 'created_time': 1774365704.023629, 'last_price_update_time': 1774821810.690199}
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YX64%2520PZC') HTTP/1.1" 204 0
2026-03-29 22:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19OFS/42810083?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=ORlwvGpwXL94ftG8FnSaSukIEGA5e2xLjQOEIZpRK9A%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK68TLO/42810527?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=LWWZ9ibgdpr0XB%2BZxka5%2Ba4QP2LsFip8WLiRMCnKMzE%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430314/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19VSX/42812111?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=qlSeQUbf83xHqWfD9mYZ2SCAALVwdddlxYHgmUNU2tY%3D)
2026-03-29 22:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 477bab74-dc05-5a7b-9859-e3241d0cdc6e with identifier: BG16%20VPU
2026-03-29 22:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 477bab74-dc05-5a7b-9859-e3241d0cdc6e with identifier: BG16%20VPU
2026-03-29 22:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 477bab74-dc05-5a7b-9859-e3241d0cdc6e with identifier: BG16%20VPU to the API
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG16%20VPU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '477bab74-dc05-5a7b-9859-e3241d0cdc6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG16 VPU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BG16%20VPU&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 56542,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.2 DIG-T 113 ACENTA PREMIUM Hatchback',
'transmission': 'manual',
'trim': 'DIG-T 113 ACENTA PREMIUM',
'vin': 'SJNFEAF15U7166433',
'year': 2016}
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG16%2520VPU%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Saving data for BG16%20VPU: {'auction_closing_time': 1774864800.0, 'created_time': 1774188114.028666, 'last_price_update_time': 1774821811.10858}
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BG16%2520VPU') HTTP/1.1" 204 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: X754%20XJO
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X754%2520XJO%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for X754%20XJO: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: KD55%20WDG
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KD55%2520WDG%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for KD55%20WDG: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: HN09%20VCM
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN09%2520VCM%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for HN09%20VCM: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: WR10%20KTF
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR10%2520KTF%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for WR10%20KTF: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: AX06%20BHJ
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX06%2520BHJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for AX06%20BHJ: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: BF08%20KXH
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF08%2520KXH%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for BF08%20KXH: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: DA11%20XHP
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA11%2520XHP%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for DA11%20XHP: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: DV15%20BDX
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV15%2520BDX%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for DV15%20BDX: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: GD05%20ESY
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD05%2520ESY%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for GD05%20ESY: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: GF13%20WKW
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF13%2520WKW%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for GF13%20WKW: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: GY62%20LMK
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY62%2520LMK%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for GY62%20LMK: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: LF13%20HMY
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF13%2520HMY%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for LF13%20HMY: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: LN10%20YCU
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN10%2520YCU%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for LN10%20YCU: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: LT62%20PZA
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT62%2520PZA%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for LT62%20PZA: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: LX10%20XUF
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX10%2520XUF%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for LX10%20XUF: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: LX63%20NNP
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX63%2520NNP%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for LX63%20NNP: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: MF62%20LBL
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF62%2520LBL%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for MF62%20LBL: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: BF19%20GGJ
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF19%2520GGJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for BF19%20GGJ: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: KX18%20YOG
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX18%2520YOG%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for KX18%20YOG: 0
2026-03-29 22:03:31 [bca.uk] INFO: Found listing with ID: EA67%20PUX
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA67%2520PUX%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [bca.uk] INFO: Scrape type for EA67%20PUX: 2
2026-03-29 22:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efe9536c-07f4-51cc-8c8c-b67b73b93c1d with identifier: EA67%20PUX
2026-03-29 22:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efe9536c-07f4-51cc-8c8c-b67b73b93c1d with scrape type 2
2026-03-29 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efe9536c-07f4-51cc-8c8c-b67b73b93c1d with scrape type 2
2026-03-29 22:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: efe9536c-07f4-51cc-8c8c-b67b73b93c1d, identifier: EA67%20PUX
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699236645%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236645 not downloaded yet
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440270%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440270 not downloaded yet
2026-03-29 22:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637bf290>
2026-03-29 22:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_expert_report_file_a7ddbeb2-c251-4aa9-9a66-2a5c2cca681b.pdf HTTP/1.1" 201 0
2026-03-29 22:03:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 502e65dc-018f-56cc-9774-295a6ce3b96a
2026-03-29 22:03:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 502e65dc-018f-56cc-9774-295a6ce3b96a, skipping ID generation
2026-03-29 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 502e65dc-018f-56cc-9774-295a6ce3b96a
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFX22ORL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FX22ORL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a0b210>
2026-03-29 22:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_expert_report_file_bc279b69-1a99-472c-9a6a-bad3c77436a0.pdf HTTP/1.1" 201 0
2026-03-29 22:03:32 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7faeccc2-4423-53aa-a318-803e1d873f8c
2026-03-29 22:03:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7faeccc2-4423-53aa-a318-803e1d873f8c, skipping ID generation
2026-03-29 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7faeccc2-4423-53aa-a318-803e1d873f8c
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYC64ULZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YC64ULZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615e8b90>
2026-03-29 22:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_expert_report_file_80a522ba-56d6-474a-929d-08f702c43202.pdf HTTP/1.1" 201 0
2026-03-29 22:03:32 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a50a9ac2-1ae6-5dea-b91f-fba078bf92af
2026-03-29 22:03:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a50a9ac2-1ae6-5dea-b91f-fba078bf92af, skipping ID generation
2026-03-29 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a50a9ac2-1ae6-5dea-b91f-fba078bf92af
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFY17UNZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FY17UNZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411617/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE19AAK/42812078?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=MkdK1ykhsLQ%2B%2F2n1Irxn7evFumHYKKFZXmkQdpd8KgM%3D)
2026-03-29 22:03:32 [bca.uk] INFO: Found listing with ID: KU60%20AEM
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU60%2520AEM%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [bca.uk] INFO: Scrape type for KU60%20AEM: 0
2026-03-29 22:03:32 [bca.uk] INFO: Found listing with ID: VO65%20FFY
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO65%2520FFY%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [bca.uk] INFO: Scrape type for VO65%20FFY: 0
2026-03-29 22:03:32 [bca.uk] INFO: Found listing with ID: DU17%20VHK
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU17%2520VHK%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [bca.uk] INFO: Scrape type for DU17%20VHK: 0
2026-03-29 22:03:32 [bca.uk] INFO: Found listing with ID: EN63%20CGG
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN63%2520CGG%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [bca.uk] INFO: Scrape type for EN63%20CGG: 0
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699117083%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117083 not downloaded yet
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183782%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183782 not downloaded yet
2026-03-29 22:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: efe9536c-07f4-51cc-8c8c-b67b73b93c1d with identifier: EA67%20PUX
2026-03-29 22:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: efe9536c-07f4-51cc-8c8c-b67b73b93c1d with identifier: EA67%20PUX
2026-03-29 22:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: efe9536c-07f4-51cc-8c8c-b67b73b93c1d with identifier: EA67%20PUX to the API
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA67%20PUX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'efe9536c-07f4-51cc-8c8c-b67b73b93c1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA67 PUX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA67%20PUX&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'DACIA',
'model': 'SANDERO',
'odometer': 63227,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'DACIA SANDERO 1.0 SCE AMBIANCE Hatchback',
'transmission': 'manual',
'trim': 'SCE AMBIANCE',
'vin': 'UU15SDMC559039894',
'year': 2017}
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA67%2520PUX%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [bca.uk] INFO: Saving data for EA67%20PUX: {'auction_closing_time': 1774864800.0, 'created_time': 1774706583.764609, 'last_price_update_time': 1774821812.578293}
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA67%2520PUX') HTTP/1.1" 204 0
2026-03-29 22:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427855/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE20EVL/42811999?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=QNaGwsE1HTKndyV7dS5jfLI1ozyFJBkYcrsiWmkuv8k%3D)
2026-03-29 22:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427908/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19VXX/42812304?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=YzGWBhkemG5tXMwAwvYpsWX0bEfwiTWFoG%2FIuzQzr2c%3D)
2026-03-29 22:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411837/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML23KNX/42812081?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Ysjf2AWU3A%2B%2BhkZ4EdoIgPpKhCyN1a54UPjPwLBr1pc%3D)
2026-03-29 22:03:32 [bca.uk] INFO: Found listing with ID: EU64%20XKO
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU64%2520XKO%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [bca.uk] INFO: Scrape type for EU64%20XKO: 2
2026-03-29 22:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c581e762-b664-5d4e-a53f-b0f6aee181a0 with identifier: EU64%20XKO
2026-03-29 22:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c581e762-b664-5d4e-a53f-b0f6aee181a0 with scrape type 2
2026-03-29 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c581e762-b664-5d4e-a53f-b0f6aee181a0 with scrape type 2
2026-03-29 22:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c581e762-b664-5d4e-a53f-b0f6aee181a0, identifier: EU64%20XKO
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699236658%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236658 not downloaded yet
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699439153%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699439153 not downloaded yet
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015348%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015348 not downloaded yet
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430108%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430108 not downloaded yet
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699437910%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437910 not downloaded yet
2026-03-29 22:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236614/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236614>
2026-03-29 22:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236622/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236622>
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699117089%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117089 not downloaded yet
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183799%27 HTTP/1.1" 200 None
2026-03-29 22:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183799 not downloaded yet
2026-03-29 22:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c581e762-b664-5d4e-a53f-b0f6aee181a0 with identifier: EU64%20XKO
2026-03-29 22:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c581e762-b664-5d4e-a53f-b0f6aee181a0 with identifier: EU64%20XKO
2026-03-29 22:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c581e762-b664-5d4e-a53f-b0f6aee181a0 with identifier: EU64%20XKO to the API
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EU64%20XKO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c581e762-b664-5d4e-a53f-b0f6aee181a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EU64 XKO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EU64%20XKO&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'HYUNDAI',
'model': 'IX35',
'odometer': 115584,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'HYUNDAI IX35 1.7 CRDI S 2WD StationWagon',
'transmission': 'manual',
'trim': 'CRDI S 2WD',
'vin': 'TMAJT81ULFJ635603',
'year': 2014}
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU64%2520XKO%27 HTTP/1.1" 200 None
2026-03-29 22:03:33 [bca.uk] INFO: Saving data for EU64%20XKO: {'auction_closing_time': 1774864800.0, 'created_time': 1774476325.573911, 'last_price_update_time': 1774821813.246017}
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EU64%2520XKO') HTTP/1.1" 204 0
2026-03-29 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615eb1d0>
2026-03-29 22:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA16ETX%252F699430267%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430267/600 saved to cache
2026-03-29 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6398c60-fe63-5a45-a148-79cf4bf62bcf
2026-03-29 22:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6184fc90>
2026-03-29 22:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_expert_report_file_99626854-f759-408e-9c4a-3cb32beb0a39.pdf HTTP/1.1" 201 0
2026-03-29 22:03:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a0c90534-4dbe-5982-85b5-b9b714d55606
2026-03-29 22:03:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0c90534-4dbe-5982-85b5-b9b714d55606, skipping ID generation
2026-03-29 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0c90534-4dbe-5982-85b5-b9b714d55606
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOW19OFS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OW19OFS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61959f50>
2026-03-29 22:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_expert_report_file_e74967d0-7805-4600-a315-d8bd76c43d35.pdf HTTP/1.1" 201 0
2026-03-29 22:03:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9f9f2c24-88ea-52eb-8933-488e5868efc1
2026-03-29 22:03:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f9f2c24-88ea-52eb-8933-488e5868efc1, skipping ID generation
2026-03-29 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f9f2c24-88ea-52eb-8933-488e5868efc1
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBK68TLO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BK68TLO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6119b510>
2026-03-29 22:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19VSX%252F699430314%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430314/600 saved to cache
2026-03-29 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 732664ff-2041-53f2-83f7-e4a6aeaa1df2
2026-03-29 22:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65YHZ/42811357?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=1baiIOWHbM%2F4%2BVRoR2beDOige2RqCphS0OiGBDMOKRw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183725/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE10BXU/42806585?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=0HeSSm6%2FyPGHrQi9lQ%2F5I1Qis0B5ucoXD25aBf9XYJU%3D)
2026-03-29 22:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575406/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/P17LPT/42573216?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Cei94j6xTuVsYVAtMEIEaOIhWn8jpASCTY7XqjpVl64%3D)
2026-03-29 22:03:33 [bca.uk] INFO: Found listing with ID: FG68%20YWJ
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG68%2520YWJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:33 [bca.uk] INFO: Scrape type for FG68%20YWJ: 0
2026-03-29 22:03:33 [bca.uk] INFO: Found listing with ID: GV67%20PKE
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV67%2520PKE%27 HTTP/1.1" 200 None
2026-03-29 22:03:33 [bca.uk] INFO: Scrape type for GV67%20PKE: 0
2026-03-29 22:03:33 [bca.uk] INFO: Found listing with ID: MP65%20HBK
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP65%2520HBK%27 HTTP/1.1" 200 None
2026-03-29 22:03:33 [bca.uk] INFO: Scrape type for MP65%20HBK: 2
2026-03-29 22:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dfeefb8-d7d5-578d-bfda-b2ccece77879 with identifier: MP65%20HBK
2026-03-29 22:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dfeefb8-d7d5-578d-bfda-b2ccece77879 with scrape type 2
2026-03-29 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dfeefb8-d7d5-578d-bfda-b2ccece77879 with scrape type 2
2026-03-29 22:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7dfeefb8-d7d5-578d-bfda-b2ccece77879, identifier: MP65%20HBK
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699236673%27 HTTP/1.1" 200 None
2026-03-29 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236673 not downloaded yet
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440280%27 HTTP/1.1" 200 None
2026-03-29 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440280 not downloaded yet
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015357%27 HTTP/1.1" 200 None
2026-03-29 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015357 not downloaded yet
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430149%27 HTTP/1.1" 200 None
2026-03-29 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430149 not downloaded yet
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699437921%27 HTTP/1.1" 200 None
2026-03-29 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437921 not downloaded yet
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699117096%27 HTTP/1.1" 200 None
2026-03-29 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117096 not downloaded yet
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183818%27 HTTP/1.1" 200 None
2026-03-29 22:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183818 not downloaded yet
2026-03-29 22:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7dfeefb8-d7d5-578d-bfda-b2ccece77879 with identifier: MP65%20HBK
2026-03-29 22:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7dfeefb8-d7d5-578d-bfda-b2ccece77879 with identifier: MP65%20HBK
2026-03-29 22:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7dfeefb8-d7d5-578d-bfda-b2ccece77879 with identifier: MP65%20HBK to the API
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MP65%20HBK-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7dfeefb8-d7d5-578d-bfda-b2ccece77879',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MP65 HBK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MP65%20HBK&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'C220 D',
'odometer': 83088,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C220 D 2.1 SE EXECUTIVE Estate',
'transmission': 'manual',
'trim': 'SE EXECUTIVE',
'vin': 'WDD2052042F330855',
'year': 2016}
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP65%2520HBK%27 HTTP/1.1" 200 None
2026-03-29 22:03:34 [bca.uk] INFO: Saving data for MP65%20HBK: {'auction_closing_time': 1774864800.0, 'created_time': 1774390962.455067, 'last_price_update_time': 1774821814.06498}
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MP65%2520HBK') HTTP/1.1" 204 0
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456077%27 HTTP/1.1" 200 None
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456077 not downloaded yet
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142394%27 HTTP/1.1" 200 None
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142394 not downloaded yet
2026-03-29 22:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236629/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236629>
2026-03-29 22:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183748/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183748>
2026-03-29 22:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117065/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117065>
2026-03-29 22:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440260/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LK65LDD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411781/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP65LKN/42812099?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=YYiddic%2BqcqY2M0XPOfW0%2FrAPtac9opCHs6%2B5ikpuFw%3D)
2026-03-29 22:03:34 [bca.uk] INFO: Found listing with ID: PO15%20XUV
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO15%2520XUV%27 HTTP/1.1" 200 None
2026-03-29 22:03:34 [bca.uk] INFO: Scrape type for PO15%20XUV: 2
2026-03-29 22:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 325fe017-882a-52af-b1a0-8b2b107ef73e with identifier: PO15%20XUV
2026-03-29 22:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 325fe017-882a-52af-b1a0-8b2b107ef73e with scrape type 2
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 325fe017-882a-52af-b1a0-8b2b107ef73e with scrape type 2
2026-03-29 22:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 325fe017-882a-52af-b1a0-8b2b107ef73e, identifier: PO15%20XUV
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699236687%27 HTTP/1.1" 200 None
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236687 not downloaded yet
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699439154%27 HTTP/1.1" 200 None
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699439154 not downloaded yet
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015367%27 HTTP/1.1" 200 None
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015367 not downloaded yet
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430173%27 HTTP/1.1" 200 None
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430173 not downloaded yet
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699437939%27 HTTP/1.1" 200 None
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437939 not downloaded yet
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615f0910>
2026-03-29 22:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE19AAK%252F699411617%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411617/600 saved to cache
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff522792-d041-5ecb-b231-8bf72c190c1e
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6367a350>
2026-03-29 22:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE20EVL%252F699427855%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427855/600 saved to cache
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b145ed4d-e096-5329-b7ec-7396067fba60
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6195b310>
2026-03-29 22:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19VXX%252F699427908%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427908/600 saved to cache
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 553a9526-308c-5e9f-97f5-1bce769f99d7
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61934150>
2026-03-29 22:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML23KNX%252F699411837%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411837/600 saved to cache
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c96e7ad0-7cd4-5ea7-b41d-642972a2bf14
2026-03-29 22:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183754/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183754>
2026-03-29 22:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236638/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236638>
2026-03-29 22:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183769/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183769>
2026-03-29 22:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 325fe017-882a-52af-b1a0-8b2b107ef73e with identifier: PO15%20XUV
2026-03-29 22:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 325fe017-882a-52af-b1a0-8b2b107ef73e with identifier: PO15%20XUV
2026-03-29 22:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 325fe017-882a-52af-b1a0-8b2b107ef73e with identifier: PO15%20XUV to the API
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PO15%20XUV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '325fe017-882a-52af-b1a0-8b2b107ef73e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PO15 XUV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PO15%20XUV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'ZAFIRA TOURER',
'odometer': 78111,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL ZAFIRA TOURER 1.4 T 140 EXCLUSIV MPV',
'transmission': 'manual',
'trim': 'T 140 EXCLUSIV',
'vin': 'W0LPD9EC4F1031943',
'year': 2015}
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO15%2520XUV%27 HTTP/1.1" 200 None
2026-03-29 22:03:34 [bca.uk] INFO: Saving data for PO15%20XUV: {'auction_closing_time': 1774864800.0, 'created_time': 1774706580.612616, 'last_price_update_time': 1774821814.903536}
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PO15%2520XUV') HTTP/1.1" 204 0
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456080%27 HTTP/1.1" 200 None
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456080 not downloaded yet
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142415%27 HTTP/1.1" 200 None
2026-03-29 22:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142415 not downloaded yet
2026-03-29 22:03:34 [bca.uk] INFO: Found listing with ID: SW15%20MJE
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW15%2520MJE%27 HTTP/1.1" 200 None
2026-03-29 22:03:34 [bca.uk] INFO: Scrape type for SW15%20MJE: 0
2026-03-29 22:03:34 [bca.uk] INFO: Found listing with ID: VE08%20GUX
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE08%2520GUX%27 HTTP/1.1" 200 None
2026-03-29 22:03:34 [bca.uk] INFO: Scrape type for VE08%20GUX: 0
2026-03-29 22:03:34 [bca.uk] INFO: Found listing with ID: AE06%20HAU
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE06%2520HAU%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [bca.uk] INFO: Scrape type for AE06%20HAU: 0
2026-03-29 22:03:35 [bca.uk] INFO: Found listing with ID: FX51%20CRK
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX51%2520CRK%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [bca.uk] INFO: Scrape type for FX51%20CRK: 0
2026-03-29 22:03:35 [bca.uk] INFO: Found listing with ID: KU53%20LFL
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU53%2520LFL%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [bca.uk] INFO: Scrape type for KU53%20LFL: 0
2026-03-29 22:03:35 [bca.uk] INFO: Found listing with ID: LC58%20UCT
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC58%2520UCT%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [bca.uk] INFO: Scrape type for LC58%20UCT: 0
2026-03-29 22:03:35 [bca.uk] INFO: Found listing with ID: RY56%20RNF
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY56%2520RNF%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [bca.uk] INFO: Scrape type for RY56%20RNF: 0
2026-03-29 22:03:35 [bca.uk] INFO: Found listing with ID: AP15%20JHV
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP15%2520JHV%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [bca.uk] INFO: Scrape type for AP15%20JHV: 0
2026-03-29 22:03:35 [bca.uk] INFO: Found listing with ID: DA65%20YOO
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA65%2520YOO%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [bca.uk] INFO: Scrape type for DA65%20YOO: 0
2026-03-29 22:03:35 [bca.uk] INFO: Found listing with ID: EJ15%20LVF
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ15%2520LVF%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [bca.uk] INFO: Scrape type for EJ15%20LVF: 2
2026-03-29 22:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe646fe6-f01e-5178-ac3e-7413a9f97e1c with identifier: EJ15%20LVF
2026-03-29 22:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe646fe6-f01e-5178-ac3e-7413a9f97e1c with scrape type 2
2026-03-29 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe646fe6-f01e-5178-ac3e-7413a9f97e1c with scrape type 2
2026-03-29 22:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fe646fe6-f01e-5178-ac3e-7413a9f97e1c, identifier: EJ15%20LVF
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699236704%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236704 not downloaded yet
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440290%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440290 not downloaded yet
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015382%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015382 not downloaded yet
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430196%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430196 not downloaded yet
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699437953%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437953 not downloaded yet
2026-03-29 22:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236622/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC22HUO/42806704?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=dQBCNh6w1rixkLp3DKgWlJpgfe3vccB%2F%2Fb6WAecmC7Q%3D)
2026-03-29 22:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236614/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC22HUO/42806704?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=dQBCNh6w1rixkLp3DKgWlJpgfe3vccB%2F%2Fb6WAecmC7Q%3D)
2026-03-29 22:03:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183782>
2026-03-29 22:03:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117083/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117083>
2026-03-29 22:03:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437901/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FY17UNZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fe646fe6-f01e-5178-ac3e-7413a9f97e1c with identifier: EJ15%20LVF
2026-03-29 22:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fe646fe6-f01e-5178-ac3e-7413a9f97e1c with identifier: EJ15%20LVF
2026-03-29 22:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fe646fe6-f01e-5178-ac3e-7413a9f97e1c with identifier: EJ15%20LVF to the API
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ15%20LVF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fe646fe6-f01e-5178-ac3e-7413a9f97e1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EJ15 LVF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EJ15%20LVF&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 77657,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FORD MONDEO 1.5 T E/B 160 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'T E/B 160 TITANIUM',
'vin': 'WF0EXXWPCEFE81977',
'year': 2015}
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ15%2520LVF%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [bca.uk] INFO: Saving data for EJ15%20LVF: {'auction_closing_time': 1774864800.0, 'created_time': 1774365642.674144, 'last_price_update_time': 1774821815.68099}
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EJ15%2520LVF') HTTP/1.1" 204 0
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456081%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456081 not downloaded yet
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142428%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142428 not downloaded yet
2026-03-29 22:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6352dc90>
2026-03-29 22:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_expert_report_file_ef49cdab-6725-4356-94d1-af6d2dcda08f.pdf HTTP/1.1" 201 0
2026-03-29 22:03:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d5c6f7aa-8396-5873-84ff-36f777f94cac
2026-03-29 22:03:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5c6f7aa-8396-5873-84ff-36f777f94cac, skipping ID generation
2026-03-29 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d5c6f7aa-8396-5873-84ff-36f777f94cac
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHY65YHZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HY65YHZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6373abd0>
2026-03-29 22:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE10BXU%252F699183725%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183725/600 saved to cache
2026-03-29 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95589f3c-887c-5311-a841-cf63432d8df5
2026-03-29 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63616a90>
2026-03-29 22:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FP17LPT%252F686575406%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575406/600 saved to cache
2026-03-29 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9
2026-03-29 22:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a46250>
2026-03-29 22:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP65LKN%252F699411781%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411781/600 saved to cache
2026-03-29 22:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6062366a-77b0-5b3c-aa23-49414d769971
2026-03-29 22:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437910/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437910>
2026-03-29 22:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015348/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015348>
2026-03-29 22:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430108/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430108>
2026-03-29 22:03:36 [bca.uk] INFO: Found listing with ID: FG67%20NYZ
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG67%2520NYZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [bca.uk] INFO: Scrape type for FG67%20NYZ: 0
2026-03-29 22:03:36 [bca.uk] INFO: Found listing with ID: J22%20CDN
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J22%2520CDN%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [bca.uk] INFO: Scrape type for J22%20CDN: 2
2026-03-29 22:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8eebd19-dbc9-5c5a-9094-21a11f9e6c87 with identifier: J22%20CDN
2026-03-29 22:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8eebd19-dbc9-5c5a-9094-21a11f9e6c87 with scrape type 2
2026-03-29 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8eebd19-dbc9-5c5a-9094-21a11f9e6c87 with scrape type 2
2026-03-29 22:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b8eebd19-dbc9-5c5a-9094-21a11f9e6c87, identifier: J22%20CDN
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699439155%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699439155 not downloaded yet
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015400%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015400 not downloaded yet
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430211%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430211 not downloaded yet
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699437967%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437967 not downloaded yet
2026-03-29 22:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b8eebd19-dbc9-5c5a-9094-21a11f9e6c87 with identifier: J22%20CDN
2026-03-29 22:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b8eebd19-dbc9-5c5a-9094-21a11f9e6c87 with identifier: J22%20CDN
2026-03-29 22:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b8eebd19-dbc9-5c5a-9094-21a11f9e6c87 with identifier: J22%20CDN to the API
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 172,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=J22%20CDN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b8eebd19-dbc9-5c5a-9094-21a11f9e6c87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'J22 CDN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=J22%20CDN&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MERCEDES-BENZ',
'model': 'GLA45 AMG',
'odometer': 51118,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ GLA45 AMG 2.0 (381) 4MATIC DCT Hatchback',
'transmission': 'automatic',
'trim': '(381) 4MATIC DCT',
'vin': 'WDC1569522J315417',
'year': 2016}
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J22%2520CDN%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [bca.uk] INFO: Saving data for J22%20CDN: {'auction_closing_time': 1774864800.0, 'created_time': 1774365618.327777, 'last_price_update_time': 1774821816.593568}
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='J22%2520CDN') HTTP/1.1" 204 0
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456084%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456084 not downloaded yet
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142441%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142441 not downloaded yet
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144683%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144683 not downloaded yet
2026-03-29 22:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117065/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK74VDT/42809563?sv=2020-08-04&st=2026-03-29T22%3A03%3A19Z&se=2026-03-29T22%3A28%3A19Z&sr=b&sp=r&sig=WU6pM2L1dWJi3Ejn6IWyffxUL7z8BjuTgiWJku%2FGEIo%3D)
2026-03-29 22:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440260/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK65LDD/42812399?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=Jmfc85tb0kYx50%2BURzquG39JrqJ2lb%2BDkV6aqrYcOoI%3D)
2026-03-29 22:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183748/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE10BXU/42806585?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=0HeSSm6%2FyPGHrQi9lQ%2F5I1Qis0B5ucoXD25aBf9XYJU%3D)
2026-03-29 22:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437921/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437921>
2026-03-29 22:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236629/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC22HUO/42806704?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=dQBCNh6w1rixkLp3DKgWlJpgfe3vccB%2F%2Fb6WAecmC7Q%3D)
2026-03-29 22:03:36 [bca.uk] INFO: Found listing with ID: MJ18%20VDO
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ18%2520VDO%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [bca.uk] INFO: Scrape type for MJ18%20VDO: 0
2026-03-29 22:03:36 [bca.uk] INFO: Found listing with ID: ML14%20AHZ
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML14%2520AHZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [bca.uk] INFO: Scrape type for ML14%20AHZ: 0
2026-03-29 22:03:36 [bca.uk] INFO: Found listing with ID: BV68%20CXD
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV68%2520CXD%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [bca.uk] INFO: Scrape type for BV68%20CXD: 0
2026-03-29 22:03:36 [bca.uk] INFO: Found listing with ID: NV07%20OAE
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV07%2520OAE%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [bca.uk] INFO: Scrape type for NV07%20OAE: 0
2026-03-29 22:03:36 [bca.uk] INFO: Found listing with ID: YD66%20KFF
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD66%2520KFF%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [bca.uk] INFO: Scrape type for YD66%20KFF: 2
2026-03-29 22:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c163b1cf-cc62-5193-9026-6cea3a049e80 with identifier: YD66%20KFF
2026-03-29 22:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c163b1cf-cc62-5193-9026-6cea3a049e80 with scrape type 2
2026-03-29 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c163b1cf-cc62-5193-9026-6cea3a049e80 with scrape type 2
2026-03-29 22:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c163b1cf-cc62-5193-9026-6cea3a049e80, identifier: YD66%20KFF
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440299%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440299 not downloaded yet
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015440%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015440 not downloaded yet
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430242%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430242 not downloaded yet
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699437984%27 HTTP/1.1" 200 None
2026-03-29 22:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437984 not downloaded yet
2026-03-29 22:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63653a90>
2026-03-29 22:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC22HUO%252F699236622%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236622/600 saved to cache
2026-03-29 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c45461f-b816-537d-a25b-219757224249
2026-03-29 22:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63501bd0>
2026-03-29 22:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC22HUO%252F699236614%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236614/600 saved to cache
2026-03-29 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c45461f-b816-537d-a25b-219757224249
2026-03-29 22:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183754/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE10BXU/42806585?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=0HeSSm6%2FyPGHrQi9lQ%2F5I1Qis0B5ucoXD25aBf9XYJU%3D)
2026-03-29 22:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236638/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC22HUO/42806704?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=dQBCNh6w1rixkLp3DKgWlJpgfe3vccB%2F%2Fb6WAecmC7Q%3D)
2026-03-29 22:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c163b1cf-cc62-5193-9026-6cea3a049e80 with identifier: YD66%20KFF
2026-03-29 22:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c163b1cf-cc62-5193-9026-6cea3a049e80 with identifier: YD66%20KFF
2026-03-29 22:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c163b1cf-cc62-5193-9026-6cea3a049e80 with identifier: YD66%20KFF to the API
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD66%20KFF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c163b1cf-cc62-5193-9026-6cea3a049e80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD66 KFF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD66%20KFF&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 75361,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE StationWagon',
'transmission': 'manual',
'trim': 'TD4 180 HSE',
'vin': 'SALCA2CN1HH642438',
'year': 2016}
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD66%2520KFF%27 HTTP/1.1" 200 None
2026-03-29 22:03:37 [bca.uk] INFO: Saving data for YD66%20KFF: {'auction_closing_time': 1774864800.0, 'created_time': 1774706518.595276, 'last_price_update_time': 1774821817.417212}
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD66%2520KFF') HTTP/1.1" 204 0
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456085%27 HTTP/1.1" 200 None
2026-03-29 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456085 not downloaded yet
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142458%27 HTTP/1.1" 200 None
2026-03-29 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142458 not downloaded yet
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144688%27 HTTP/1.1" 200 None
2026-03-29 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144688 not downloaded yet
2026-03-29 22:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183769/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE10BXU/42806585?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=0HeSSm6%2FyPGHrQi9lQ%2F5I1Qis0B5ucoXD25aBf9XYJU%3D)
2026-03-29 22:03:37 [bca.uk] INFO: Found listing with ID: YG66%20UPZ
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG66%2520UPZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:37 [bca.uk] INFO: Scrape type for YG66%20UPZ: 0
2026-03-29 22:03:37 [bca.uk] INFO: Found listing with ID: NA20%20MYY
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA20%2520MYY%27 HTTP/1.1" 200 None
2026-03-29 22:03:37 [bca.uk] INFO: Scrape type for NA20%20MYY: 0
2026-03-29 22:03:37 [bca.uk] INFO: Found listing with ID: NG17%20ZRR
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG17%2520ZRR%27 HTTP/1.1" 200 None
2026-03-29 22:03:37 [bca.uk] INFO: Scrape type for NG17%20ZRR: 0
2026-03-29 22:03:37 [bca.uk] INFO: Found listing with ID: NU65%20YZX
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU65%2520YZX%27 HTTP/1.1" 200 None
2026-03-29 22:03:37 [bca.uk] INFO: Scrape type for NU65%20YZX: 0
2026-03-29 22:03:37 [bca.uk] INFO: Found listing with ID: VN64%20YVX
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN64%2520YVX%27 HTTP/1.1" 200 None
2026-03-29 22:03:37 [bca.uk] INFO: Scrape type for VN64%20YVX: 0
2026-03-29 22:03:37 [bca.uk] INFO: Found listing with ID: YX18%20XUA
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX18%2520XUA%27 HTTP/1.1" 200 None
2026-03-29 22:03:37 [bca.uk] INFO: Scrape type for YX18%20XUA: 0
2026-03-29 22:03:37 [bca.uk] INFO: Found listing with ID: GJ64%20FZB
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ64%2520FZB%27 HTTP/1.1" 200 None
2026-03-29 22:03:37 [bca.uk] INFO: Scrape type for GJ64%20FZB: 2
2026-03-29 22:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca6003d0-8b9b-5f53-aa37-03ead93a3f87 with identifier: GJ64%20FZB
2026-03-29 22:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca6003d0-8b9b-5f53-aa37-03ead93a3f87 with scrape type 2
2026-03-29 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca6003d0-8b9b-5f53-aa37-03ead93a3f87 with scrape type 2
2026-03-29 22:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ca6003d0-8b9b-5f53-aa37-03ead93a3f87, identifier: GJ64%20FZB
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699439156%27 HTTP/1.1" 200 None
2026-03-29 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699439156 not downloaded yet
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015472%27 HTTP/1.1" 200 None
2026-03-29 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015472 not downloaded yet
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430268%27 HTTP/1.1" 200 None
2026-03-29 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430268 not downloaded yet
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699438012%27 HTTP/1.1" 200 None
2026-03-29 22:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699438012 not downloaded yet
2026-03-29 22:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437901/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY17UNZ/42812181?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=hFBTsS2nuxHG%2FPLDcHvb2CJWogkhUN7WPevhBflvZ2A%3D)
2026-03-29 22:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142415/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142415>
2026-03-29 22:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456080/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456080>
2026-03-29 22:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ca6003d0-8b9b-5f53-aa37-03ead93a3f87 with identifier: GJ64%20FZB
2026-03-29 22:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ca6003d0-8b9b-5f53-aa37-03ead93a3f87 with identifier: GJ64%20FZB
2026-03-29 22:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ca6003d0-8b9b-5f53-aa37-03ead93a3f87 with identifier: GJ64%20FZB to the API
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ64%20FZB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ca6003d0-8b9b-5f53-aa37-03ead93a3f87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ64 FZB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ64%20FZB&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 77626,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 TITANIUM NAVIGATOR Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM NAVIGATOR',
'vin': 'WF0KXXGCBKEM26577',
'year': 2014}
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ64%2520FZB%27 HTTP/1.1" 200 None
2026-03-29 22:03:38 [bca.uk] INFO: Saving data for GJ64%20FZB: {'auction_closing_time': 1774864800.0, 'created_time': 1774524213.359406, 'last_price_update_time': 1774821818.269234}
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ64%2520FZB') HTTP/1.1" 204 0
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456089%27 HTTP/1.1" 200 None
2026-03-29 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456089 not downloaded yet
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142482%27 HTTP/1.1" 200 None
2026-03-29 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142482 not downloaded yet
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144693%27 HTTP/1.1" 200 None
2026-03-29 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144693 not downloaded yet
2026-03-29 22:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63738c10>
2026-03-29 22:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK74VDT%252F699117065%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117065/600 saved to cache
2026-03-29 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd5918ef-16dc-5dbe-90ef-20698b6a8126
2026-03-29 22:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6164fd10>
2026-03-29 22:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK65LDD%252F699440260%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440260/600 saved to cache
2026-03-29 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1bbb7ce7-a50f-5792-918b-66476d234a65
2026-03-29 22:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611b97d0>
2026-03-29 22:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE10BXU%252F699183748%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183748/600 saved to cache
2026-03-29 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95589f3c-887c-5311-a841-cf63432d8df5
2026-03-29 22:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63546a10>
2026-03-29 22:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC22HUO%252F699236629%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236629/600 saved to cache
2026-03-29 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c45461f-b816-537d-a25b-219757224249
2026-03-29 22:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430108/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC64ULZ/42812318?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=FgK9URJPQRCwQJ0o8NKxE9CnVWlkhUweJFUTtZ6LlnY%3D)
2026-03-29 22:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015348/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX22ORL/42812368?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=4JuKCAILMz4%2BQPnM96C2XazYcd%2BQuDP%2F3FUZiLkKst4%3D)
2026-03-29 22:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE10BXU/42806585?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=0HeSSm6%2FyPGHrQi9lQ%2F5I1Qis0B5ucoXD25aBf9XYJU%3D)
2026-03-29 22:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117083/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK74VDT/42809563?sv=2020-08-04&st=2026-03-29T22%3A03%3A19Z&se=2026-03-29T22%3A28%3A19Z&sr=b&sp=r&sig=WU6pM2L1dWJi3Ejn6IWyffxUL7z8BjuTgiWJku%2FGEIo%3D)
2026-03-29 22:03:38 [bca.uk] INFO: Found listing with ID: KR65%20CKN
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR65%2520CKN%27 HTTP/1.1" 200 None
2026-03-29 22:03:38 [bca.uk] INFO: Scrape type for KR65%20CKN: 0
2026-03-29 22:03:38 [bca.uk] INFO: Found listing with ID: LD14%20UGX
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD14%2520UGX%27 HTTP/1.1" 200 None
2026-03-29 22:03:38 [bca.uk] INFO: Scrape type for LD14%20UGX: 2
2026-03-29 22:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c886d5a8-7924-5e92-b88e-1f87c5b1511a with identifier: LD14%20UGX
2026-03-29 22:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c886d5a8-7924-5e92-b88e-1f87c5b1511a with scrape type 2
2026-03-29 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c886d5a8-7924-5e92-b88e-1f87c5b1511a with scrape type 2
2026-03-29 22:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c886d5a8-7924-5e92-b88e-1f87c5b1511a, identifier: LD14%20UGX
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699440304%27 HTTP/1.1" 200 None
2026-03-29 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440304 not downloaded yet
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015504%27 HTTP/1.1" 200 None
2026-03-29 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015504 not downloaded yet
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430295%27 HTTP/1.1" 200 None
2026-03-29 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430295 not downloaded yet
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699438029%27 HTTP/1.1" 200 None
2026-03-29 22:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699438029 not downloaded yet
2026-03-29 22:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c886d5a8-7924-5e92-b88e-1f87c5b1511a with identifier: LD14%20UGX
2026-03-29 22:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c886d5a8-7924-5e92-b88e-1f87c5b1511a with identifier: LD14%20UGX
2026-03-29 22:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c886d5a8-7924-5e92-b88e-1f87c5b1511a with identifier: LD14%20UGX to the API
2026-03-29 22:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 94,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD14%20UGX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'c886d5a8-7924-5e92-b88e-1f87c5b1511a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD14 UGX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD14%20UGX&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'LEXUS',
'model': 'CT 200H',
'odometer': 55599,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'LEXUS CT 200H 1.8 ADVANCE Hatchback',
'transmission': 'automatic',
'trim': 'ADVANCE',
'vin': 'JTHKD5BHX02186128',
'year': 2014}
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD14%2520UGX%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [bca.uk] INFO: Saving data for LD14%20UGX: {'auction_closing_time': 1774864800.0, 'created_time': 1774706510.494003, 'last_price_update_time': 1774821819.14005}
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD14%2520UGX') HTTP/1.1" 204 0
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456093%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456093 not downloaded yet
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142505%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142505 not downloaded yet
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144697%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144697 not downloaded yet
2026-03-29 22:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437910/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY17UNZ/42812181?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=hFBTsS2nuxHG%2FPLDcHvb2CJWogkhUN7WPevhBflvZ2A%3D)
2026-03-29 22:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437921/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY17UNZ/42812181?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=hFBTsS2nuxHG%2FPLDcHvb2CJWogkhUN7WPevhBflvZ2A%3D)
2026-03-29 22:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437967/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437967>
2026-03-29 22:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430211/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430211>
2026-03-29 22:03:39 [bca.uk] INFO: Found listing with ID: LO13%20ZTR
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO13%2520ZTR%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [bca.uk] INFO: Scrape type for LO13%20ZTR: 0
2026-03-29 22:03:39 [bca.uk] INFO: Found listing with ID: NK63%20OGC
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK63%2520OGC%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [bca.uk] INFO: Scrape type for NK63%20OGC: 0
2026-03-29 22:03:39 [bca.uk] INFO: Found listing with ID: OV14%20WTT
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV14%2520WTT%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [bca.uk] INFO: Scrape type for OV14%20WTT: 0
2026-03-29 22:03:39 [bca.uk] INFO: Found listing with ID: SJ13%20HUH
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ13%2520HUH%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [bca.uk] INFO: Scrape type for SJ13%20HUH: 0
2026-03-29 22:03:39 [bca.uk] INFO: Found listing with ID: SN11%20HLZ
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN11%2520HLZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [bca.uk] INFO: Scrape type for SN11%20HLZ: 0
2026-03-29 22:03:39 [bca.uk] INFO: Found listing with ID: SV09%20YGZ
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV09%2520YGZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [bca.uk] INFO: Scrape type for SV09%20YGZ: 0
2026-03-29 22:03:39 [bca.uk] INFO: Found listing with ID: SY13%20GYG
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY13%2520GYG%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [bca.uk] INFO: Scrape type for SY13%20GYG: 0
2026-03-29 22:03:39 [bca.uk] INFO: Found listing with ID: FY09%20CJO
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY09%2520CJO%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [bca.uk] INFO: Scrape type for FY09%20CJO: 0
2026-03-29 22:03:39 [bca.uk] INFO: Found listing with ID: AK65%20GFO
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK65%2520GFO%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [bca.uk] INFO: Scrape type for AK65%20GFO: 0
2026-03-29 22:03:39 [bca.uk] INFO: Found listing with ID: BK12%20WRC
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK12%2520WRC%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [bca.uk] INFO: Scrape type for BK12%20WRC: 0
2026-03-29 22:03:39 [bca.uk] INFO: Found listing with ID: DT16%20AWH
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT16%2520AWH%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [bca.uk] INFO: Scrape type for DT16%20AWH: 2
2026-03-29 22:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92f1052e-2c5b-500c-801d-40376c1b4f7c with identifier: DT16%20AWH
2026-03-29 22:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92f1052e-2c5b-500c-801d-40376c1b4f7c with scrape type 2
2026-03-29 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92f1052e-2c5b-500c-801d-40376c1b4f7c with scrape type 2
2026-03-29 22:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 92f1052e-2c5b-500c-801d-40376c1b4f7c, identifier: DT16%20AWH
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699015540%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015540 not downloaded yet
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430330%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430330 not downloaded yet
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699438040%27 HTTP/1.1" 200 None
2026-03-29 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699438040 not downloaded yet
2026-03-29 22:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c4f0d0>
2026-03-29 22:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE10BXU%252F699183754%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183754/600 saved to cache
2026-03-29 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95589f3c-887c-5311-a841-cf63432d8df5
2026-03-29 22:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6362bc50>
2026-03-29 22:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC22HUO%252F699236638%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236638/600 saved to cache
2026-03-29 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c45461f-b816-537d-a25b-219757224249
2026-03-29 22:03:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614de910>
2026-03-29 22:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE10BXU%252F699183769%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183769/600 saved to cache
2026-03-29 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95589f3c-887c-5311-a841-cf63432d8df5
2026-03-29 22:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62144ad0>
2026-03-29 22:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY17UNZ%252F699437901%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437901/600 saved to cache
2026-03-29 22:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a50a9ac2-1ae6-5dea-b91f-fba078bf92af
2026-03-29 22:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144683/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144683>
2026-03-29 22:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015400/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015400>
2026-03-29 22:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439155/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699439155>
2026-03-29 22:03:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142441/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142441>
2026-03-29 22:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 92f1052e-2c5b-500c-801d-40376c1b4f7c with identifier: DT16%20AWH
2026-03-29 22:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 92f1052e-2c5b-500c-801d-40376c1b4f7c with identifier: DT16%20AWH
2026-03-29 22:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 92f1052e-2c5b-500c-801d-40376c1b4f7c with identifier: DT16%20AWH to the API
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DT16%20AWH-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 6,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '92f1052e-2c5b-500c-801d-40376c1b4f7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DT16 AWH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DT16%20AWH&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'MINI',
'model': 'CLUBMAN',
'odometer': 153775,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MINI CLUBMAN 2.0 COOPER D Estate',
'transmission': 'manual',
'trim': 'COOPER D',
'vin': 'WMWLR920902E23524',
'year': 2016}
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT16%2520AWH%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Saving data for DT16%20AWH: {'auction_closing_time': 1774864800.0, 'created_time': 1774706585.220788, 'last_price_update_time': 1774821820.029926}
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DT16%2520AWH') HTTP/1.1" 204 0
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456098%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456098 not downloaded yet
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142528%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142528 not downloaded yet
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144703%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144703 not downloaded yet
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: FV61%20BCF
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV61%2520BCF%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for FV61%20BCF: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: SE58%20SJE
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE58%2520SJE%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for SE58%20SJE: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: WJ60%20CFP
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ60%2520CFP%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for WJ60%20CFP: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: YG12%20VBZ
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG12%2520VBZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for YG12%20VBZ: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: SJ09%20OPL
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ09%2520OPL%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for SJ09%20OPL: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: SW60%20LHD
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW60%2520LHD%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for SW60%20LHD: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: VK14%20NPY
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK14%2520NPY%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for VK14%20NPY: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: WP61%20YGA
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP61%2520YGA%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for WP61%20YGA: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: YE07%20CMY
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE07%2520CMY%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for YE07%20CMY: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: YF08%20KHP
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF08%2520KHP%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for YF08%20KHP: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: YG61%20ZTR
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG61%2520ZTR%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for YG61%20ZTR: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: YH59%20CCY
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH59%2520CCY%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for YH59%20CCY: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: YH60%20WLJ
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH60%2520WLJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for YH60%20WLJ: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: YS61%20PYP
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS61%2520PYP%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for YS61%20PYP: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: EO60%20VMK
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO60%2520VMK%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for EO60%20VMK: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: FY12%20XKT
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY12%2520XKT%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for FY12%20XKT: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: KN18%20UBZ
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN18%2520UBZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for KN18%20UBZ: 0
2026-03-29 22:03:40 [bca.uk] INFO: Found listing with ID: MF12%20UUT
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF12%2520UUT%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Scrape type for MF12%20UUT: 2
2026-03-29 22:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84896659-99c4-56b4-ba12-a6ae9ed61b99 with identifier: MF12%20UUT
2026-03-29 22:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84896659-99c4-56b4-ba12-a6ae9ed61b99 with scrape type 2
2026-03-29 22:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84896659-99c4-56b4-ba12-a6ae9ed61b99 with scrape type 2
2026-03-29 22:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 84896659-99c4-56b4-ba12-a6ae9ed61b99, identifier: MF12%20UUT
2026-03-29 22:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456080/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19OFS/42810083?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=ORlwvGpwXL94ftG8FnSaSukIEGA5e2xLjQOEIZpRK9A%3D)
2026-03-29 22:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142415/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK68TLO/42810527?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=LWWZ9ibgdpr0XB%2BZxka5%2Ba4QP2LsFip8WLiRMCnKMzE%3D)
2026-03-29 22:03:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142458/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142458>
2026-03-29 22:03:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144688/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144688>
2026-03-29 22:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 84896659-99c4-56b4-ba12-a6ae9ed61b99 with identifier: MF12%20UUT
2026-03-29 22:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 84896659-99c4-56b4-ba12-a6ae9ed61b99 with identifier: MF12%20UUT
2026-03-29 22:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 84896659-99c4-56b4-ba12-a6ae9ed61b99 with identifier: MF12%20UUT to the API
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF12%20UUT-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '84896659-99c4-56b4-ba12-a6ae9ed61b99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF12 UUT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF12%20UUT&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'MERCEDES-BENZ',
'model': 'C200',
'odometer': 52266,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C200 2.1 CDI B/E SE Saloon',
'transmission': 'manual',
'trim': 'CDI B/E SE',
'vin': 'WDD2040012A676061',
'year': 2012}
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF12%2520UUT%27 HTTP/1.1" 200 None
2026-03-29 22:03:40 [bca.uk] INFO: Saving data for MF12%20UUT: {'auction_closing_time': 1774864800.0, 'created_time': 1773931056.782606, 'last_price_update_time': 1774821820.96414}
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF12%2520UUT') HTTP/1.1" 204 0
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456102%27 HTTP/1.1" 200 None
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456102 not downloaded yet
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142554%27 HTTP/1.1" 200 None
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142554 not downloaded yet
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144713%27 HTTP/1.1" 200 None
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144713 not downloaded yet
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a19150>
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC64ULZ%252F699430108%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430108/600 saved to cache
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7faeccc2-4423-53aa-a318-803e1d873f8c
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a53f50>
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX22ORL%252F699015348%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015348/600 saved to cache
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 502e65dc-018f-56cc-9774-295a6ce3b96a
2026-03-29 22:03:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61881e10>
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE10BXU%252F699183782%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183782/600 saved to cache
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95589f3c-887c-5311-a841-cf63432d8df5
2026-03-29 22:03:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632c8f50>
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK74VDT%252F699117083%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117083/600 saved to cache
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd5918ef-16dc-5dbe-90ef-20698b6a8126
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61bbd790>
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY17UNZ%252F699437910%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437910/600 saved to cache
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a50a9ac2-1ae6-5dea-b91f-fba078bf92af
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63304dd0>
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY17UNZ%252F699437921%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437921/600 saved to cache
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a50a9ac2-1ae6-5dea-b91f-fba078bf92af
2026-03-29 22:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439156/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699439156>
2026-03-29 22:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699438012/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699438012>
2026-03-29 22:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015472/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015472>
2026-03-29 22:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430268/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430268>
2026-03-29 22:03:41 [bca.uk] INFO: Found listing with ID: SB13%20MVJ
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB13%2520MVJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:41 [bca.uk] INFO: Scrape type for SB13%20MVJ: 2
2026-03-29 22:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f48a7973-53b4-56e5-9505-0366d02eb330 with identifier: SB13%20MVJ
2026-03-29 22:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f48a7973-53b4-56e5-9505-0366d02eb330 with scrape type 2
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f48a7973-53b4-56e5-9505-0366d02eb330 with scrape type 2
2026-03-29 22:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f48a7973-53b4-56e5-9505-0366d02eb330, identifier: SB13%20MVJ
2026-03-29 22:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f48a7973-53b4-56e5-9505-0366d02eb330 with identifier: SB13%20MVJ
2026-03-29 22:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f48a7973-53b4-56e5-9505-0366d02eb330 with identifier: SB13%20MVJ
2026-03-29 22:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f48a7973-53b4-56e5-9505-0366d02eb330 with identifier: SB13%20MVJ to the API
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB13%20MVJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f48a7973-53b4-56e5-9505-0366d02eb330',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB13 MVJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB13%20MVJ&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 52744,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.4 N-TEC+ Hatchback',
'transmission': 'manual',
'trim': 'N-TEC+',
'vin': 'SJNFAAE11U2205111',
'year': 2013}
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB13%2520MVJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:41 [bca.uk] INFO: Saving data for SB13%20MVJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774016039.564449, 'last_price_update_time': 1774821821.818646}
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB13%2520MVJ') HTTP/1.1" 204 0
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144723%27 HTTP/1.1" 200 None
2026-03-29 22:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144723 not downloaded yet
2026-03-29 22:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437967/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY17UNZ/42812181?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=hFBTsS2nuxHG%2FPLDcHvb2CJWogkhUN7WPevhBflvZ2A%3D)
2026-03-29 22:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430211/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC64ULZ/42812318?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=FgK9URJPQRCwQJ0o8NKxE9CnVWlkhUweJFUTtZ6LlnY%3D)
2026-03-29 22:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699438029/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699438029>
2026-03-29 22:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430295/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430295>
2026-03-29 22:03:41 [bca.uk] INFO: Found listing with ID: SB66%20VUV
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB66%2520VUV%27 HTTP/1.1" 200 None
2026-03-29 22:03:41 [bca.uk] INFO: Scrape type for SB66%20VUV: 0
2026-03-29 22:03:41 [bca.uk] INFO: Found listing with ID: SH11%20YDW
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH11%2520YDW%27 HTTP/1.1" 200 None
2026-03-29 22:03:41 [bca.uk] INFO: Scrape type for SH11%20YDW: 0
2026-03-29 22:03:41 [bca.uk] INFO: Found listing with ID: SH60%20LDZ
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH60%2520LDZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:41 [bca.uk] INFO: Scrape type for SH60%20LDZ: 0
2026-03-29 22:03:41 [bca.uk] INFO: Found listing with ID: SK63%20FLJ
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK63%2520FLJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:41 [bca.uk] INFO: Scrape type for SK63%20FLJ: 0
2026-03-29 22:03:41 [bca.uk] INFO: Found listing with ID: SL13%20PTX
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL13%2520PTX%27 HTTP/1.1" 200 None
2026-03-29 22:03:41 [bca.uk] INFO: Scrape type for SL13%20PTX: 0
2026-03-29 22:03:41 [bca.uk] INFO: Found listing with ID: SP63%20WOR
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP63%2520WOR%27 HTTP/1.1" 200 None
2026-03-29 22:03:41 [bca.uk] INFO: Scrape type for SP63%20WOR: 0
2026-03-29 22:03:41 [bca.uk] INFO: Found listing with ID: VA67%20MVC
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA67%2520MVC%27 HTTP/1.1" 200 None
2026-03-29 22:03:41 [bca.uk] INFO: Scrape type for VA67%20MVC: 0
2026-03-29 22:03:41 [bca.uk] INFO: Found listing with ID: EJ14%20VWN
2026-03-29 22:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ14%2520VWN%27 HTTP/1.1" 200 None
2026-03-29 22:03:42 [bca.uk] INFO: Scrape type for EJ14%20VWN: 0
2026-03-29 22:03:42 [bca.uk] INFO: Found listing with ID: SL68%20YWR
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL68%2520YWR%27 HTTP/1.1" 200 None
2026-03-29 22:03:42 [bca.uk] INFO: Scrape type for SL68%20YWR: 0
2026-03-29 22:03:42 [bca.uk] INFO: Found listing with ID: MJ61%20CYK
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ61%2520CYK%27 HTTP/1.1" 200 None
2026-03-29 22:03:42 [bca.uk] INFO: Scrape type for MJ61%20CYK: 0
2026-03-29 22:03:42 [bca.uk] INFO: Found listing with ID: OE60%20WYJ
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE60%2520WYJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:42 [bca.uk] INFO: Scrape type for OE60%20WYJ: 0
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618de8d0>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19OFS%252F699456080%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456080/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0c90534-4dbe-5982-85b5-b9b714d55606
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618dee90>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK68TLO%252F699142415%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142415/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f9f2c24-88ea-52eb-8933-488e5868efc1
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015400/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX22ORL/42812368?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=4JuKCAILMz4%2BQPnM96C2XazYcd%2BQuDP%2F3FUZiLkKst4%3D)
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144683/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65YHZ/42811357?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=1baiIOWHbM%2F4%2BVRoR2beDOige2RqCphS0OiGBDMOKRw%3D)
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142441/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK68TLO/42810527?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=LWWZ9ibgdpr0XB%2BZxka5%2Ba4QP2LsFip8WLiRMCnKMzE%3D)
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144730%27 HTTP/1.1" 200 None
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144730 not downloaded yet
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144740%27 HTTP/1.1" 200 None
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144740 not downloaded yet
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439155/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK65LDD/42812399?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=Jmfc85tb0kYx50%2BURzquG39JrqJ2lb%2BDkV6aqrYcOoI%3D)
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61628490>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY17UNZ%252F699437967%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437967/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a50a9ac2-1ae6-5dea-b91f-fba078bf92af
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61864190>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC64ULZ%252F699430211%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430211/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7faeccc2-4423-53aa-a318-803e1d873f8c
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144688/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65YHZ/42811357?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=1baiIOWHbM%2F4%2BVRoR2beDOige2RqCphS0OiGBDMOKRw%3D)
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144703/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144703>
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142528/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142528>
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699438012/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY17UNZ/42812181?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=hFBTsS2nuxHG%2FPLDcHvb2CJWogkhUN7WPevhBflvZ2A%3D)
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015472/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX22ORL/42812368?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=4JuKCAILMz4%2BQPnM96C2XazYcd%2BQuDP%2F3FUZiLkKst4%3D)
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430268/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC64ULZ/42812318?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=FgK9URJPQRCwQJ0o8NKxE9CnVWlkhUweJFUTtZ6LlnY%3D)
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618dbe90>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX22ORL%252F699015400%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015400/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 502e65dc-018f-56cc-9774-295a6ce3b96a
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6192b850>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65YHZ%252F699144683%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144683/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d5c6f7aa-8396-5873-84ff-36f777f94cac
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6214a3d0>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK68TLO%252F699142441%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142441/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f9f2c24-88ea-52eb-8933-488e5868efc1
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142458/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK68TLO/42810527?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=LWWZ9ibgdpr0XB%2BZxka5%2Ba4QP2LsFip8WLiRMCnKMzE%3D)
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144713/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144713>
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430295/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC64ULZ/42812318?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=FgK9URJPQRCwQJ0o8NKxE9CnVWlkhUweJFUTtZ6LlnY%3D)
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699438029/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY17UNZ/42812181?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=hFBTsS2nuxHG%2FPLDcHvb2CJWogkhUN7WPevhBflvZ2A%3D)
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439156/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK65LDD/42812399?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=Jmfc85tb0kYx50%2BURzquG39JrqJ2lb%2BDkV6aqrYcOoI%3D)
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61929510>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK65LDD%252F699439155%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439155/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1bbb7ce7-a50f-5792-918b-66476d234a65
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63331c50>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65YHZ%252F699144688%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144688/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d5c6f7aa-8396-5873-84ff-36f777f94cac
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61705f90>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY17UNZ%252F699438012%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699438012/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a50a9ac2-1ae6-5dea-b91f-fba078bf92af
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6194f810>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX22ORL%252F699015472%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015472/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 502e65dc-018f-56cc-9774-295a6ce3b96a
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61750fd0>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC64ULZ%252F699430268%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430268/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7faeccc2-4423-53aa-a318-803e1d873f8c
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144723/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144723>
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456102/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456102>
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142554/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142554>
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144740/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144740>
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456098/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456098>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6332ad50>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK68TLO%252F699142458%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142458/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f9f2c24-88ea-52eb-8933-488e5868efc1
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621f1c50>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC64ULZ%252F699430295%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430295/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7faeccc2-4423-53aa-a318-803e1d873f8c
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618eded0>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY17UNZ%252F699438029%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699438029/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a50a9ac2-1ae6-5dea-b91f-fba078bf92af
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621a1c90>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK65LDD%252F699439156%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439156/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1bbb7ce7-a50f-5792-918b-66476d234a65
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144703/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65YHZ/42811357?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=1baiIOWHbM%2F4%2BVRoR2beDOige2RqCphS0OiGBDMOKRw%3D)
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144730/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144730>
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430330/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430330>
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699438040/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699438040>
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144697/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144697>
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015540>
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142528/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK68TLO/42810527?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=LWWZ9ibgdpr0XB%2BZxka5%2Ba4QP2LsFip8WLiRMCnKMzE%3D)
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144713/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65YHZ/42811357?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=1baiIOWHbM%2F4%2BVRoR2beDOige2RqCphS0OiGBDMOKRw%3D)
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144723/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65YHZ/42811357?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=1baiIOWHbM%2F4%2BVRoR2beDOige2RqCphS0OiGBDMOKRw%3D)
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142505/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142505>
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015504/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015504>
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456093/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456093>
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456102/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19OFS/42810083?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=ORlwvGpwXL94ftG8FnSaSukIEGA5e2xLjQOEIZpRK9A%3D)
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456098/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19OFS/42810083?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=ORlwvGpwXL94ftG8FnSaSukIEGA5e2xLjQOEIZpRK9A%3D)
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144740/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65YHZ/42811357?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=1baiIOWHbM%2F4%2BVRoR2beDOige2RqCphS0OiGBDMOKRw%3D)
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142554/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK68TLO/42810527?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=LWWZ9ibgdpr0XB%2BZxka5%2Ba4QP2LsFip8WLiRMCnKMzE%3D)
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61988710>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65YHZ%252F699144703%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144703/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d5c6f7aa-8396-5873-84ff-36f777f94cac
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144697/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65YHZ/42811357?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=1baiIOWHbM%2F4%2BVRoR2beDOige2RqCphS0OiGBDMOKRw%3D)
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430330/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC64ULZ/42812318?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=FgK9URJPQRCwQJ0o8NKxE9CnVWlkhUweJFUTtZ6LlnY%3D)
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6156b650>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK68TLO%252F699142528%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142528/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f9f2c24-88ea-52eb-8933-488e5868efc1
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac684a7f10>
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65YHZ%252F699144713%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144713/600 saved to cache
2026-03-29 22:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d5c6f7aa-8396-5873-84ff-36f777f94cac
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699438040/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY17UNZ/42812181?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=hFBTsS2nuxHG%2FPLDcHvb2CJWogkhUN7WPevhBflvZ2A%3D)
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440304/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440304>
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144730/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65YHZ/42811357?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=1baiIOWHbM%2F4%2BVRoR2beDOige2RqCphS0OiGBDMOKRw%3D)
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144693/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144693>
2026-03-29 22:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142482/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142482>
2026-03-29 22:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456093/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19OFS/42810083?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=ORlwvGpwXL94ftG8FnSaSukIEGA5e2xLjQOEIZpRK9A%3D)
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61752490>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65YHZ%252F699144723%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144723/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d5c6f7aa-8396-5873-84ff-36f777f94cac
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61595e50>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19OFS%252F699456102%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456102/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0c90534-4dbe-5982-85b5-b9b714d55606
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6214bc50>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19OFS%252F699456098%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456098/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0c90534-4dbe-5982-85b5-b9b714d55606
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61afcb90>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65YHZ%252F699144740%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144740/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d5c6f7aa-8396-5873-84ff-36f777f94cac
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61964f90>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK68TLO%252F699142554%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142554/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f9f2c24-88ea-52eb-8933-488e5868efc1
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430242/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430242>
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456085/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456085>
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437984/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437984>
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456089/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456089>
2026-03-29 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142505/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK68TLO/42810527?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=LWWZ9ibgdpr0XB%2BZxka5%2Ba4QP2LsFip8WLiRMCnKMzE%3D)
2026-03-29 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015540/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX22ORL/42812368?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=4JuKCAILMz4%2BQPnM96C2XazYcd%2BQuDP%2F3FUZiLkKst4%3D)
2026-03-29 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015504/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX22ORL/42812368?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=4JuKCAILMz4%2BQPnM96C2XazYcd%2BQuDP%2F3FUZiLkKst4%3D)
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620b99d0>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65YHZ%252F699144697%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144697/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d5c6f7aa-8396-5873-84ff-36f777f94cac
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615553d0>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC64ULZ%252F699430330%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430330/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7faeccc2-4423-53aa-a318-803e1d873f8c
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637a3b50>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY17UNZ%252F699438040%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699438040/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a50a9ac2-1ae6-5dea-b91f-fba078bf92af
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6218e790>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65YHZ%252F699144730%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144730/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d5c6f7aa-8396-5873-84ff-36f777f94cac
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637a0b50>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19OFS%252F699456093%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456093/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0c90534-4dbe-5982-85b5-b9b714d55606
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015440/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015440>
2026-03-29 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144693/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65YHZ/42811357?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=1baiIOWHbM%2F4%2BVRoR2beDOige2RqCphS0OiGBDMOKRw%3D)
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440299/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440299>
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456084/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456084>
2026-03-29 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142482/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK68TLO/42810527?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=LWWZ9ibgdpr0XB%2BZxka5%2Ba4QP2LsFip8WLiRMCnKMzE%3D)
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63632550>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK68TLO%252F699142505%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142505/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f9f2c24-88ea-52eb-8933-488e5868efc1
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6151aed0>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX22ORL%252F699015540%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015540/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 502e65dc-018f-56cc-9774-295a6ce3b96a
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61757bd0>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX22ORL%252F699015504%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015504/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 502e65dc-018f-56cc-9774-295a6ce3b96a
2026-03-29 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440304/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK65LDD/42812399?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=Jmfc85tb0kYx50%2BURzquG39JrqJ2lb%2BDkV6aqrYcOoI%3D)
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142428/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142428>
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144678/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HY65YHZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456085/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19OFS/42810083?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=ORlwvGpwXL94ftG8FnSaSukIEGA5e2xLjQOEIZpRK9A%3D)
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456081/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456081>
2026-03-29 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437984/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY17UNZ/42812181?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=hFBTsS2nuxHG%2FPLDcHvb2CJWogkhUN7WPevhBflvZ2A%3D)
2026-03-29 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456089/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19OFS/42810083?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=ORlwvGpwXL94ftG8FnSaSukIEGA5e2xLjQOEIZpRK9A%3D)
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618f4650>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65YHZ%252F699144693%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144693/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d5c6f7aa-8396-5873-84ff-36f777f94cac
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610b5ed0>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK68TLO%252F699142482%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142482/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f9f2c24-88ea-52eb-8933-488e5868efc1
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015382/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015382>
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430196/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430196>
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437953/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437953>
2026-03-29 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430242/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC64ULZ/42812318?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=FgK9URJPQRCwQJ0o8NKxE9CnVWlkhUweJFUTtZ6LlnY%3D)
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6193dc90>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK65LDD%252F699440304%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440304/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1bbb7ce7-a50f-5792-918b-66476d234a65
2026-03-29 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440299/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK65LDD/42812399?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=Jmfc85tb0kYx50%2BURzquG39JrqJ2lb%2BDkV6aqrYcOoI%3D)
2026-03-29 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456084/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19OFS/42810083?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=ORlwvGpwXL94ftG8FnSaSukIEGA5e2xLjQOEIZpRK9A%3D)
2026-03-29 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144678/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HY65YHZ/42811357?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=1baiIOWHbM%2F4%2BVRoR2beDOige2RqCphS0OiGBDMOKRw%3D)
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440290/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440290>
2026-03-29 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015440/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX22ORL/42812368?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=4JuKCAILMz4%2BQPnM96C2XazYcd%2BQuDP%2F3FUZiLkKst4%3D)
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61bbf510>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19OFS%252F699456085%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456085/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0c90534-4dbe-5982-85b5-b9b714d55606
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61754910>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY17UNZ%252F699437984%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437984/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a50a9ac2-1ae6-5dea-b91f-fba078bf92af
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6197e910>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19OFS%252F699456089%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456089/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0c90534-4dbe-5982-85b5-b9b714d55606
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236704/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236704>
2026-03-29 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142428/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK68TLO/42810527?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=LWWZ9ibgdpr0XB%2BZxka5%2Ba4QP2LsFip8WLiRMCnKMzE%3D)
2026-03-29 22:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456081/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19OFS/42810083?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=ORlwvGpwXL94ftG8FnSaSukIEGA5e2xLjQOEIZpRK9A%3D)
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437939/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699437939>
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430173/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430173>
2026-03-29 22:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015367/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015367>
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6211cd90>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC64ULZ%252F699430242%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430242/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7faeccc2-4423-53aa-a318-803e1d873f8c
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617068d0>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK65LDD%252F699440299%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440299/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1bbb7ce7-a50f-5792-918b-66476d234a65
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618fdc90>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19OFS%252F699456084%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456084/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0c90534-4dbe-5982-85b5-b9b714d55606
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61604f90>
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHY65YHZ%252F699144678%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144678/600 saved to cache
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5c6f7aa-8396-5873-84ff-36f777f94cac
2026-03-29 22:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5c6f7aa-8396-5873-84ff-36f777f94cac, skipping ID generation
2026-03-29 22:03:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5c6f7aa-8396-5873-84ff-36f777f94cac sending to next pipeline
2026-03-29 22:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d5c6f7aa-8396-5873-84ff-36f777f94cac, identifier: HY65%20YHZ
2026-03-29 22:03:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62196fd0>
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX22ORL%252F699015440%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015440/600 saved to cache
2026-03-29 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 502e65dc-018f-56cc-9774-295a6ce3b96a
2026-03-29 22:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d5c6f7aa-8396-5873-84ff-36f777f94cac with identifier: HY65%20YHZ
2026-03-29 22:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d5c6f7aa-8396-5873-84ff-36f777f94cac with identifier: HY65%20YHZ
2026-03-29 22:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d5c6f7aa-8396-5873-84ff-36f777f94cac with identifier: HY65%20YHZ to the API
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144678/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_expert_report_file_ef49cdab-6725-4356-94d1-af6d2dcda08f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY65%20YHZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd5c6f7aa-8396-5873-84ff-36f777f94cac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY65 YHZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HY65%20YHZ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MAZDA',
'model': 'CX-5',
'odometer': 81102,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49220,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144678/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46019,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144683/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46385,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144688/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47973,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144693/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46469,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144697/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43483,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144703/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78116,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144713/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70246,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144723/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90828,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144730/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5c6f7aa-8396-5873-84ff-36f777f94cac/d5c6f7aa-8396-5873-84ff-36f777f94cac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73211,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HY65YHZ/699144740/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MAZDA CX-5 2.2 D 150 SPORT 2WD StationWagon',
'transmission': 'manual',
'trim': 'D 150 SPORT 2WD',
'vin': 'JMZKEF91600436121',
'year': 2015}
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY65%2520YHZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:44 [bca.uk] INFO: Saving data for HY65%20YHZ: {'created_time': 1774821824.725539, 'last_price_update_time': 1774821824.725552, 'auction_closing_time': 1774951200.0}
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HY65%2520YHZ') HTTP/1.1" 204 0
2026-03-29 22:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437953/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY17UNZ/42812181?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=hFBTsS2nuxHG%2FPLDcHvb2CJWogkhUN7WPevhBflvZ2A%3D)
2026-03-29 22:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430196/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC64ULZ/42812318?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=FgK9URJPQRCwQJ0o8NKxE9CnVWlkhUweJFUTtZ6LlnY%3D)
2026-03-29 22:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015382/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX22ORL/42812368?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=4JuKCAILMz4%2BQPnM96C2XazYcd%2BQuDP%2F3FUZiLkKst4%3D)
2026-03-29 22:03:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439154/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699439154>
2026-03-29 22:03:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236687/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236687>
2026-03-29 22:03:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183818/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183818>
2026-03-29 22:03:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456077/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456077>
2026-03-29 22:03:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142394/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142394>
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac633053d0>
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK68TLO%252F699142428%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142428/600 saved to cache
2026-03-29 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f9f2c24-88ea-52eb-8933-488e5868efc1
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61665e10>
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19OFS%252F699456081%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456081/600 saved to cache
2026-03-29 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0c90534-4dbe-5982-85b5-b9b714d55606
2026-03-29 22:03:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117096/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117096>
2026-03-29 22:03:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015357/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699015357>
2026-03-29 22:03:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430149/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430149>
2026-03-29 22:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437939/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY17UNZ/42812181?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=hFBTsS2nuxHG%2FPLDcHvb2CJWogkhUN7WPevhBflvZ2A%3D)
2026-03-29 22:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236704/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC22HUO/42806704?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=dQBCNh6w1rixkLp3DKgWlJpgfe3vccB%2F%2Fb6WAecmC7Q%3D)
2026-03-29 22:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430173/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC64ULZ/42812318?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=FgK9URJPQRCwQJ0o8NKxE9CnVWlkhUweJFUTtZ6LlnY%3D)
2026-03-29 22:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015367/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX22ORL/42812368?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=4JuKCAILMz4%2BQPnM96C2XazYcd%2BQuDP%2F3FUZiLkKst4%3D)
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621dc2d0>
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY17UNZ%252F699437953%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437953/600 saved to cache
2026-03-29 22:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a50a9ac2-1ae6-5dea-b91f-fba078bf92af
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636311d0>
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC64ULZ%252F699430196%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430196/600 saved to cache
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7faeccc2-4423-53aa-a318-803e1d873f8c
2026-03-29 22:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440290/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK65LDD/42812399?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=Jmfc85tb0kYx50%2BURzquG39JrqJ2lb%2BDkV6aqrYcOoI%3D)
2026-03-29 22:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456077/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19OFS/42810083?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=ORlwvGpwXL94ftG8FnSaSukIEGA5e2xLjQOEIZpRK9A%3D)
2026-03-29 22:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236673/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236673>
2026-03-29 22:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440280/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440280>
2026-03-29 22:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183818/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE10BXU/42806585?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=0HeSSm6%2FyPGHrQi9lQ%2F5I1Qis0B5ucoXD25aBf9XYJU%3D)
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61543cd0>
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX22ORL%252F699015382%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015382/600 saved to cache
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 502e65dc-018f-56cc-9774-295a6ce3b96a
2026-03-29 22:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236687/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC22HUO/42806704?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=dQBCNh6w1rixkLp3DKgWlJpgfe3vccB%2F%2Fb6WAecmC7Q%3D)
2026-03-29 22:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439154/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK65LDD/42812399?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=Jmfc85tb0kYx50%2BURzquG39JrqJ2lb%2BDkV6aqrYcOoI%3D)
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63339110>
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY17UNZ%252F699437939%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437939/600 saved to cache
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a50a9ac2-1ae6-5dea-b91f-fba078bf92af
2026-03-29 22:03:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a50a9ac2-1ae6-5dea-b91f-fba078bf92af, skipping ID generation
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a50a9ac2-1ae6-5dea-b91f-fba078bf92af sending to next pipeline
2026-03-29 22:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a50a9ac2-1ae6-5dea-b91f-fba078bf92af, identifier: FY17%20UNZ
2026-03-29 22:03:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63304f50>
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC22HUO%252F699236704%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236704/600 saved to cache
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c45461f-b816-537d-a25b-219757224249
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63328c50>
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC64ULZ%252F699430173%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430173/600 saved to cache
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7faeccc2-4423-53aa-a318-803e1d873f8c
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6193ccd0>
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX22ORL%252F699015367%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015367/600 saved to cache
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 502e65dc-018f-56cc-9774-295a6ce3b96a
2026-03-29 22:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a50a9ac2-1ae6-5dea-b91f-fba078bf92af with identifier: FY17%20UNZ
2026-03-29 22:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a50a9ac2-1ae6-5dea-b91f-fba078bf92af with identifier: FY17%20UNZ
2026-03-29 22:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a50a9ac2-1ae6-5dea-b91f-fba078bf92af with identifier: FY17%20UNZ to the API
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437939/600>
{'auction_title': '',
'c_o_2_emission_value': 88,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_expert_report_file_80a522ba-56d6-474a-929d-08f702c43202.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY17%20UNZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'a50a9ac2-1ae6-5dea-b91f-fba078bf92af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY17 UNZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FY17%20UNZ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'KIA',
'model': 'NIRO',
'odometer': 93217,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41498,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437901/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40033,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437910/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43365,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437921/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44339,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437939/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35995,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437953/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34341,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437967/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95767,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699437984/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94371,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699438012/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101196,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699438029/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a50a9ac2-1ae6-5dea-b91f-fba078bf92af/a50a9ac2-1ae6-5dea-b91f-fba078bf92af_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73700,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY17UNZ/699438040/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'KIA NIRO 1.6 GDI HYBRID 2 DCT Hatchback',
'transmission': 'automatic',
'trim': 'GDI HYBRID 2 DCT',
'vin': 'KNACC81CVH5062689',
'year': 2017}
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY17%2520UNZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:45 [bca.uk] INFO: Saving data for FY17%20UNZ: {'created_time': 1774821825.681048, 'last_price_update_time': 1774821825.681059, 'auction_closing_time': 1774951200.0}
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FY17%2520UNZ') HTTP/1.1" 204 0
2026-03-29 22:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142394/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK68TLO/42810527?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=LWWZ9ibgdpr0XB%2BZxka5%2Ba4QP2LsFip8WLiRMCnKMzE%3D)
2026-03-29 22:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430149/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC64ULZ/42812318?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=FgK9URJPQRCwQJ0o8NKxE9CnVWlkhUweJFUTtZ6LlnY%3D)
2026-03-29 22:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015357/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX22ORL/42812368?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=4JuKCAILMz4%2BQPnM96C2XazYcd%2BQuDP%2F3FUZiLkKst4%3D)
2026-03-29 22:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456075/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OW19OFS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183799/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183799>
2026-03-29 22:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142373/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BK68TLO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117089/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117089>
2026-03-29 22:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117096/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK74VDT/42809563?sv=2020-08-04&st=2026-03-29T22%3A03%3A19Z&se=2026-03-29T22%3A28%3A19Z&sr=b&sp=r&sig=WU6pM2L1dWJi3Ejn6IWyffxUL7z8BjuTgiWJku%2FGEIo%3D)
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621dd610>
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK65LDD%252F699440290%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440290/600 saved to cache
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1bbb7ce7-a50f-5792-918b-66476d234a65
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619698d0>
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19OFS%252F699456077%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456077/600 saved to cache
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0c90534-4dbe-5982-85b5-b9b714d55606
2026-03-29 22:03:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac622592d0>
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE10BXU%252F699183818%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183818/600 saved to cache
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 95589f3c-887c-5311-a841-cf63432d8df5
2026-03-29 22:03:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac612002d0>
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC22HUO%252F699236687%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236687/600 saved to cache
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c45461f-b816-537d-a25b-219757224249
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6196ab90>
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK65LDD%252F699439154%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439154/600 saved to cache
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1bbb7ce7-a50f-5792-918b-66476d234a65
2026-03-29 22:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439153/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699439153>
2026-03-29 22:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236658/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236658>
2026-03-29 22:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236673/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC22HUO/42806704?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=dQBCNh6w1rixkLp3DKgWlJpgfe3vccB%2F%2Fb6WAecmC7Q%3D)
2026-03-29 22:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015344/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FX22ORL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430099/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YC64ULZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440280/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK65LDD/42812399?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=Jmfc85tb0kYx50%2BURzquG39JrqJ2lb%2BDkV6aqrYcOoI%3D)
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6191ab50>
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK68TLO%252F699142394%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142394/600 saved to cache
2026-03-29 22:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f9f2c24-88ea-52eb-8933-488e5868efc1
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac76f19890>
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC64ULZ%252F699430149%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430149/600 saved to cache
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7faeccc2-4423-53aa-a318-803e1d873f8c
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620eee10>
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX22ORL%252F699015357%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015357/600 saved to cache
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 502e65dc-018f-56cc-9774-295a6ce3b96a
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621d3550>
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK74VDT%252F699117096%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117096/600 saved to cache
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd5918ef-16dc-5dbe-90ef-20698b6a8126
2026-03-29 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440270/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699440270>
2026-03-29 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236645/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699236645>
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618db890>
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC22HUO%252F699236673%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236673/600 saved to cache
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c45461f-b816-537d-a25b-219757224249
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61667990>
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK65LDD%252F699440280%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440280/600 saved to cache
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1bbb7ce7-a50f-5792-918b-66476d234a65
2026-03-29 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456075/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19OFS/42810083?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=ORlwvGpwXL94ftG8FnSaSukIEGA5e2xLjQOEIZpRK9A%3D)
2026-03-29 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183741/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183741>
2026-03-29 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117075/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117075>
2026-03-29 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117070/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117070>
2026-03-29 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117089/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK74VDT/42809563?sv=2020-08-04&st=2026-03-29T22%3A03%3A19Z&se=2026-03-29T22%3A28%3A19Z&sr=b&sp=r&sig=WU6pM2L1dWJi3Ejn6IWyffxUL7z8BjuTgiWJku%2FGEIo%3D)
2026-03-29 22:03:46 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:03:46 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117063/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117063>
2026-03-29 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183799/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE10BXU/42806585?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=0HeSSm6%2FyPGHrQi9lQ%2F5I1Qis0B5ucoXD25aBf9XYJU%3D)
2026-03-29 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142373/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK68TLO/42810527?sv=2020-08-04&st=2026-03-29T22%3A03%3A23Z&se=2026-03-29T22%3A28%3A23Z&sr=b&sp=r&sig=LWWZ9ibgdpr0XB%2BZxka5%2Ba4QP2LsFip8WLiRMCnKMzE%3D)
2026-03-29 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183735/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183735>
2026-03-29 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430099/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC64ULZ/42812318?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=FgK9URJPQRCwQJ0o8NKxE9CnVWlkhUweJFUTtZ6LlnY%3D)
2026-03-29 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117059/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117059>
2026-03-29 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440270/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK65LDD/42812399?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=Jmfc85tb0kYx50%2BURzquG39JrqJ2lb%2BDkV6aqrYcOoI%3D)
2026-03-29 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015344/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX22ORL/42812368?sv=2020-08-04&st=2026-03-29T22%3A03%3A22Z&se=2026-03-29T22%3A28%3A22Z&sr=b&sp=r&sig=4JuKCAILMz4%2BQPnM96C2XazYcd%2BQuDP%2F3FUZiLkKst4%3D)
2026-03-29 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439153/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LK65LDD/42812399?sv=2020-08-04&st=2026-03-29T22%3A03%3A21Z&se=2026-03-29T22%3A28%3A21Z&sr=b&sp=r&sig=Jmfc85tb0kYx50%2BURzquG39JrqJ2lb%2BDkV6aqrYcOoI%3D)
2026-03-29 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236645/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC22HUO/42806704?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=dQBCNh6w1rixkLp3DKgWlJpgfe3vccB%2F%2Fb6WAecmC7Q%3D)
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61864c10>
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19OFS%252F699456075%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456075/600 saved to cache
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0c90534-4dbe-5982-85b5-b9b714d55606
2026-03-29 22:03:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0c90534-4dbe-5982-85b5-b9b714d55606, skipping ID generation
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0c90534-4dbe-5982-85b5-b9b714d55606 sending to next pipeline
2026-03-29 22:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a0c90534-4dbe-5982-85b5-b9b714d55606, identifier: OW19%20OFS
2026-03-29 22:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a0c90534-4dbe-5982-85b5-b9b714d55606 with identifier: OW19%20OFS
2026-03-29 22:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a0c90534-4dbe-5982-85b5-b9b714d55606 with identifier: OW19%20OFS
2026-03-29 22:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a0c90534-4dbe-5982-85b5-b9b714d55606 with identifier: OW19%20OFS to the API
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456075/600>
{'auction_title': '',
'c_o_2_emission_value': 170,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_expert_report_file_99626854-f759-408e-9c4a-3cb32beb0a39.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OW19%20OFS-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a0c90534-4dbe-5982-85b5-b9b714d55606',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OW19 OFS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OW19%20OFS&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 61053,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41317,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456075/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40086,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456077/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37989,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456080/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37925,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456081/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37017,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456084/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36706,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456085/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82818,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456089/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70593,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456093/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77711,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456098/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c90534-4dbe-5982-85b5-b9b714d55606/a0c90534-4dbe-5982-85b5-b9b714d55606_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68764,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19OFS/699456102/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 LANDMARK StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 LANDMARK',
'vin': 'SALCA2AN4KH826721',
'year': 2019}
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW19%2520OFS%27 HTTP/1.1" 200 None
2026-03-29 22:03:46 [bca.uk] INFO: Saving data for OW19%20OFS: {'created_time': 1774821826.788885, 'last_price_update_time': 1774821826.788896, 'auction_closing_time': 1775037600.0}
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OW19%2520OFS') HTTP/1.1" 204 0
2026-03-29 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117070/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK74VDT/42809563?sv=2020-08-04&st=2026-03-29T22%3A03%3A19Z&se=2026-03-29T22%3A28%3A19Z&sr=b&sp=r&sig=WU6pM2L1dWJi3Ejn6IWyffxUL7z8BjuTgiWJku%2FGEIo%3D)
2026-03-29 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183741/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE10BXU/42806585?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=0HeSSm6%2FyPGHrQi9lQ%2F5I1Qis0B5ucoXD25aBf9XYJU%3D)
2026-03-29 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117063/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK74VDT/42809563?sv=2020-08-04&st=2026-03-29T22%3A03%3A19Z&se=2026-03-29T22%3A28%3A19Z&sr=b&sp=r&sig=WU6pM2L1dWJi3Ejn6IWyffxUL7z8BjuTgiWJku%2FGEIo%3D)
2026-03-29 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236609/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DC22HUO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183729/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183729>
2026-03-29 22:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117057/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699117057>
2026-03-29 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236658/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC22HUO/42806704?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=dQBCNh6w1rixkLp3DKgWlJpgfe3vccB%2F%2Fb6WAecmC7Q%3D)
2026-03-29 22:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117075/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK74VDT/42809563?sv=2020-08-04&st=2026-03-29T22%3A03%3A19Z&se=2026-03-29T22%3A28%3A19Z&sr=b&sp=r&sig=WU6pM2L1dWJi3Ejn6IWyffxUL7z8BjuTgiWJku%2FGEIo%3D)
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62149010>
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK74VDT%252F699117089%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117089/600 saved to cache
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd5918ef-16dc-5dbe-90ef-20698b6a8126
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61799250>
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE10BXU%252F699183799%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183799/600 saved to cache
2026-03-29 22:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95589f3c-887c-5311-a841-cf63432d8df5
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621f2650>
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK68TLO%252F699142373%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142373/600 saved to cache
2026-03-29 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f9f2c24-88ea-52eb-8933-488e5868efc1
2026-03-29 22:03:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f9f2c24-88ea-52eb-8933-488e5868efc1, skipping ID generation
2026-03-29 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f9f2c24-88ea-52eb-8933-488e5868efc1 sending to next pipeline
2026-03-29 22:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9f9f2c24-88ea-52eb-8933-488e5868efc1, identifier: BK68%20TLO
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621f21d0>
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC64ULZ%252F699430099%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430099/600 saved to cache
2026-03-29 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7faeccc2-4423-53aa-a318-803e1d873f8c
2026-03-29 22:03:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7faeccc2-4423-53aa-a318-803e1d873f8c, skipping ID generation
2026-03-29 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7faeccc2-4423-53aa-a318-803e1d873f8c sending to next pipeline
2026-03-29 22:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7faeccc2-4423-53aa-a318-803e1d873f8c, identifier: YC64%20ULZ
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6173fe90>
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK65LDD%252F699440270%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440270/600 saved to cache
2026-03-29 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1bbb7ce7-a50f-5792-918b-66476d234a65
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6362af10>
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX22ORL%252F699015344%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015344/600 saved to cache
2026-03-29 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 502e65dc-018f-56cc-9774-295a6ce3b96a
2026-03-29 22:03:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 502e65dc-018f-56cc-9774-295a6ce3b96a, skipping ID generation
2026-03-29 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 502e65dc-018f-56cc-9774-295a6ce3b96a sending to next pipeline
2026-03-29 22:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 502e65dc-018f-56cc-9774-295a6ce3b96a, identifier: FX22%20ORL
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6219e2d0>
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLK65LDD%252F699439153%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439153/600 saved to cache
2026-03-29 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1bbb7ce7-a50f-5792-918b-66476d234a65
2026-03-29 22:03:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1bbb7ce7-a50f-5792-918b-66476d234a65, skipping ID generation
2026-03-29 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1bbb7ce7-a50f-5792-918b-66476d234a65 sending to next pipeline
2026-03-29 22:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1bbb7ce7-a50f-5792-918b-66476d234a65, identifier: LK65%20LDD
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6118cc90>
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC22HUO%252F699236645%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236645/600 saved to cache
2026-03-29 22:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c45461f-b816-537d-a25b-219757224249
2026-03-29 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117059/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK74VDT/42809563?sv=2020-08-04&st=2026-03-29T22%3A03%3A19Z&se=2026-03-29T22%3A28%3A19Z&sr=b&sp=r&sig=WU6pM2L1dWJi3Ejn6IWyffxUL7z8BjuTgiWJku%2FGEIo%3D)
2026-03-29 22:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183735/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE10BXU/42806585?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=0HeSSm6%2FyPGHrQi9lQ%2F5I1Qis0B5ucoXD25aBf9XYJU%3D)
2026-03-29 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406305/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406305>
2026-03-29 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117052/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HK74VDT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX24YZN/42810399?sv=2020-08-04&st=2026-03-29T22%3A03%3A46Z&se=2026-03-29T22%3A28%3A46Z&sr=b&sp=r&sig=8e9SBxRll69R6BfeEYHqMucX3PZJ0l%2BWAH9PpY%2B%2Bjlo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RX24%20YZN-GB>
2026-03-29 22:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040182/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040182>
2026-03-29 22:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9f9f2c24-88ea-52eb-8933-488e5868efc1 with identifier: BK68%20TLO
2026-03-29 22:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9f9f2c24-88ea-52eb-8933-488e5868efc1 with identifier: BK68%20TLO
2026-03-29 22:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9f9f2c24-88ea-52eb-8933-488e5868efc1 with identifier: BK68%20TLO to the API
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142373/600>
{'auction_title': '',
'c_o_2_emission_value': 170,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_expert_report_file_e74967d0-7805-4600-a315-d8bd76c43d35.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BK68%20TLO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9f9f2c24-88ea-52eb-8933-488e5868efc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BK68 TLO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BK68%20TLO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 60895,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48994,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142373/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45297,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142394/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43395,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142415/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45566,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142428/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45542,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142441/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41819,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142458/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77884,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142482/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61254,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142505/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72587,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142528/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f2c24-88ea-52eb-8933-488e5868efc1/9f9f2c24-88ea-52eb-8933-488e5868efc1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61806,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK68TLO/699142554/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 LANDMARK StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 LANDMARK',
'vin': 'SALCA2AN2KH792665',
'year': 2018}
2026-03-29 22:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK68%2520TLO%27 HTTP/1.1" 200 None
2026-03-29 22:03:48 [bca.uk] INFO: Saving data for BK68%20TLO: {'created_time': 1774821828.006432, 'last_price_update_time': 1774821828.006451, 'auction_closing_time': 1775037600.0}
2026-03-29 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BK68%2520TLO') HTTP/1.1" 204 0
2026-03-29 22:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7faeccc2-4423-53aa-a318-803e1d873f8c with identifier: YC64%20ULZ
2026-03-29 22:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7faeccc2-4423-53aa-a318-803e1d873f8c with identifier: YC64%20ULZ
2026-03-29 22:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7faeccc2-4423-53aa-a318-803e1d873f8c with identifier: YC64%20ULZ to the API
2026-03-29 22:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430099/600>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_expert_report_file_bc279b69-1a99-472c-9a6a-bad3c77436a0.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC64%20ULZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7faeccc2-4423-53aa-a318-803e1d873f8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC64 ULZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC64%20ULZ&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BMW',
'model': 'X5',
'odometer': 116434,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38528,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430099/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38413,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430108/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36710,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430149/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36450,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430173/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32125,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430196/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32222,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430211/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80136,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430242/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77015,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430268/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84928,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430295/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faeccc2-4423-53aa-a318-803e1d873f8c/7faeccc2-4423-53aa-a318-803e1d873f8c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68516,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC64ULZ/699430330/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'BMW X5 3.0 XDRIVE 30D M SPORT (7S) StationWagon',
'transmission': 'manual',
'trim': 'XDRIVE 30D M SPORT (7S)',
'vin': 'WBAKS420200J45786',
'year': 2014}
2026-03-29 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC64%2520ULZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:48 [bca.uk] INFO: Saving data for YC64%20ULZ: {'created_time': 1774821828.415969, 'last_price_update_time': 1774821828.415982, 'auction_closing_time': 1774951200.0}
2026-03-29 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC64%2520ULZ') HTTP/1.1" 204 0
2026-03-29 22:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 502e65dc-018f-56cc-9774-295a6ce3b96a with identifier: FX22%20ORL
2026-03-29 22:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 502e65dc-018f-56cc-9774-295a6ce3b96a with identifier: FX22%20ORL
2026-03-29 22:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 502e65dc-018f-56cc-9774-295a6ce3b96a with identifier: FX22%20ORL to the API
2026-03-29 22:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015344/600>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_expert_report_file_a7ddbeb2-c251-4aa9-9a66-2a5c2cca681b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FX22%20ORL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '502e65dc-018f-56cc-9774-295a6ce3b96a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FX22 ORL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FX22%20ORL&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'C220 D',
'odometer': 16656,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50631,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015344/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45944,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015348/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46339,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015357/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49353,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015367/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42675,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015382/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41037,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015400/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85293,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015440/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82442,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015472/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89785,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015504/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502e65dc-018f-56cc-9774-295a6ce3b96a/502e65dc-018f-56cc-9774-295a6ce3b96a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79265,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX22ORL/699015540/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C220 D 2.0 AMG LINE PREMIUM PLUS 9G Estate',
'transmission': 'manual',
'trim': 'AMG LINE PREMIUM PLUS 9G',
'vin': 'W1K2062042F043020',
'year': 2022}
2026-03-29 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX22%2520ORL%27 HTTP/1.1" 200 None
2026-03-29 22:03:48 [bca.uk] INFO: Saving data for FX22%20ORL: {'created_time': 1774821828.815553, 'last_price_update_time': 1774821828.815563, 'auction_closing_time': 1774951200.0}
2026-03-29 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FX22%2520ORL') HTTP/1.1" 204 0
2026-03-29 22:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1bbb7ce7-a50f-5792-918b-66476d234a65 with identifier: LK65%20LDD
2026-03-29 22:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1bbb7ce7-a50f-5792-918b-66476d234a65 with identifier: LK65%20LDD
2026-03-29 22:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1bbb7ce7-a50f-5792-918b-66476d234a65 with identifier: LK65%20LDD to the API
2026-03-29 22:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439153/600>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_expert_report_file_1bdb7e8d-81b8-4b60-9f3d-85c971aadbda.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LK65%20LDD-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1bbb7ce7-a50f-5792-918b-66476d234a65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LK65 LDD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LK65%20LDD&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 87623,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47975,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440260/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46852,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440270/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191466,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439153/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47189,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440280/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183941,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439154/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58304,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440290/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198482,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439155/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54581,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440299/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166149,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699439156/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bbb7ce7-a50f-5792-918b-66476d234a65/1bbb7ce7-a50f-5792-918b-66476d234a65_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54191,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LK65LDD/699440304/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 70 EXCITE Hatchback',
'transmission': 'manual',
'trim': '70 EXCITE',
'vin': 'W0L0XEP68F4293816',
'year': 2015}
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK65%2520LDD%27 HTTP/1.1" 200 None
2026-03-29 22:03:49 [bca.uk] INFO: Saving data for LK65%20LDD: {'created_time': 1774821829.197139, 'last_price_update_time': 1774821829.19715, 'auction_closing_time': 1774951200.0}
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LK65%2520LDD') HTTP/1.1" 204 0
2026-03-29 22:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117057/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK74VDT/42809563?sv=2020-08-04&st=2026-03-29T22%3A03%3A19Z&se=2026-03-29T22%3A28%3A19Z&sr=b&sp=r&sig=WU6pM2L1dWJi3Ejn6IWyffxUL7z8BjuTgiWJku%2FGEIo%3D)
2026-03-29 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV13MWG/42809444?sv=2020-08-04&st=2026-03-29T22%3A03%3A47Z&se=2026-03-29T22%3A28%3A47Z&sr=b&sp=r&sig=ez2ghwDEfe5r9Au1DGHEHNI79cn1%2F7NorIDKWocec04%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV13%20MWG-GB>
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac697ee790>
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK74VDT%252F699117070%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117070/600 saved to cache
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd5918ef-16dc-5dbe-90ef-20698b6a8126
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69bf04d0>
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE10BXU%252F699183741%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183741/600 saved to cache
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95589f3c-887c-5311-a841-cf63432d8df5
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620bae10>
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK74VDT%252F699117063%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117063/600 saved to cache
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd5918ef-16dc-5dbe-90ef-20698b6a8126
2026-03-29 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618ada10>
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC22HUO%252F699236658%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236658/600 saved to cache
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c45461f-b816-537d-a25b-219757224249
2026-03-29 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621fc210>
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK74VDT%252F699117075%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117075/600 saved to cache
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd5918ef-16dc-5dbe-90ef-20698b6a8126
2026-03-29 22:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236609/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC22HUO/42806704?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=dQBCNh6w1rixkLp3DKgWlJpgfe3vccB%2F%2Fb6WAecmC7Q%3D)
2026-03-29 22:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183729/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE10BXU/42806585?sv=2020-08-04&st=2026-03-29T22%3A03%3A20Z&se=2026-03-29T22%3A28%3A20Z&sr=b&sp=r&sig=0HeSSm6%2FyPGHrQi9lQ%2F5I1Qis0B5ucoXD25aBf9XYJU%3D)
2026-03-29 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251954/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699251954>
2026-03-29 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435156/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435156>
2026-03-29 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212542/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699212542>
2026-03-29 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239936/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699239936>
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61703690>
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK74VDT%252F699117059%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117059/600 saved to cache
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd5918ef-16dc-5dbe-90ef-20698b6a8126
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632eec90>
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE10BXU%252F699183735%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183735/600 saved to cache
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95589f3c-887c-5311-a841-cf63432d8df5
2026-03-29 22:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040182/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70YYW/42571204?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=3YETERDVJsfcYf9zoGQQnS8MvGAFRjTT6qcrLaHjjZg%3D)
2026-03-29 22:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409251/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409251>
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614e3bd0>
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK74VDT%252F699117057%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117057/600 saved to cache
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd5918ef-16dc-5dbe-90ef-20698b6a8126
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621348d0>
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC22HUO%252F699236609%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236609/600 saved to cache
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c45461f-b816-537d-a25b-219757224249
2026-03-29 22:03:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c45461f-b816-537d-a25b-219757224249, skipping ID generation
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c45461f-b816-537d-a25b-219757224249 sending to next pipeline
2026-03-29 22:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6c45461f-b816-537d-a25b-219757224249, identifier: DC22%20HUO
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61700d50>
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE10BXU%252F699183729%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183729/600 saved to cache
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95589f3c-887c-5311-a841-cf63432d8df5
2026-03-29 22:03:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95589f3c-887c-5311-a841-cf63432d8df5, skipping ID generation
2026-03-29 22:03:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95589f3c-887c-5311-a841-cf63432d8df5 sending to next pipeline
2026-03-29 22:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 95589f3c-887c-5311-a841-cf63432d8df5, identifier: OE10%20BXU
2026-03-29 22:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6c45461f-b816-537d-a25b-219757224249 with identifier: DC22%20HUO
2026-03-29 22:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6c45461f-b816-537d-a25b-219757224249 with identifier: DC22%20HUO
2026-03-29 22:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6c45461f-b816-537d-a25b-219757224249 with identifier: DC22%20HUO to the API
2026-03-29 22:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236609/600>
{'auction_title': '',
'c_o_2_emission_value': 183,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_expert_report_file_01cb4cc3-87a7-4ca2-b152-6bdfe944d6c9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DC22%20HUO-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6c45461f-b816-537d-a25b-219757224249',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DC22 HUO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DC22%20HUO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLVO',
'model': 'XC60',
'odometer': 33064,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42462,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236609/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42841,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236614/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43915,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236622/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44107,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236629/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38527,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236638/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36697,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236645/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88083,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236658/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63526,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236673/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79945,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236687/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45461f-b816-537d-a25b-219757224249/6c45461f-b816-537d-a25b-219757224249_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58097,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC22HUO/699236704/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'VOLVO XC60 2.0 B5P AWD INSCRIPTION G/T StationWagon',
'transmission': 'automatic',
'trim': 'B5P AWD INSCRIPTION G/T',
'vin': 'YV1UZL1VCN1072894',
'year': 2022}
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC22%2520HUO%27 HTTP/1.1" 200 None
2026-03-29 22:03:50 [bca.uk] INFO: Saving data for DC22%20HUO: {'created_time': 1774821830.233567, 'last_price_update_time': 1774821830.233578, 'auction_closing_time': 1775124000.0}
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DC22%2520HUO') HTTP/1.1" 204 0
2026-03-29 22:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 95589f3c-887c-5311-a841-cf63432d8df5 with identifier: OE10%20BXU
2026-03-29 22:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 95589f3c-887c-5311-a841-cf63432d8df5 with identifier: OE10%20BXU
2026-03-29 22:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 95589f3c-887c-5311-a841-cf63432d8df5 with identifier: OE10%20BXU to the API
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183729/600>
{'auction_title': '',
'c_o_2_emission_value': 189,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_expert_report_file_fc945a10-52c0-4a5e-8caf-6a7bd5a7f7d7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OE10%20BXU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': '95589f3c-887c-5311-a841-cf63432d8df5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OE10 BXU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OE10%20BXU&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'JAGUAR',
'model': 'XJ SERIES LWB',
'odometer': 102952,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42269,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183725/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41969,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183729/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36469,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183735/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37501,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183741/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34233,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183748/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34700,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183754/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87093,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183769/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86472,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183782/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86393,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183799/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95589f3c-887c-5311-a841-cf63432d8df5/95589f3c-887c-5311-a841-cf63432d8df5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78948,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE10BXU/699183818/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'JAGUAR XJ SERIES LWB 3.0 D V6 275 PORTFOLIO Saloon',
'transmission': 'automatic',
'trim': 'D V6 275 PORTFOLIO',
'vin': 'SAJAC2621ANV03686',
'year': 2010}
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE10%2520BXU%27 HTTP/1.1" 200 None
2026-03-29 22:03:50 [bca.uk] INFO: Saving data for OE10%20BXU: {'created_time': 1774821830.623404, 'last_price_update_time': 1774821830.623415, 'auction_closing_time': 1775210400.0}
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OE10%2520BXU') HTTP/1.1" 204 0
2026-03-29 22:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117052/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK74VDT/42809563?sv=2020-08-04&st=2026-03-29T22%3A03%3A19Z&se=2026-03-29T22%3A28%3A19Z&sr=b&sp=r&sig=WU6pM2L1dWJi3Ejn6IWyffxUL7z8BjuTgiWJku%2FGEIo%3D)
2026-03-29 22:03:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411597/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411597>
2026-03-29 22:03:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430292/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430292>
2026-03-29 22:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239936/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KD15FPU/42809529?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=fvJF7ucpRX0E%2BAJp%2BX9CWPAyJRKbO%2FRJwWNOYDHIzAs%3D)
2026-03-29 22:03:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430241/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430241>
2026-03-29 22:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406305/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LA70NPE/42811995?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=1ymICcEKrtpKHFHLQTc1yKaMMeniIFUDVOMDF5neyAs%3D)
2026-03-29 22:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV13MWG/42809444?sv=2020-08-04&st=2026-03-29T22%3A03%3A47Z&se=2026-03-29T22%3A28%3A47Z&sr=b&sp=r&sig=ez2ghwDEfe5r9Au1DGHEHNI79cn1%2F7NorIDKWocec04%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX24YZN/42810399?sv=2020-08-04&st=2026-03-29T22%3A03%3A46Z&se=2026-03-29T22%3A28%3A46Z&sr=b&sp=r&sig=8e9SBxRll69R6BfeEYHqMucX3PZJ0l%2BWAH9PpY%2B%2Bjlo%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6360c0d0>
2026-03-29 22:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70YYW%252F699040182%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040182/600 saved to cache
2026-03-29 22:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01b57636-ffd9-585f-9b00-e6ae7dbcc329
2026-03-29 22:03:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575390>
2026-03-29 22:03:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427838/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427838>
2026-03-29 22:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251954/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MC14KAE/42809755?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=DG6b3zLT1DRX51p27qxjR95H%2BdTJAJxRv%2B3BMmM%2BaS4%3D)
2026-03-29 22:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212542/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL11KPY/42783241?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=Q5R98DxLk%2FIyOrHb6oSyVq%2Bq9sVfHG45AhfvPKzaek4%3D)
2026-03-29 22:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632f3f50>
2026-03-29 22:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK74VDT%252F699117052%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117052/600 saved to cache
2026-03-29 22:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd5918ef-16dc-5dbe-90ef-20698b6a8126
2026-03-29 22:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd5918ef-16dc-5dbe-90ef-20698b6a8126, skipping ID generation
2026-03-29 22:03:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd5918ef-16dc-5dbe-90ef-20698b6a8126 sending to next pipeline
2026-03-29 22:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dd5918ef-16dc-5dbe-90ef-20698b6a8126, identifier: HK74%20VDT
2026-03-29 22:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dd5918ef-16dc-5dbe-90ef-20698b6a8126 with identifier: HK74%20VDT
2026-03-29 22:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dd5918ef-16dc-5dbe-90ef-20698b6a8126 with identifier: HK74%20VDT
2026-03-29 22:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dd5918ef-16dc-5dbe-90ef-20698b6a8126 with identifier: HK74%20VDT to the API
2026-03-29 22:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117052/600>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_expert_report_file_7f23d172-db57-4f13-895e-21ec8e9946e8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK74%20VDT-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dd5918ef-16dc-5dbe-90ef-20698b6a8126',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK74 VDT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK74%20VDT&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'A180',
'odometer': 15414,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50752,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117052/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46173,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117057/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47083,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117059/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51116,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117063/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44287,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117065/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41128,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117070/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78623,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117075/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82881,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117083/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95270,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117089/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd5918ef-16dc-5dbe-90ef-20698b6a8126/dd5918ef-16dc-5dbe-90ef-20698b6a8126_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK74VDT/699117096/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A180 1.3 AMG LINE PREMIUM PLUS DCT Hatchback',
'transmission': 'automatic',
'trim': 'AMG LINE PREMIUM PLUS DCT',
'vin': 'W1K3F8EB9SV212430',
'year': 2024}
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK74%2520VDT%27 HTTP/1.1" 200 None
2026-03-29 22:03:51 [bca.uk] INFO: Saving data for HK74%20VDT: {'created_time': 1774821831.252249, 'last_price_update_time': 1774821831.25226, 'auction_closing_time': 1775124000.0}
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK74%2520VDT') HTTP/1.1" 204 0
2026-03-29 22:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409251/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE18CHX/42812000?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=oyBRp8qHoowbCW9kieY0zUV46IZNjY3FwR8NKuxfaxo%3D)
2026-03-29 22:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427899/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427899>
2026-03-29 22:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430241/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA16ETX/42812131?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=67cSoD7yDAcPlVUXb6MtFxB8b%2F%2B%2FHPzK%2FRcqJHz%2FIwo%3D)
2026-03-29 22:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435156/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS68PYY/42812178?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=ilxdzGsr4IgRZDvqZmWhurm4pGkLnzxS3s4veY%2BdCjs%3D)
2026-03-29 22:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411824/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411824>
2026-03-29 22:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699415062/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699415062>
2026-03-29 22:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411597/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE19AAK/42812078?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=MkdK1ykhsLQ%2B%2F2n1Irxn7evFumHYKKFZXmkQdpd8KgM%3D)
2026-03-29 22:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430292/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19VSX/42812111?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=qlSeQUbf83xHqWfD9mYZ2SCAALVwdddlxYHgmUNU2tY%3D)
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6996fc50>
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKD15FPU%252F699239936%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239936/600 saved to cache
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62261050>
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLA70NPE%252F699406305%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406305/600 saved to cache
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4838ed0-a1bc-555f-ae17-73d79e29d1ac
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62151c10>
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_expert_report_file_0526dcd4-f15c-4457-9de7-7b2ac4d97226.pdf HTTP/1.1" 201 0
2026-03-29 22:03:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9da815d0-0890-5d46-9004-81239b502fc3
2026-03-29 22:03:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9da815d0-0890-5d46-9004-81239b502fc3, skipping ID generation
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9da815d0-0890-5d46-9004-81239b502fc3
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHV13MWG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HV13MWG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6195aad0>
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_expert_report_file_75757f6d-e5d6-4343-96e7-c2dd648b2cf1.pdf HTTP/1.1" 201 0
2026-03-29 22:03:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9edc33d7-192a-5fcd-8823-b4e8eb0a8391
2026-03-29 22:03:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9edc33d7-192a-5fcd-8823-b4e8eb0a8391, skipping ID generation
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9edc33d7-192a-5fcd-8823-b4e8eb0a8391
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRX24YZN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RX24YZN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6198f890>
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMC14KAE%252F699251954%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251954/600 saved to cache
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97c5232d-22c9-5728-b6fd-84d8da4f8949
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63632310>
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL11KPY%252F699212542%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212542/600 saved to cache
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c
2026-03-29 22:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040160/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040160>
2026-03-29 22:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406392/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406392>
2026-03-29 22:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411770/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411770>
2026-03-29 22:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409286/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409286>
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188876%27 HTTP/1.1" 200 None
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188876 not downloaded yet
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699135189%27 HTTP/1.1" 200 None
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135189 not downloaded yet
2026-03-29 22:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427838/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE20EVL/42811999?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=QNaGwsE1HTKndyV7dS5jfLI1ozyFJBkYcrsiWmkuv8k%3D)
2026-03-29 22:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575390/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/P17LPT/42573216?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Cei94j6xTuVsYVAtMEIEaOIhWn8jpASCTY7XqjpVl64%3D)
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61541990>
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE18CHX%252F699409251%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409251/600 saved to cache
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62131590>
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA16ETX%252F699430241%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430241/600 saved to cache
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6398c60-fe63-5a45-a148-79cf4bf62bcf
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611cb890>
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS68PYY%252F699435156%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435156/600 saved to cache
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617247d0>
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE19AAK%252F699411597%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411597/600 saved to cache
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff522792-d041-5ecb-b231-8bf72c190c1e
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611c9590>
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19VSX%252F699430292%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430292/600 saved to cache
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 732664ff-2041-53f2-83f7-e4a6aeaa1df2
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188882%27 HTTP/1.1" 200 None
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188882 not downloaded yet
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699135203%27 HTTP/1.1" 200 None
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135203 not downloaded yet
2026-03-29 22:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406287/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406287>
2026-03-29 22:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699415062/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ72FOT/42812096?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=F1eqEFipUoySPGKOeLKkFyyLLItl9dJbMFy96XQcSRY%3D)
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188892%27 HTTP/1.1" 200 None
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188892 not downloaded yet
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699135228%27 HTTP/1.1" 200 None
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135228 not downloaded yet
2026-03-29 22:03:51 [bca.uk] INFO: Total items found: 100
2026-03-29 22:03:51 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded
2026-03-29 22:03:51 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:03:51 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61650b10>
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE20EVL%252F699427838%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427838/600 saved to cache
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b145ed4d-e096-5329-b7ec-7396067fba60
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b5ed0>
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FP17LPT%252F686575390%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575390/600 saved to cache
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9
2026-03-29 22:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251950/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MC14KAE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SL11KPY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239903/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KD15FPU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FHZ1603/42805791?sv=2020-08-04&st=2026-03-29T22%3A03%3A51Z&se=2026-03-29T22%3A28%3A51Z&sr=b&sp=r&sig=Qo7fOtclp9X7inziZuofC2kPLk5w0PoXJfJGKaWDDkM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FHZ%201603-GB>
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188899%27 HTTP/1.1" 200 None
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188899 not downloaded yet
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699135245%27 HTTP/1.1" 200 None
2026-03-29 22:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135245 not downloaded yet
2026-03-29 22:03:51 [bca.uk] INFO: Found listing with ID: SG60%20RXA
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG60%2520RXA%27 HTTP/1.1" 200 None
2026-03-29 22:03:51 [bca.uk] INFO: Scrape type for SG60%20RXA: 0
2026-03-29 22:03:51 [bca.uk] INFO: Found listing with ID: LB57%20JJE
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB57%2520JJE%27 HTTP/1.1" 200 None
2026-03-29 22:03:51 [bca.uk] INFO: Scrape type for LB57%20JJE: 0
2026-03-29 22:03:51 [bca.uk] INFO: Found listing with ID: EA58%20FEF
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA58%2520FEF%27 HTTP/1.1" 200 None
2026-03-29 22:03:51 [bca.uk] INFO: Scrape type for EA58%20FEF: 0
2026-03-29 22:03:51 [bca.uk] INFO: Found listing with ID: HV58%20YJY
2026-03-29 22:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV58%2520YJY%27 HTTP/1.1" 200 None
2026-03-29 22:03:52 [bca.uk] INFO: Scrape type for HV58%20YJY: 2
2026-03-29 22:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b64f21f-1ee3-5237-8105-b88b835030a8 with identifier: HV58%20YJY
2026-03-29 22:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b64f21f-1ee3-5237-8105-b88b835030a8 with scrape type 2
2026-03-29 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b64f21f-1ee3-5237-8105-b88b835030a8 with scrape type 2
2026-03-29 22:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8b64f21f-1ee3-5237-8105-b88b835030a8, identifier: HV58%20YJY
2026-03-29 22:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427899/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19VXX/42812304?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=YzGWBhkemG5tXMwAwvYpsWX0bEfwiTWFoG%2FIuzQzr2c%3D)
2026-03-29 22:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411824/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML23KNX/42812081?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Ysjf2AWU3A%2B%2BhkZ4EdoIgPpKhCyN1a54UPjPwLBr1pc%3D)
2026-03-29 22:03:52 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:03:52 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8b64f21f-1ee3-5237-8105-b88b835030a8 with identifier: HV58%20YJY
2026-03-29 22:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8b64f21f-1ee3-5237-8105-b88b835030a8 with identifier: HV58%20YJY
2026-03-29 22:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8b64f21f-1ee3-5237-8105-b88b835030a8 with identifier: HV58%20YJY to the API
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV58%20YJY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8b64f21f-1ee3-5237-8105-b88b835030a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV58 YJY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV58%20YJY&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'PEUGEOT',
'model': '308',
'odometer': 85128,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.6 VTI S Hatchback',
'transmission': 'automatic',
'trim': 'VTI S',
'vin': 'VF34C5FWF55353066',
'year': 2008}
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV58%2520YJY%27 HTTP/1.1" 200 None
2026-03-29 22:03:52 [bca.uk] INFO: Saving data for HV58%20YJY: {'auction_closing_time': 1774864800.0, 'created_time': 1774706565.581135, 'last_price_update_time': 1774821832.566456}
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV58%2520YJY') HTTP/1.1" 204 0
2026-03-29 22:03:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435146/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435146>
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188907%27 HTTP/1.1" 200 None
2026-03-29 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188907 not downloaded yet
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699135260%27 HTTP/1.1" 200 None
2026-03-29 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135260 not downloaded yet
2026-03-29 22:03:52 [bca.uk] INFO: Found listing with ID: AM09%20AHK
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AM09%2520AHK%27 HTTP/1.1" 200 None
2026-03-29 22:03:52 [bca.uk] INFO: Scrape type for AM09%20AHK: 0
2026-03-29 22:03:52 [bca.uk] INFO: Found listing with ID: FT63%20VNN
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT63%2520VNN%27 HTTP/1.1" 200 None
2026-03-29 22:03:52 [bca.uk] INFO: Scrape type for FT63%20VNN: 0
2026-03-29 22:03:52 [bca.uk] INFO: Found listing with ID: GU12%20UYL
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU12%2520UYL%27 HTTP/1.1" 200 None
2026-03-29 22:03:52 [bca.uk] INFO: Scrape type for GU12%20UYL: 0
2026-03-29 22:03:52 [bca.uk] INFO: Found listing with ID: KO15%20JZW
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO15%2520JZW%27 HTTP/1.1" 200 None
2026-03-29 22:03:52 [bca.uk] INFO: Scrape type for KO15%20JZW: 2
2026-03-29 22:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cdb5790-795c-503b-b01e-2ccf288a1773 with identifier: KO15%20JZW
2026-03-29 22:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cdb5790-795c-503b-b01e-2ccf288a1773 with scrape type 2
2026-03-29 22:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cdb5790-795c-503b-b01e-2ccf288a1773 with scrape type 2
2026-03-29 22:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7cdb5790-795c-503b-b01e-2ccf288a1773, identifier: KO15%20JZW
2026-03-29 22:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040160/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70YYW/42571204?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=3YETERDVJsfcYf9zoGQQnS8MvGAFRjTT6qcrLaHjjZg%3D)
2026-03-29 22:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411770/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP65LKN/42812099?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=YYiddic%2BqcqY2M0XPOfW0%2FrAPtac9opCHs6%2B5ikpuFw%3D)
2026-03-29 22:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135170/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RX24YZN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409286/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PA19DCO/42811984?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=5dad8F2568bHOl2s5RwggeSpVONMrl6yr8ByaoDJDOc%3D)
2026-03-29 22:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7cdb5790-795c-503b-b01e-2ccf288a1773 with identifier: KO15%20JZW
2026-03-29 22:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7cdb5790-795c-503b-b01e-2ccf288a1773 with identifier: KO15%20JZW
2026-03-29 22:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7cdb5790-795c-503b-b01e-2ccf288a1773 with identifier: KO15%20JZW to the API
2026-03-29 22:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 97,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KO15%20JZW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7cdb5790-795c-503b-b01e-2ccf288a1773',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KO15 JZW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KO15%20JZW&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 133263,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 CDTI 110 E/F TECH LINE Hatchback',
'transmission': 'manual',
'trim': 'CDTI 110 E/F TECH LINE',
'vin': 'W0LPD6E68FG144090',
'year': 2015}
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO15%2520JZW%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Saving data for KO15%20JZW: {'auction_closing_time': 1774864800.0, 'created_time': 1774706533.733515, 'last_price_update_time': 1774821833.263477}
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KO15%2520JZW') HTTP/1.1" 204 0
2026-03-29 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61580b50>
2026-03-29 22:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ72FOT%252F699415062%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699415062/600 saved to cache
2026-03-29 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a
2026-03-29 22:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188866/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HV13MWG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409230/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409230>
2026-03-29 22:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406392/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG69FWY/42811982?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=iIU0ZFwxCrfo9iR2T7l%2BEKiHBXHpV%2FjhvFuNPQMcBwU%3D)
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188920%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188920 not downloaded yet
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699135279%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135279 not downloaded yet
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: LL58%20VHF
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL58%2520VHF%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for LL58%20VHF: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: VK15%20FJO
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK15%2520FJO%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for VK15%20FJO: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: GV68%20ULZ
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV68%2520ULZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for GV68%20ULZ: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: ET67%20ZTJ
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET67%2520ZTJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for ET67%20ZTJ: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: EY64%20EXD
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY64%2520EXD%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for EY64%20EXD: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: GT18%20AWT
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GT18%2520AWT%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for GT18%20AWT: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: LM10%20MWN
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM10%2520MWN%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for LM10%20MWN: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: NJ66%20WFT
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ66%2520WFT%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for NJ66%20WFT: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: GU08%20JYS
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU08%2520JYS%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for GU08%20JYS: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: GX08%20LUH
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX08%2520LUH%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for GX08%20LUH: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: LR57%20XYT
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR57%2520XYT%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for LR57%20XYT: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: LV59%20HND
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV59%2520HND%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for LV59%20HND: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: NJ16%20VNL
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ16%2520VNL%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for NJ16%20VNL: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: YT66%20UER
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT66%2520UER%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for YT66%20UER: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: EA14%20UBC
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA14%2520UBC%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for EA14%20UBC: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: EY66%20UZM
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY66%2520UZM%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for EY66%20UZM: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: MT63%20OKS
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT63%2520OKS%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for MT63%20OKS: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: SH64%20GEY
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH64%2520GEY%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for SH64%20GEY: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: SP10%20OWU
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP10%2520OWU%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for SP10%20OWU: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: SP13%20OYM
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP13%2520OYM%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for SP13%20OYM: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: ST61%20AZU
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST61%2520AZU%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for ST61%20AZU: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: SY11%20OZW
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY11%2520OZW%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for SY11%20OZW: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: SY60%20MFJ
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY60%2520MFJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for SY60%20MFJ: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: SY61%20MXG
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY61%2520MXG%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for SY61%20MXG: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: WD22%20CCF
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD22%2520CCF%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for WD22%20CCF: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: AG59%20RKO
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AG59%2520RKO%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for AG59%20RKO: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: AK58%20DZJ
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK58%2520DZJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for AK58%20DZJ: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: EJ10%20YOL
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ10%2520YOL%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for EJ10%20YOL: 0
2026-03-29 22:03:53 [bca.uk] INFO: Found listing with ID: KE15%20VGG
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE15%2520VGG%27 HTTP/1.1" 200 None
2026-03-29 22:03:53 [bca.uk] INFO: Scrape type for KE15%20VGG: 2
2026-03-29 22:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e08ebb9-5776-5621-9c06-f20c01de4014 with identifier: KE15%20VGG
2026-03-29 22:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e08ebb9-5776-5621-9c06-f20c01de4014 with scrape type 2
2026-03-29 22:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e08ebb9-5776-5621-9c06-f20c01de4014 with scrape type 2
2026-03-29 22:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5e08ebb9-5776-5621-9c06-f20c01de4014, identifier: KE15%20VGG
2026-03-29 22:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5e08ebb9-5776-5621-9c06-f20c01de4014 with identifier: KE15%20VGG
2026-03-29 22:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5e08ebb9-5776-5621-9c06-f20c01de4014 with identifier: KE15%20VGG
2026-03-29 22:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5e08ebb9-5776-5621-9c06-f20c01de4014 with identifier: KE15%20VGG to the API
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KE15%20VGG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5e08ebb9-5776-5621-9c06-f20c01de4014',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KE15 VGG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KE15%20VGG&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'MAZDA',
'model': '3',
'odometer': 131237,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MAZDA 3 2.0 SPORT Hatchback',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'JMZBM646611302773',
'year': 2015}
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE15%2520VGG%27 HTTP/1.1" 200 None
2026-03-29 22:03:54 [bca.uk] INFO: Saving data for KE15%20VGG: {'auction_closing_time': 1774864800.0, 'created_time': 1774044491.637369, 'last_price_update_time': 1774821834.285312}
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KE15%2520VGG') HTTP/1.1" 204 0
2026-03-29 22:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL11KPY/42783241?sv=2020-08-04&st=2026-03-29T22%3A01%3A00Z&se=2026-03-29T22%3A26%3A00Z&sr=b&sp=r&sig=Q5R98DxLk%2FIyOrHb6oSyVq%2Bq9sVfHG45AhfvPKzaek4%3D)
2026-03-29 22:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239903/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KD15FPU/42809529?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=fvJF7ucpRX0E%2BAJp%2BX9CWPAyJRKbO%2FRJwWNOYDHIzAs%3D)
2026-03-29 22:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135203/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135203>
2026-03-29 22:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406287/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LA70NPE/42811995?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=1ymICcEKrtpKHFHLQTc1yKaMMeniIFUDVOMDF5neyAs%3D)
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188934%27 HTTP/1.1" 200 None
2026-03-29 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188934 not downloaded yet
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699135292%27 HTTP/1.1" 200 None
2026-03-29 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135292 not downloaded yet
2026-03-29 22:03:54 [bca.uk] INFO: Found listing with ID: KG56%20YPR
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KG56%2520YPR%27 HTTP/1.1" 200 None
2026-03-29 22:03:54 [bca.uk] INFO: Scrape type for KG56%20YPR: 0
2026-03-29 22:03:54 [bca.uk] INFO: Found listing with ID: KM08%20HZJ
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM08%2520HZJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:54 [bca.uk] INFO: Scrape type for KM08%20HZJ: 0
2026-03-29 22:03:54 [bca.uk] INFO: Found listing with ID: NK66%20YFN
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK66%2520YFN%27 HTTP/1.1" 200 None
2026-03-29 22:03:54 [bca.uk] INFO: Scrape type for NK66%20YFN: 0
2026-03-29 22:03:54 [bca.uk] INFO: Found listing with ID: OY11%20XRC
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY11%2520XRC%27 HTTP/1.1" 200 None
2026-03-29 22:03:54 [bca.uk] INFO: Scrape type for OY11%20XRC: 0
2026-03-29 22:03:54 [bca.uk] INFO: Found listing with ID: RX63%20SMO
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX63%2520SMO%27 HTTP/1.1" 200 None
2026-03-29 22:03:54 [bca.uk] INFO: Scrape type for RX63%20SMO: 2
2026-03-29 22:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 208d0970-e666-5a1d-bb8d-26c8a38ccb22 with identifier: RX63%20SMO
2026-03-29 22:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 208d0970-e666-5a1d-bb8d-26c8a38ccb22 with scrape type 2
2026-03-29 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 208d0970-e666-5a1d-bb8d-26c8a38ccb22 with scrape type 2
2026-03-29 22:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 208d0970-e666-5a1d-bb8d-26c8a38ccb22, identifier: RX63%20SMO
2026-03-29 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69ae03d0>
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19VXX%252F699427899%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427899/600 saved to cache
2026-03-29 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 553a9526-308c-5e9f-97f5-1bce769f99d7
2026-03-29 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61747290>
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML23KNX%252F699411824%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411824/600 saved to cache
2026-03-29 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c96e7ad0-7cd4-5ea7-b41d-642972a2bf14
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618f4ed0>
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70YYW%252F699040160%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040160/600 saved to cache
2026-03-29 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01b57636-ffd9-585f-9b00-e6ae7dbcc329
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6188d110>
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP65LKN%252F699411770%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411770/600 saved to cache
2026-03-29 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6062366a-77b0-5b3c-aa23-49414d769971
2026-03-29 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61714450>
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPA19DCO%252F699409286%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409286/600 saved to cache
2026-03-29 22:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da397772-3003-5876-84de-18e19f2e1e0e
2026-03-29 22:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251950/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MC14KAE/42809755?sv=2020-08-04&st=2026-03-29T22%3A00%3A59Z&se=2026-03-29T22%3A25%3A59Z&sr=b&sp=r&sig=DG6b3zLT1DRX51p27qxjR95H%2BdTJAJxRv%2B3BMmM%2BaS4%3D)
2026-03-29 22:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135170/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX24YZN/42810399?sv=2020-08-04&st=2026-03-29T22%3A03%3A46Z&se=2026-03-29T22%3A28%3A46Z&sr=b&sp=r&sig=8e9SBxRll69R6BfeEYHqMucX3PZJ0l%2BWAH9PpY%2B%2Bjlo%3D)
2026-03-29 22:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135228/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135228>
2026-03-29 22:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 208d0970-e666-5a1d-bb8d-26c8a38ccb22 with identifier: RX63%20SMO
2026-03-29 22:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 208d0970-e666-5a1d-bb8d-26c8a38ccb22 with identifier: RX63%20SMO
2026-03-29 22:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 208d0970-e666-5a1d-bb8d-26c8a38ccb22 with identifier: RX63%20SMO to the API
2026-03-29 22:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 100,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RX63%20SMO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '208d0970-e666-5a1d-bb8d-26c8a38ccb22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RX63 SMO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RX63%20SMO&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'KIA',
'model': 'CEED',
'odometer': 106693,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'KIA CEED 1.6 CRDI 126 E/D 2 Hatchback',
'transmission': 'manual',
'trim': 'CRDI 126 E/D 2',
'vin': 'U5YHN516LEL086444',
'year': 2013}
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX63%2520SMO%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [bca.uk] INFO: Saving data for RX63%20SMO: {'auction_closing_time': 1774864800.0, 'created_time': 1774044457.61291, 'last_price_update_time': 1774821835.141183}
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RX63%2520SMO') HTTP/1.1" 204 0
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188947%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188947 not downloaded yet
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699135329%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135329 not downloaded yet
2026-03-29 22:03:55 [bca.uk] INFO: Found listing with ID: SH09%20HCE
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH09%2520HCE%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [bca.uk] INFO: Scrape type for SH09%20HCE: 0
2026-03-29 22:03:55 [bca.uk] INFO: Found listing with ID: SJ12%20WND
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ12%2520WND%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [bca.uk] INFO: Scrape type for SJ12%20WND: 0
2026-03-29 22:03:55 [bca.uk] INFO: Found listing with ID: PY70%20CZE
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY70%2520CZE%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [bca.uk] INFO: Scrape type for PY70%20CZE: 0
2026-03-29 22:03:55 [bca.uk] INFO: Found listing with ID: MK10%20FFX
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK10%2520FFX%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [bca.uk] INFO: Scrape type for MK10%20FFX: 0
2026-03-29 22:03:55 [bca.uk] INFO: Found listing with ID: SE14%20ONO
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE14%2520ONO%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [bca.uk] INFO: Scrape type for SE14%20ONO: 0
2026-03-29 22:03:55 [bca.uk] INFO: Found listing with ID: GY10%20KJN
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY10%2520KJN%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [bca.uk] INFO: Scrape type for GY10%20KJN: 0
2026-03-29 22:03:55 [bca.uk] INFO: Found listing with ID: FG68%20YMS
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG68%2520YMS%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [bca.uk] INFO: Scrape type for FG68%20YMS: 0
2026-03-29 22:03:55 [bca.uk] INFO: Found listing with ID: GY10%20HOJ
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY10%2520HOJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [bca.uk] INFO: Scrape type for GY10%20HOJ: 0
2026-03-29 22:03:55 [bca.uk] INFO: Found listing with ID: GK69%20VVX
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK69%2520VVX%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [bca.uk] INFO: Scrape type for GK69%20VVX: 0
2026-03-29 22:03:55 [bca.uk] INFO: Found listing with ID: HY14%20HKE
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY14%2520HKE%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [bca.uk] INFO: Scrape type for HY14%20HKE: 2
2026-03-29 22:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a266e90-5a43-5bf9-84c9-d323c4a91e17 with identifier: HY14%20HKE
2026-03-29 22:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a266e90-5a43-5bf9-84c9-d323c4a91e17 with scrape type 2
2026-03-29 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a266e90-5a43-5bf9-84c9-d323c4a91e17 with scrape type 2
2026-03-29 22:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1a266e90-5a43-5bf9-84c9-d323c4a91e17, identifier: HY14%20HKE
2026-03-29 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61050610>
2026-03-29 22:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG69FWY%252F699406392%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406392/600 saved to cache
2026-03-29 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 23673480-b7c5-5707-903a-2783d4797f75
2026-03-29 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188899/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188899>
2026-03-29 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135245/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135245>
2026-03-29 22:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188892/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188892>
2026-03-29 22:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435146/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS68PYY/42812178?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=ilxdzGsr4IgRZDvqZmWhurm4pGkLnzxS3s4veY%2BdCjs%3D)
2026-03-29 22:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1a266e90-5a43-5bf9-84c9-d323c4a91e17 with identifier: HY14%20HKE
2026-03-29 22:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1a266e90-5a43-5bf9-84c9-d323c4a91e17 with identifier: HY14%20HKE
2026-03-29 22:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1a266e90-5a43-5bf9-84c9-d323c4a91e17 with identifier: HY14%20HKE to the API
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 192,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY14%20HKE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.7L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1a266e90-5a43-5bf9-84c9-d323c4a91e17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY14 HKE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HY14%20HKE&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'PORSCHE',
'model': 'BOXSTER',
'odometer': 54176,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PORSCHE BOXSTER 2.7 Roadster',
'transmission': 'manual',
'trim': '',
'vin': 'WP0ZZZ98ZES112076',
'year': 2014}
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY14%2520HKE%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [bca.uk] INFO: Saving data for HY14%20HKE: {'auction_closing_time': 1774951200.0, 'created_time': 1774016641.87007, 'last_price_update_time': 1774821835.819188}
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HY14%2520HKE') HTTP/1.1" 204 0
2026-03-29 22:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FHZ1603/42805791?sv=2020-08-04&st=2026-03-29T22%3A03%3A51Z&se=2026-03-29T22%3A28%3A51Z&sr=b&sp=r&sig=Qo7fOtclp9X7inziZuofC2kPLk5w0PoXJfJGKaWDDkM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188962%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188962 not downloaded yet
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699135343%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135343 not downloaded yet
2026-03-29 22:03:55 [bca.uk] INFO: Found listing with ID: NU67%20EBV
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU67%2520EBV%27 HTTP/1.1" 200 None
2026-03-29 22:03:55 [bca.uk] INFO: Scrape type for NU67%20EBV: 0
2026-03-29 22:03:55 [bca.uk] INFO: Found listing with ID: WJ60%20UWG
2026-03-29 22:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ60%2520UWG%27 HTTP/1.1" 200 None
2026-03-29 22:03:56 [bca.uk] INFO: Scrape type for WJ60%20UWG: 0
2026-03-29 22:03:56 [bca.uk] INFO: Found listing with ID: YF07%20WXT
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF07%2520WXT%27 HTTP/1.1" 200 None
2026-03-29 22:03:56 [bca.uk] INFO: Scrape type for YF07%20WXT: 0
2026-03-29 22:03:56 [bca.uk] INFO: Found listing with ID: EY08%20VJV
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY08%2520VJV%27 HTTP/1.1" 200 None
2026-03-29 22:03:56 [bca.uk] INFO: Scrape type for EY08%20VJV: 0
2026-03-29 22:03:56 [bca.uk] INFO: Found listing with ID: T500%20MUL
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T500%2520MUL%27 HTTP/1.1" 200 None
2026-03-29 22:03:56 [bca.uk] INFO: Scrape type for T500%20MUL: 0
2026-03-29 22:03:56 [bca.uk] INFO: Found listing with ID: DV10%20NXK
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV10%2520NXK%27 HTTP/1.1" 200 None
2026-03-29 22:03:56 [bca.uk] INFO: Scrape type for DV10%20NXK: 0
2026-03-29 22:03:56 [bca.uk] INFO: Found listing with ID: RO62%20MVR
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO62%2520MVR%27 HTTP/1.1" 200 None
2026-03-29 22:03:56 [bca.uk] INFO: Scrape type for RO62%20MVR: 0
2026-03-29 22:03:56 [bca.uk] INFO: Found listing with ID: SD62%20JTV
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD62%2520JTV%27 HTTP/1.1" 200 None
2026-03-29 22:03:56 [bca.uk] INFO: Scrape type for SD62%20JTV: 0
2026-03-29 22:03:56 [bca.uk] INFO: Found listing with ID: VN11%20JKK
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN11%2520JKK%27 HTTP/1.1" 200 None
2026-03-29 22:03:56 [bca.uk] INFO: Scrape type for VN11%20JKK: 0
2026-03-29 22:03:56 [bca.uk] INFO: Found listing with ID: VO06%20JCX
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO06%2520JCX%27 HTTP/1.1" 200 None
2026-03-29 22:03:56 [bca.uk] INFO: Scrape type for VO06%20JCX: 0
2026-03-29 22:03:56 [bca.uk] INFO: Found listing with ID: WF16%20HVZ
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF16%2520HVZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:56 [bca.uk] INFO: Scrape type for WF16%20HVZ: 0
2026-03-29 22:03:56 [bca.uk] INFO: Found listing with ID: WP59%20WKJ
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP59%2520WKJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:56 [bca.uk] INFO: Scrape type for WP59%20WKJ: 0
2026-03-29 22:03:56 [bca.uk] INFO: Found listing with ID: WU19%20VDC
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU19%2520VDC%27 HTTP/1.1" 200 None
2026-03-29 22:03:56 [bca.uk] INFO: Scrape type for WU19%20VDC: 2
2026-03-29 22:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c7ab10e-203f-5d5d-b669-d394e3cfab8d with identifier: WU19%20VDC
2026-03-29 22:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c7ab10e-203f-5d5d-b669-d394e3cfab8d with scrape type 2
2026-03-29 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c7ab10e-203f-5d5d-b669-d394e3cfab8d with scrape type 2
2026-03-29 22:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2c7ab10e-203f-5d5d-b669-d394e3cfab8d, identifier: WU19%20VDC
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61053450>
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL11KPY%252F699212535%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212535/600 saved to cache
2026-03-29 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c
2026-03-29 22:03:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c, skipping ID generation
2026-03-29 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c sending to next pipeline
2026-03-29 22:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c, identifier: SL11%20KPY
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6188d1d0>
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKD15FPU%252F699239903%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239903/600 saved to cache
2026-03-29 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78
2026-03-29 22:03:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78, skipping ID generation
2026-03-29 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78 sending to next pipeline
2026-03-29 22:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78, identifier: KD15%20FPU
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61671310>
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLA70NPE%252F699406287%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406287/600 saved to cache
2026-03-29 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4838ed0-a1bc-555f-ae17-73d79e29d1ac
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61002490>
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMC14KAE%252F699251950%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251950/600 saved to cache
2026-03-29 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97c5232d-22c9-5728-b6fd-84d8da4f8949
2026-03-29 22:03:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97c5232d-22c9-5728-b6fd-84d8da4f8949, skipping ID generation
2026-03-29 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97c5232d-22c9-5728-b6fd-84d8da4f8949 sending to next pipeline
2026-03-29 22:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 97c5232d-22c9-5728-b6fd-84d8da4f8949, identifier: MC14%20KAE
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6218c650>
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX24YZN%252F699135170%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135170/600 saved to cache
2026-03-29 22:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9edc33d7-192a-5fcd-8823-b4e8eb0a8391
2026-03-29 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188866/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV13MWG/42809444?sv=2020-08-04&st=2026-03-29T22%3A03%3A47Z&se=2026-03-29T22%3A28%3A47Z&sr=b&sp=r&sig=ez2ghwDEfe5r9Au1DGHEHNI79cn1%2F7NorIDKWocec04%3D)
2026-03-29 22:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409230/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE18CHX/42812000?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=oyBRp8qHoowbCW9kieY0zUV46IZNjY3FwR8NKuxfaxo%3D)
2026-03-29 22:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135260/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135260>
2026-03-29 22:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2c7ab10e-203f-5d5d-b669-d394e3cfab8d with identifier: WU19%20VDC
2026-03-29 22:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2c7ab10e-203f-5d5d-b669-d394e3cfab8d with identifier: WU19%20VDC
2026-03-29 22:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2c7ab10e-203f-5d5d-b669-d394e3cfab8d with identifier: WU19%20VDC to the API
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WU19%20VDC-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2c7ab10e-203f-5d5d-b669-d394e3cfab8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WU19 VDC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WU19%20VDC&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'SKODA',
'model': 'OCTAVIA',
'odometer': 130145,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'SKODA OCTAVIA 1.5 TSI 150 SE Hatchback',
'transmission': 'manual',
'trim': 'TSI 150 SE',
'vin': 'TMBBR7NE7K0158186',
'year': 2019}
2026-03-29 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU19%2520VDC%27 HTTP/1.1" 200 None
2026-03-29 22:03:57 [bca.uk] INFO: Saving data for WU19%20VDC: {'auction_closing_time': 1774864800.0, 'created_time': 1774706880.107877, 'last_price_update_time': 1774821837.092903}
2026-03-29 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WU19%2520VDC') HTTP/1.1" 204 0
2026-03-29 22:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c with identifier: SL11%20KPY
2026-03-29 22:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c with identifier: SL11%20KPY
2026-03-29 22:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 74a83265-9a8e-5ab8-b24a-1e8aacc9b90c with identifier: SL11%20KPY to the API
2026-03-29 22:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212535/600>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_expert_report_file_a4aee775-a19b-4a18-a2bb-66b37dfe6157.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL11%20KPY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': '74a83265-9a8e-5ab8-b24a-1e8aacc9b90c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SL11 KPY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SL11%20KPY&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 84199,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40959,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212535/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39926,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212542/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40181,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212548/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40564,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212555/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37622,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212562/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37485,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212569/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77835,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212581/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73422,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212596/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82152,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212610/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a83265-9a8e-5ab8-b24a-1e8aacc9b90c/74a83265-9a8e-5ab8-b24a-1e8aacc9b90c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83830,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL11KPY/699212624/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.4 TWIST Hatchback',
'transmission': 'manual',
'trim': 'TWIST',
'vin': 'WVWZZZ1KZBP081577',
'year': 2011}
2026-03-29 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL11%2520KPY%27 HTTP/1.1" 200 None
2026-03-29 22:03:57 [bca.uk] INFO: Saving data for SL11%20KPY: {'created_time': 1774821837.561159, 'last_price_update_time': 1774821837.561174, 'auction_closing_time': 1775210400.0}
2026-03-29 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SL11%2520KPY') HTTP/1.1" 204 0
2026-03-29 22:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78 with identifier: KD15%20FPU
2026-03-29 22:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78 with identifier: KD15%20FPU
2026-03-29 22:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78 with identifier: KD15%20FPU to the API
2026-03-29 22:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239903/600>
{'auction_title': '',
'c_o_2_emission_value': 102,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_expert_report_file_d65f98e9-a40d-49ec-86de-5fbb82779d92.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KD15%20FPU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KD15 FPU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KD15%20FPU&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLVO',
'model': 'V40',
'odometer': 63472,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39757,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239903/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39612,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239936/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40089,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239946/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40427,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239960/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36525,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239969/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35599,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699239980/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80042,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699240002/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76840,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699240020/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82853,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699240036/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78/6bbbd997-0b9f-5ad1-8ff4-88e9a6d62e78_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70032,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD15FPU/699240050/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VOLVO V40 1.6 D2 115 SE P/S Hatchback',
'transmission': 'automatic',
'trim': 'D2 115 SE P/S',
'vin': 'YV1MV848BF2241436',
'year': 2015}
2026-03-29 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KD15%2520FPU%27 HTTP/1.1" 200 None
2026-03-29 22:03:57 [bca.uk] INFO: Saving data for KD15%20FPU: {'created_time': 1774821837.941181, 'last_price_update_time': 1774821837.941192, 'auction_closing_time': 1775210400.0}
2026-03-29 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KD15%2520FPU') HTTP/1.1" 204 0
2026-03-29 22:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 97c5232d-22c9-5728-b6fd-84d8da4f8949 with identifier: MC14%20KAE
2026-03-29 22:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 97c5232d-22c9-5728-b6fd-84d8da4f8949 with identifier: MC14%20KAE
2026-03-29 22:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 97c5232d-22c9-5728-b6fd-84d8da4f8949 with identifier: MC14%20KAE to the API
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251950/600>
{'auction_title': '',
'c_o_2_emission_value': 27,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_expert_report_file_51246dfb-8a48-4f36-86ee-27d54701a223.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MC14%20KAE-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '97c5232d-22c9-5728-b6fd-84d8da4f8949',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MC14 KAE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MC14%20KAE&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'AMPERA',
'odometer': 115127,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40698,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251950/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40856,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251954/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40037,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251964/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40514,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251971/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35988,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251980/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34909,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699251990/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106286,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699252004/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81350,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699252019/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105798,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699252032/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c5232d-22c9-5728-b6fd-84d8da4f8949/97c5232d-22c9-5728-b6fd-84d8da4f8949_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66969,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MC14KAE/699252047/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL AMPERA 1.4 POSITIV (REX) Hatchback',
'transmission': 'automatic',
'trim': 'POSITIV (REX)',
'vin': '1G0R86E48DU107761',
'year': 2014}
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC14%2520KAE%27 HTTP/1.1" 200 None
2026-03-29 22:03:58 [bca.uk] INFO: Saving data for MC14%20KAE: {'created_time': 1774821838.342985, 'last_price_update_time': 1774821838.342995, 'auction_closing_time': 1775210400.0}
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MC14%2520KAE') HTTP/1.1" 204 0
2026-03-29 22:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135203/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX24YZN/42810399?sv=2020-08-04&st=2026-03-29T22%3A03%3A46Z&se=2026-03-29T22%3A28%3A46Z&sr=b&sp=r&sig=8e9SBxRll69R6BfeEYHqMucX3PZJ0l%2BWAH9PpY%2B%2Bjlo%3D)
2026-03-29 22:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188907/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188907>
2026-03-29 22:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188920/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188920>
2026-03-29 22:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135279/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135279>
2026-03-29 22:03:58 [bca.uk] INFO: Found listing with ID: WV62%20VSN
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV62%2520VSN%27 HTTP/1.1" 200 None
2026-03-29 22:03:58 [bca.uk] INFO: Scrape type for WV62%20VSN: 0
2026-03-29 22:03:58 [bca.uk] INFO: Found listing with ID: WV64%20BPX
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV64%2520BPX%27 HTTP/1.1" 200 None
2026-03-29 22:03:58 [bca.uk] INFO: Scrape type for WV64%20BPX: 0
2026-03-29 22:03:58 [bca.uk] INFO: Found listing with ID: YS09%20CYH
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS09%2520CYH%27 HTTP/1.1" 200 None
2026-03-29 22:03:58 [bca.uk] INFO: Scrape type for YS09%20CYH: 0
2026-03-29 22:03:58 [bca.uk] INFO: Found listing with ID: YY64%20XMD
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY64%2520XMD%27 HTTP/1.1" 200 None
2026-03-29 22:03:58 [bca.uk] INFO: Scrape type for YY64%20XMD: 0
2026-03-29 22:03:58 [bca.uk] INFO: Found listing with ID: CE59%20OEW
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE59%2520OEW%27 HTTP/1.1" 200 None
2026-03-29 22:03:58 [bca.uk] INFO: Scrape type for CE59%20OEW: 0
2026-03-29 22:03:58 [bca.uk] INFO: Found listing with ID: CV12%20NYD
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV12%2520NYD%27 HTTP/1.1" 200 None
2026-03-29 22:03:58 [bca.uk] INFO: Scrape type for CV12%20NYD: 0
2026-03-29 22:03:58 [bca.uk] INFO: Found listing with ID: CX59%20VUM
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX59%2520VUM%27 HTTP/1.1" 200 None
2026-03-29 22:03:58 [bca.uk] INFO: Scrape type for CX59%20VUM: 0
2026-03-29 22:03:58 [bca.uk] INFO: Found listing with ID: CX63%20XMF
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX63%2520XMF%27 HTTP/1.1" 200 None
2026-03-29 22:03:58 [bca.uk] INFO: Scrape type for CX63%20XMF: 0
2026-03-29 22:03:58 [bca.uk] INFO: Found listing with ID: DA09%20LRF
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA09%2520LRF%27 HTTP/1.1" 200 None
2026-03-29 22:03:58 [bca.uk] INFO: Scrape type for DA09%20LRF: 0
2026-03-29 22:03:58 [bca.uk] INFO: Found listing with ID: DU68%20ZPW
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU68%2520ZPW%27 HTTP/1.1" 200 None
2026-03-29 22:03:58 [bca.uk] INFO: Scrape type for DU68%20ZPW: 0
2026-03-29 22:03:58 [bca.uk] INFO: Found listing with ID: EA16%20HWV
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA16%2520HWV%27 HTTP/1.1" 200 None
2026-03-29 22:03:58 [bca.uk] INFO: Scrape type for EA16%20HWV: 0
2026-03-29 22:03:58 [bca.uk] INFO: Found listing with ID: FL11%20PWJ
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL11%2520PWJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:58 [bca.uk] INFO: Scrape type for FL11%20PWJ: 0
2026-03-29 22:03:58 [bca.uk] INFO: Found listing with ID: HG57%20ZGN
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG57%2520ZGN%27 HTTP/1.1" 200 None
2026-03-29 22:03:58 [bca.uk] INFO: Scrape type for HG57%20ZGN: 0
2026-03-29 22:03:58 [bca.uk] INFO: Found listing with ID: HJ13%20EOR
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ13%2520EOR%27 HTTP/1.1" 200 None
2026-03-29 22:03:58 [bca.uk] INFO: Scrape type for HJ13%20EOR: 0
2026-03-29 22:03:58 [bca.uk] INFO: Found listing with ID: KV16%20LDZ
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV16%2520LDZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:58 [bca.uk] INFO: Scrape type for KV16%20LDZ: 2
2026-03-29 22:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b90222e-e04a-5b27-ab41-392150aadde5 with identifier: KV16%20LDZ
2026-03-29 22:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b90222e-e04a-5b27-ab41-392150aadde5 with scrape type 2
2026-03-29 22:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b90222e-e04a-5b27-ab41-392150aadde5 with scrape type 2
2026-03-29 22:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8b90222e-e04a-5b27-ab41-392150aadde5, identifier: KV16%20LDZ
2026-03-29 22:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135228/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX24YZN/42810399?sv=2020-08-04&st=2026-03-29T22%3A03%3A46Z&se=2026-03-29T22%3A28%3A46Z&sr=b&sp=r&sig=8e9SBxRll69R6BfeEYHqMucX3PZJ0l%2BWAH9PpY%2B%2Bjlo%3D)
2026-03-29 22:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8b90222e-e04a-5b27-ab41-392150aadde5 with identifier: KV16%20LDZ
2026-03-29 22:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8b90222e-e04a-5b27-ab41-392150aadde5 with identifier: KV16%20LDZ
2026-03-29 22:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8b90222e-e04a-5b27-ab41-392150aadde5 with identifier: KV16%20LDZ to the API
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KV16%20LDZ-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8b90222e-e04a-5b27-ab41-392150aadde5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KV16 LDZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KV16%20LDZ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 133347,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN X-TRAIL 1.6 DCI 130 TEKNA (7ST) XTRONIC StationWagon',
'transmission': 'automatic',
'trim': 'DCI 130 TEKNA (7ST) XTRONIC',
'vin': 'JN1JCAT32U0023480',
'year': 2016}
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV16%2520LDZ%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Saving data for KV16%20LDZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774706880.484852, 'last_price_update_time': 1774821839.041682}
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KV16%2520LDZ') HTTP/1.1" 204 0
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614ce9d0>
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS68PYY%252F699435146%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435146/600 saved to cache
2026-03-29 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62246150>
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_expert_report_file_9aae6906-044d-436b-a39f-69a4e74e8a23.pdf HTTP/1.1" 201 0
2026-03-29 22:03:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 96a01409-506c-5e89-901d-52d468f35eff
2026-03-29 22:03:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96a01409-506c-5e89-901d-52d468f35eff, skipping ID generation
2026-03-29 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96a01409-506c-5e89-901d-52d468f35eff
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFHZ1603-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FHZ1603-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135292/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135292>
2026-03-29 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188892/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV13MWG/42809444?sv=2020-08-04&st=2026-03-29T22%3A03%3A47Z&se=2026-03-29T22%3A28%3A47Z&sr=b&sp=r&sig=ez2ghwDEfe5r9Au1DGHEHNI79cn1%2F7NorIDKWocec04%3D)
2026-03-29 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188934/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188934>
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: LD58%20FPT
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD58%2520FPT%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for LD58%20FPT: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: RK64%20AWR
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK64%2520AWR%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for RK64%20AWR: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: MF10%20XKL
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF10%2520XKL%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for MF10%20XKL: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: MT18%20GXF
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT18%2520GXF%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for MT18%20GXF: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: WM19%20NVK
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM19%2520NVK%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for WM19%20NVK: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: CY65%20DFE
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CY65%2520DFE%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for CY65%20DFE: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: KU17%20ZLW
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU17%2520ZLW%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for KU17%20ZLW: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: SM20%20VYX
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM20%2520VYX%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for SM20%20VYX: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: BC18%20CLU
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC18%2520CLU%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for BC18%20CLU: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: KM18%20ZYB
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM18%2520ZYB%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for KM18%20ZYB: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: NX10%20HHP
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX10%2520HHP%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for NX10%20HHP: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: LA10%20WZY
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA10%2520WZY%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for LA10%20WZY: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: KY66%20XSJ
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY66%2520XSJ%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for KY66%20XSJ: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: GL56%20COH
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL56%2520COH%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for GL56%20COH: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: SK09%20MUU
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK09%2520MUU%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for SK09%20MUU: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: DU18%20WDR
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU18%2520WDR%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for DU18%20WDR: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: LO62%20FPD
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO62%2520FPD%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for LO62%20FPD: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: HN10%20VKV
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN10%2520VKV%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for HN10%20VKV: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: KU12%20NXX
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU12%2520NXX%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for KU12%20NXX: 0
2026-03-29 22:03:59 [bca.uk] INFO: Found listing with ID: WJ63%20PFD
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ63%2520PFD%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [bca.uk] INFO: Scrape type for WJ63%20PFD: 0
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699180333%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180333 not downloaded yet
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620d7ed0>
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV13MWG%252F699188866%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188866/600 saved to cache
2026-03-29 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9da815d0-0890-5d46-9004-81239b502fc3
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611e28d0>
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE18CHX%252F699409230%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409230/600 saved to cache
2026-03-29 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632e0fd0>
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX24YZN%252F699135203%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135203/600 saved to cache
2026-03-29 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9edc33d7-192a-5fcd-8823-b4e8eb0a8391
2026-03-29 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135260/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX24YZN/42810399?sv=2020-08-04&st=2026-03-29T22%3A03%3A46Z&se=2026-03-29T22%3A28%3A46Z&sr=b&sp=r&sig=8e9SBxRll69R6BfeEYHqMucX3PZJ0l%2BWAH9PpY%2B%2Bjlo%3D)
2026-03-29 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135245/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX24YZN/42810399?sv=2020-08-04&st=2026-03-29T22%3A03%3A46Z&se=2026-03-29T22%3A28%3A46Z&sr=b&sp=r&sig=8e9SBxRll69R6BfeEYHqMucX3PZJ0l%2BWAH9PpY%2B%2Bjlo%3D)
2026-03-29 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188882/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188882>
2026-03-29 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135329/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135329>
2026-03-29 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188899/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV13MWG/42809444?sv=2020-08-04&st=2026-03-29T22%3A03%3A47Z&se=2026-03-29T22%3A28%3A47Z&sr=b&sp=r&sig=ez2ghwDEfe5r9Au1DGHEHNI79cn1%2F7NorIDKWocec04%3D)
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619292d0>
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX24YZN%252F699135228%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135228/600 saved to cache
2026-03-29 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9edc33d7-192a-5fcd-8823-b4e8eb0a8391
2026-03-29 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135279/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX24YZN/42810399?sv=2020-08-04&st=2026-03-29T22%3A03%3A46Z&se=2026-03-29T22%3A28%3A46Z&sr=b&sp=r&sig=8e9SBxRll69R6BfeEYHqMucX3PZJ0l%2BWAH9PpY%2B%2Bjlo%3D)
2026-03-29 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135189/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135189>
2026-03-29 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188947/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188947>
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699180342%27 HTTP/1.1" 200 None
2026-03-29 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180342 not downloaded yet
2026-03-29 22:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614c1650>
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV13MWG%252F699188892%252F600') HTTP/1.1" 204 0
2026-03-29 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188892/600 saved to cache
2026-03-29 22:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9da815d0-0890-5d46-9004-81239b502fc3
2026-03-29 22:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188962/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188962>
2026-03-29 22:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699180351%27 HTTP/1.1" 200 None
2026-03-29 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180351 not downloaded yet
2026-03-29 22:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61883d90>
2026-03-29 22:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX24YZN%252F699135260%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135260/600 saved to cache
2026-03-29 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9edc33d7-192a-5fcd-8823-b4e8eb0a8391
2026-03-29 22:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632b8c50>
2026-03-29 22:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX24YZN%252F699135245%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135245/600 saved to cache
2026-03-29 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9edc33d7-192a-5fcd-8823-b4e8eb0a8391
2026-03-29 22:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614cc450>
2026-03-29 22:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV13MWG%252F699188899%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188899/600 saved to cache
2026-03-29 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9da815d0-0890-5d46-9004-81239b502fc3
2026-03-29 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135343/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699135343>
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699180360%27 HTTP/1.1" 200 None
2026-03-29 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180360 not downloaded yet
2026-03-29 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188907/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV13MWG/42809444?sv=2020-08-04&st=2026-03-29T22%3A03%3A47Z&se=2026-03-29T22%3A28%3A47Z&sr=b&sp=r&sig=ez2ghwDEfe5r9Au1DGHEHNI79cn1%2F7NorIDKWocec04%3D)
2026-03-29 22:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188876/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188876>
2026-03-29 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188882/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV13MWG/42809444?sv=2020-08-04&st=2026-03-29T22%3A03%3A47Z&se=2026-03-29T22%3A28%3A47Z&sr=b&sp=r&sig=ez2ghwDEfe5r9Au1DGHEHNI79cn1%2F7NorIDKWocec04%3D)
2026-03-29 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188934/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV13MWG/42809444?sv=2020-08-04&st=2026-03-29T22%3A03%3A47Z&se=2026-03-29T22%3A28%3A47Z&sr=b&sp=r&sig=ez2ghwDEfe5r9Au1DGHEHNI79cn1%2F7NorIDKWocec04%3D)
2026-03-29 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188920/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV13MWG/42809444?sv=2020-08-04&st=2026-03-29T22%3A03%3A47Z&se=2026-03-29T22%3A28%3A47Z&sr=b&sp=r&sig=ez2ghwDEfe5r9Au1DGHEHNI79cn1%2F7NorIDKWocec04%3D)
2026-03-29 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135292/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX24YZN/42810399?sv=2020-08-04&st=2026-03-29T22%3A03%3A46Z&se=2026-03-29T22%3A28%3A46Z&sr=b&sp=r&sig=8e9SBxRll69R6BfeEYHqMucX3PZJ0l%2BWAH9PpY%2B%2Bjlo%3D)
2026-03-29 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135329/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX24YZN/42810399?sv=2020-08-04&st=2026-03-29T22%3A03%3A46Z&se=2026-03-29T22%3A28%3A46Z&sr=b&sp=r&sig=8e9SBxRll69R6BfeEYHqMucX3PZJ0l%2BWAH9PpY%2B%2Bjlo%3D)
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699180367%27 HTTP/1.1" 200 None
2026-03-29 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180367 not downloaded yet
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699180383%27 HTTP/1.1" 200 None
2026-03-29 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180383 not downloaded yet
2026-03-29 22:04:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6216bed0>
2026-03-29 22:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX24YZN%252F699135279%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135279/600 saved to cache
2026-03-29 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9edc33d7-192a-5fcd-8823-b4e8eb0a8391
2026-03-29 22:04:00 [bca.uk] INFO: Total items found: 100
2026-03-29 22:04:00 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded
2026-03-29 22:04:00 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:04:00 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699180396%27 HTTP/1.1" 200 None
2026-03-29 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180396 not downloaded yet
2026-03-29 22:04:00 [bca.uk] INFO: Found listing with ID: YX59%20SFY
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX59%2520SFY%27 HTTP/1.1" 200 None
2026-03-29 22:04:00 [bca.uk] INFO: Scrape type for YX59%20SFY: 0
2026-03-29 22:04:00 [bca.uk] INFO: Found listing with ID: BW69%20HZG
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW69%2520HZG%27 HTTP/1.1" 200 None
2026-03-29 22:04:00 [bca.uk] INFO: Scrape type for BW69%20HZG: 0
2026-03-29 22:04:00 [bca.uk] INFO: Found listing with ID: HT19%20TZL
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT19%2520TZL%27 HTTP/1.1" 200 None
2026-03-29 22:04:00 [bca.uk] INFO: Scrape type for HT19%20TZL: 0
2026-03-29 22:04:00 [bca.uk] INFO: Found listing with ID: BL18%20KKR
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL18%2520KKR%27 HTTP/1.1" 200 None
2026-03-29 22:04:00 [bca.uk] INFO: Scrape type for BL18%20KKR: 0
2026-03-29 22:04:00 [bca.uk] INFO: Found listing with ID: DC19%20NCN
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC19%2520NCN%27 HTTP/1.1" 200 None
2026-03-29 22:04:00 [bca.uk] INFO: Scrape type for DC19%20NCN: 0
2026-03-29 22:04:00 [bca.uk] INFO: Found listing with ID: HY57%20KMG
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY57%2520KMG%27 HTTP/1.1" 200 None
2026-03-29 22:04:00 [bca.uk] INFO: Scrape type for HY57%20KMG: 2
2026-03-29 22:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab756b39-43fa-5fe7-8f31-c7670e3f9d15 with identifier: HY57%20KMG
2026-03-29 22:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab756b39-43fa-5fe7-8f31-c7670e3f9d15 with scrape type 2
2026-03-29 22:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab756b39-43fa-5fe7-8f31-c7670e3f9d15 with scrape type 2
2026-03-29 22:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ab756b39-43fa-5fe7-8f31-c7670e3f9d15, identifier: HY57%20KMG
2026-03-29 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188947/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV13MWG/42809444?sv=2020-08-04&st=2026-03-29T22%3A03%3A47Z&se=2026-03-29T22%3A28%3A47Z&sr=b&sp=r&sig=ez2ghwDEfe5r9Au1DGHEHNI79cn1%2F7NorIDKWocec04%3D)
2026-03-29 22:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135189/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX24YZN/42810399?sv=2020-08-04&st=2026-03-29T22%3A03%3A46Z&se=2026-03-29T22%3A28%3A46Z&sr=b&sp=r&sig=8e9SBxRll69R6BfeEYHqMucX3PZJ0l%2BWAH9PpY%2B%2Bjlo%3D)
2026-03-29 22:04:00 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:04:00 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ab756b39-43fa-5fe7-8f31-c7670e3f9d15 with identifier: HY57%20KMG
2026-03-29 22:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ab756b39-43fa-5fe7-8f31-c7670e3f9d15 with identifier: HY57%20KMG
2026-03-29 22:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ab756b39-43fa-5fe7-8f31-c7670e3f9d15 with identifier: HY57%20KMG to the API
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 181,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY57%20KMG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ab756b39-43fa-5fe7-8f31-c7670e3f9d15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY57 KMG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HY57%20KMG&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': 'Z4',
'odometer': 55873,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'BMW Z4 2.0 SE Roadster',
'transmission': 'manual',
'trim': 'SE',
'vin': 'WBABZ12060LY61857',
'year': 2007}
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY57%2520KMG%27 HTTP/1.1" 200 None
2026-03-29 22:04:00 [bca.uk] INFO: Saving data for HY57%20KMG: {'auction_closing_time': 1774951200.0, 'created_time': 1774391960.179668, 'last_price_update_time': 1774821840.895712}
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HY57%2520KMG') HTTP/1.1" 204 0
2026-03-29 22:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411573/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411573>
2026-03-29 22:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180333/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180333>
2026-03-29 22:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430208/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430208>
2026-03-29 22:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430264/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430264>
2026-03-29 22:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180325/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FHZ1603-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699180413%27 HTTP/1.1" 200 None
2026-03-29 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180413 not downloaded yet
2026-03-29 22:04:01 [bca.uk] INFO: Found listing with ID: PN17%20YAG
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN17%2520YAG%27 HTTP/1.1" 200 None
2026-03-29 22:04:01 [bca.uk] INFO: Scrape type for PN17%20YAG: 0
2026-03-29 22:04:01 [bca.uk] INFO: Found listing with ID: EN12%20PFK
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN12%2520PFK%27 HTTP/1.1" 200 None
2026-03-29 22:04:01 [bca.uk] INFO: Scrape type for EN12%20PFK: 0
2026-03-29 22:04:01 [bca.uk] INFO: Found listing with ID: LL19%20WUR
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL19%2520WUR%27 HTTP/1.1" 200 None
2026-03-29 22:04:01 [bca.uk] INFO: Scrape type for LL19%20WUR: 2
2026-03-29 22:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8117b92-254d-556f-bb05-b05ba99b2b70 with identifier: LL19%20WUR
2026-03-29 22:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8117b92-254d-556f-bb05-b05ba99b2b70 with scrape type 2
2026-03-29 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8117b92-254d-556f-bb05-b05ba99b2b70 with scrape type 2
2026-03-29 22:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d8117b92-254d-556f-bb05-b05ba99b2b70, identifier: LL19%20WUR
2026-03-29 22:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188962/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV13MWG/42809444?sv=2020-08-04&st=2026-03-29T22%3A03%3A47Z&se=2026-03-29T22%3A28%3A47Z&sr=b&sp=r&sig=ez2ghwDEfe5r9Au1DGHEHNI79cn1%2F7NorIDKWocec04%3D)
2026-03-29 22:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d8117b92-254d-556f-bb05-b05ba99b2b70 with identifier: LL19%20WUR
2026-03-29 22:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d8117b92-254d-556f-bb05-b05ba99b2b70 with identifier: LL19%20WUR
2026-03-29 22:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d8117b92-254d-556f-bb05-b05ba99b2b70 with identifier: LL19%20WUR to the API
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 178,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LL19%20WUR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd8117b92-254d-556f-bb05-b05ba99b2b70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL19 WUR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LL19%20WUR&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'AUDI',
'model': 'Q7',
'odometer': 76473,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'AUDI Q7 3.0 45 TDI QUATTRO S LINE TIP StationWagon',
'transmission': 'manual',
'trim': '45 TDI QUATTRO S LINE TIP',
'vin': 'WAUZZZ4M6KD012872',
'year': 2019}
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL19%2520WUR%27 HTTP/1.1" 200 None
2026-03-29 22:04:01 [bca.uk] INFO: Saving data for LL19%20WUR: {'auction_closing_time': 1774864800.0, 'created_time': 1774609392.660476, 'last_price_update_time': 1774821841.650973}
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LL19%2520WUR') HTTP/1.1" 204 0
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac697c5bd0>
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV13MWG%252F699188907%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188907/600 saved to cache
2026-03-29 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9da815d0-0890-5d46-9004-81239b502fc3
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632ba2d0>
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV13MWG%252F699188882%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188882/600 saved to cache
2026-03-29 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9da815d0-0890-5d46-9004-81239b502fc3
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611e1190>
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV13MWG%252F699188934%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188934/600 saved to cache
2026-03-29 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9da815d0-0890-5d46-9004-81239b502fc3
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617521d0>
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV13MWG%252F699188920%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188920/600 saved to cache
2026-03-29 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9da815d0-0890-5d46-9004-81239b502fc3
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614b2f10>
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX24YZN%252F699135292%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135292/600 saved to cache
2026-03-29 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9edc33d7-192a-5fcd-8823-b4e8eb0a8391
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c84890>
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX24YZN%252F699135329%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135329/600 saved to cache
2026-03-29 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9edc33d7-192a-5fcd-8823-b4e8eb0a8391
2026-03-29 22:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188876/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV13MWG/42809444?sv=2020-08-04&st=2026-03-29T22%3A03%3A47Z&se=2026-03-29T22%3A28%3A47Z&sr=b&sp=r&sig=ez2ghwDEfe5r9Au1DGHEHNI79cn1%2F7NorIDKWocec04%3D)
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699180434%27 HTTP/1.1" 200 None
2026-03-29 22:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180434 not downloaded yet
2026-03-29 22:04:01 [bca.uk] INFO: Found listing with ID: GL09%20EWC
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL09%2520EWC%27 HTTP/1.1" 200 None
2026-03-29 22:04:01 [bca.uk] INFO: Scrape type for GL09%20EWC: 0
2026-03-29 22:04:01 [bca.uk] INFO: Found listing with ID: HD56%20FNE
2026-03-29 22:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD56%2520FNE%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for HD56%20FNE: 0
2026-03-29 22:04:02 [bca.uk] INFO: Found listing with ID: LV53%20KDO
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV53%2520KDO%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for LV53%20KDO: 0
2026-03-29 22:04:02 [bca.uk] INFO: Found listing with ID: OY05%20LPJ
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY05%2520LPJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for OY05%20LPJ: 0
2026-03-29 22:04:02 [bca.uk] INFO: Found listing with ID: RO09%20VDN
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO09%2520VDN%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for RO09%20VDN: 0
2026-03-29 22:04:02 [bca.uk] INFO: Found listing with ID: SB07%20CVZ
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB07%2520CVZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for SB07%20CVZ: 0
2026-03-29 22:04:02 [bca.uk] INFO: Found listing with ID: SL54%20XRG
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL54%2520XRG%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for SL54%20XRG: 0
2026-03-29 22:04:02 [bca.uk] INFO: Found listing with ID: YT58%20MMV
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT58%2520MMV%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for YT58%20MMV: 0
2026-03-29 22:04:02 [bca.uk] INFO: Found listing with ID: GD06%20HEV
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD06%2520HEV%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for GD06%20HEV: 0
2026-03-29 22:04:02 [bca.uk] INFO: Found listing with ID: KW19%20XMZ
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW19%2520XMZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for KW19%20XMZ: 0
2026-03-29 22:04:02 [bca.uk] INFO: Found listing with ID: FE70%20MZU
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE70%2520MZU%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for FE70%20MZU: 0
2026-03-29 22:04:02 [bca.uk] INFO: Found listing with ID: AF11%20YLP
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF11%2520YLP%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for AF11%20YLP: 0
2026-03-29 22:04:02 [bca.uk] INFO: Found listing with ID: FN67%20DOU
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN67%2520DOU%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for FN67%20DOU: 0
2026-03-29 22:04:02 [bca.uk] INFO: Found listing with ID: YJ14%20XFY
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ14%2520XFY%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for YJ14%20XFY: 2
2026-03-29 22:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f85b9ee5-11fe-5d79-b648-fd7fc6b3aaef with identifier: YJ14%20XFY
2026-03-29 22:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f85b9ee5-11fe-5d79-b648-fd7fc6b3aaef with scrape type 2
2026-03-29 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f85b9ee5-11fe-5d79-b648-fd7fc6b3aaef with scrape type 2
2026-03-29 22:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f85b9ee5-11fe-5d79-b648-fd7fc6b3aaef, identifier: YJ14%20XFY
2026-03-29 22:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135343/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX24YZN/42810399?sv=2020-08-04&st=2026-03-29T22%3A03%3A46Z&se=2026-03-29T22%3A28%3A46Z&sr=b&sp=r&sig=8e9SBxRll69R6BfeEYHqMucX3PZJ0l%2BWAH9PpY%2B%2Bjlo%3D)
2026-03-29 22:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f85b9ee5-11fe-5d79-b648-fd7fc6b3aaef with identifier: YJ14%20XFY
2026-03-29 22:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f85b9ee5-11fe-5d79-b648-fd7fc6b3aaef with identifier: YJ14%20XFY
2026-03-29 22:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f85b9ee5-11fe-5d79-b648-fd7fc6b3aaef with identifier: YJ14%20XFY to the API
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YJ14%20XFY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f85b9ee5-11fe-5d79-b648-fd7fc6b3aaef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YJ14 XFY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YJ14%20XFY&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'BMW',
'model': '118D',
'odometer': 73073,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'BMW 118D 2.0 SPORT Hatchback',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WBA1E12030J793066',
'year': 2014}
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ14%2520XFY%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Saving data for YJ14%20XFY: {'auction_closing_time': 1774864800.0, 'created_time': 1774523355.834103, 'last_price_update_time': 1774821842.629475}
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YJ14%2520XFY') HTTP/1.1" 204 0
2026-03-29 22:04:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575375/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575375>
2026-03-29 22:04:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427884/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427884>
2026-03-29 22:04:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180351/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180351>
2026-03-29 22:04:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427824/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427824>
2026-03-29 22:04:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180360/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180360>
2026-03-29 22:04:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180342/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180342>
2026-03-29 22:04:02 [bca.uk] INFO: Found listing with ID: HY59%20WKU
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY59%2520WKU%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for HY59%20WKU: 0
2026-03-29 22:04:02 [bca.uk] INFO: Found listing with ID: KE13%20UGJ
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE13%2520UGJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for KE13%20UGJ: 0
2026-03-29 22:04:02 [bca.uk] INFO: Found listing with ID: SG58%20EVK
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG58%2520EVK%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for SG58%20EVK: 0
2026-03-29 22:04:02 [bca.uk] INFO: Found listing with ID: NG62%20MFN
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG62%2520MFN%27 HTTP/1.1" 200 None
2026-03-29 22:04:02 [bca.uk] INFO: Scrape type for NG62%20MFN: 2
2026-03-29 22:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee540c51-cf33-581e-8fef-9e70457b2cad with identifier: NG62%20MFN
2026-03-29 22:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee540c51-cf33-581e-8fef-9e70457b2cad with scrape type 2
2026-03-29 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee540c51-cf33-581e-8fef-9e70457b2cad with scrape type 2
2026-03-29 22:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ee540c51-cf33-581e-8fef-9e70457b2cad, identifier: NG62%20MFN
2026-03-29 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617e1d90>
2026-03-29 22:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV13MWG%252F699188947%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188947/600 saved to cache
2026-03-29 22:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9da815d0-0890-5d46-9004-81239b502fc3
2026-03-29 22:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a51190>
2026-03-29 22:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX24YZN%252F699135189%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135189/600 saved to cache
2026-03-29 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9edc33d7-192a-5fcd-8823-b4e8eb0a8391
2026-03-29 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61701e10>
2026-03-29 22:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV13MWG%252F699188962%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188962/600 saved to cache
2026-03-29 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9da815d0-0890-5d46-9004-81239b502fc3
2026-03-29 22:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180383/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180383>
2026-03-29 22:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ee540c51-cf33-581e-8fef-9e70457b2cad with identifier: NG62%20MFN
2026-03-29 22:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ee540c51-cf33-581e-8fef-9e70457b2cad with identifier: NG62%20MFN
2026-03-29 22:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ee540c51-cf33-581e-8fef-9e70457b2cad with identifier: NG62%20MFN to the API
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 157,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NG62%20MFN-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ee540c51-cf33-581e-8fef-9e70457b2cad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NG62 MFN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NG62%20MFN&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'ZAFIRA',
'odometer': 90477,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL ZAFIRA 1.6 VVT 115 EXCLUSIV MPV',
'transmission': 'manual',
'trim': 'VVT 115 EXCLUSIV',
'vin': 'W0L0AHM75D2051706',
'year': 2013}
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG62%2520MFN%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Saving data for NG62%20MFN: {'auction_closing_time': 1774864800.0, 'created_time': 1774706899.393682, 'last_price_update_time': 1774821843.379919}
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NG62%2520MFN') HTTP/1.1" 204 0
2026-03-29 22:04:03 [bca.uk] INFO: Found listing with ID: S400%20SSK
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S400%2520SSK%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Scrape type for S400%20SSK: 0
2026-03-29 22:04:03 [bca.uk] INFO: Found listing with ID: LL10%20KTP
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL10%2520KTP%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Scrape type for LL10%20KTP: 0
2026-03-29 22:04:03 [bca.uk] INFO: Found listing with ID: RJ58%20WUW
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ58%2520WUW%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Scrape type for RJ58%20WUW: 0
2026-03-29 22:04:03 [bca.uk] INFO: Found listing with ID: VK14%20JXE
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK14%2520JXE%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Scrape type for VK14%20JXE: 0
2026-03-29 22:04:03 [bca.uk] INFO: Found listing with ID: WF60%20ULP
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF60%2520ULP%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Scrape type for WF60%20ULP: 0
2026-03-29 22:04:03 [bca.uk] INFO: Found listing with ID: WP62%20RZJ
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP62%2520RZJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Scrape type for WP62%20RZJ: 0
2026-03-29 22:04:03 [bca.uk] INFO: Found listing with ID: YH08%20ZBP
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH08%2520ZBP%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Scrape type for YH08%20ZBP: 0
2026-03-29 22:04:03 [bca.uk] INFO: Found listing with ID: YH09%20BCO
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH09%2520BCO%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Scrape type for YH09%20BCO: 0
2026-03-29 22:04:03 [bca.uk] INFO: Found listing with ID: YK09%20KYA
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK09%2520KYA%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Scrape type for YK09%20KYA: 0
2026-03-29 22:04:03 [bca.uk] INFO: Found listing with ID: BT12%20TZY
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT12%2520TZY%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Scrape type for BT12%20TZY: 0
2026-03-29 22:04:03 [bca.uk] INFO: Found listing with ID: EN16%20TPV
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN16%2520TPV%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Scrape type for EN16%20TPV: 0
2026-03-29 22:04:03 [bca.uk] INFO: Found listing with ID: FH13%20ELV
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH13%2520ELV%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Scrape type for FH13%20ELV: 0
2026-03-29 22:04:03 [bca.uk] INFO: Found listing with ID: FP10%20JNX
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP10%2520JNX%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Scrape type for FP10%20JNX: 0
2026-03-29 22:04:03 [bca.uk] INFO: Found listing with ID: KM66%20FHL
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM66%2520FHL%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Scrape type for KM66%20FHL: 0
2026-03-29 22:04:03 [bca.uk] INFO: Found listing with ID: KR63%20ZRG
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR63%2520ZRG%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Scrape type for KR63%20ZRG: 0
2026-03-29 22:04:03 [bca.uk] INFO: Found listing with ID: MF10%20UFT
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF10%2520UFT%27 HTTP/1.1" 200 None
2026-03-29 22:04:03 [bca.uk] INFO: Scrape type for MF10%20UFT: 2
2026-03-29 22:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65110073-fd7d-5e60-a00d-1c442f744d6e with identifier: MF10%20UFT
2026-03-29 22:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65110073-fd7d-5e60-a00d-1c442f744d6e with scrape type 2
2026-03-29 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65110073-fd7d-5e60-a00d-1c442f744d6e with scrape type 2
2026-03-29 22:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 65110073-fd7d-5e60-a00d-1c442f744d6e, identifier: MF10%20UFT
2026-03-29 22:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6197fad0>
2026-03-29 22:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV13MWG%252F699188876%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188876/600 saved to cache
2026-03-29 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9da815d0-0890-5d46-9004-81239b502fc3
2026-03-29 22:04:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9da815d0-0890-5d46-9004-81239b502fc3, skipping ID generation
2026-03-29 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9da815d0-0890-5d46-9004-81239b502fc3 sending to next pipeline
2026-03-29 22:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9da815d0-0890-5d46-9004-81239b502fc3, identifier: HV13%20MWG
2026-03-29 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621d3590>
2026-03-29 22:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX24YZN%252F699135343%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135343/600 saved to cache
2026-03-29 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9edc33d7-192a-5fcd-8823-b4e8eb0a8391
2026-03-29 22:04:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9edc33d7-192a-5fcd-8823-b4e8eb0a8391, skipping ID generation
2026-03-29 22:04:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9edc33d7-192a-5fcd-8823-b4e8eb0a8391 sending to next pipeline
2026-03-29 22:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9edc33d7-192a-5fcd-8823-b4e8eb0a8391, identifier: RX24%20YZN
2026-03-29 22:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180333/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FHZ1603/42805791?sv=2020-08-04&st=2026-03-29T22%3A03%3A51Z&se=2026-03-29T22%3A28%3A51Z&sr=b&sp=r&sig=Qo7fOtclp9X7inziZuofC2kPLk5w0PoXJfJGKaWDDkM%3D)
2026-03-29 22:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180325/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FHZ1603/42805791?sv=2020-08-04&st=2026-03-29T22%3A03%3A51Z&se=2026-03-29T22%3A28%3A51Z&sr=b&sp=r&sig=Qo7fOtclp9X7inziZuofC2kPLk5w0PoXJfJGKaWDDkM%3D)
2026-03-29 22:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411573/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE19AAK/42812078?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=MkdK1ykhsLQ%2B%2F2n1Irxn7evFumHYKKFZXmkQdpd8KgM%3D)
2026-03-29 22:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180413/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180413>
2026-03-29 22:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180396/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180396>
2026-03-29 22:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 65110073-fd7d-5e60-a00d-1c442f744d6e with identifier: MF10%20UFT
2026-03-29 22:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 65110073-fd7d-5e60-a00d-1c442f744d6e with identifier: MF10%20UFT
2026-03-29 22:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 65110073-fd7d-5e60-a00d-1c442f744d6e with identifier: MF10%20UFT to the API
2026-03-29 22:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF10%20UFT-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '65110073-fd7d-5e60-a00d-1c442f744d6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF10 UFT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF10%20UFT&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 93805,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 VVT 115 LIFE Hatchback',
'transmission': 'manual',
'trim': 'VVT 115 LIFE',
'vin': 'W0L0AHL48A2075425',
'year': 2010}
2026-03-29 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF10%2520UFT%27 HTTP/1.1" 200 None
2026-03-29 22:04:04 [bca.uk] INFO: Saving data for MF10%20UFT: {'auction_closing_time': 1774864800.0, 'created_time': 1774524473.166399, 'last_price_update_time': 1774821844.38873}
2026-03-29 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF10%2520UFT') HTTP/1.1" 204 0
2026-03-29 22:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9da815d0-0890-5d46-9004-81239b502fc3 with identifier: HV13%20MWG
2026-03-29 22:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9da815d0-0890-5d46-9004-81239b502fc3 with identifier: HV13%20MWG
2026-03-29 22:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9da815d0-0890-5d46-9004-81239b502fc3 with identifier: HV13%20MWG to the API
2026-03-29 22:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188876/600>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_expert_report_file_0526dcd4-f15c-4457-9de7-7b2ac4d97226.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV13%20MWG-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9da815d0-0890-5d46-9004-81239b502fc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV13 MWG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV13%20MWG&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 77344,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42199,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188866/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42992,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188876/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42082,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188882/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43036,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188892/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40420,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188899/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40015,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188907/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75408,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188920/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72731,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188934/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75777,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188947/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da815d0-0890-5d46-9004-81239b502fc3/9da815d0-0890-5d46-9004-81239b502fc3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80952,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV13MWG/699188962/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TDCI 115 ZETEC S Hatchback',
'transmission': 'manual',
'trim': 'TDCI 115 ZETEC S',
'vin': 'WF0KXXGCBKDJ52564',
'year': 2013}
2026-03-29 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV13%2520MWG%27 HTTP/1.1" 200 None
2026-03-29 22:04:04 [bca.uk] INFO: Saving data for HV13%20MWG: {'created_time': 1774821844.866184, 'last_price_update_time': 1774821844.866196, 'auction_closing_time': 1775210400.0}
2026-03-29 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV13%2520MWG') HTTP/1.1" 204 0
2026-03-29 22:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9edc33d7-192a-5fcd-8823-b4e8eb0a8391 with identifier: RX24%20YZN
2026-03-29 22:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9edc33d7-192a-5fcd-8823-b4e8eb0a8391 with identifier: RX24%20YZN
2026-03-29 22:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9edc33d7-192a-5fcd-8823-b4e8eb0a8391 with identifier: RX24%20YZN to the API
2026-03-29 22:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135343/600>
{'auction_title': '',
'c_o_2_emission_value': 16,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_expert_report_file_75757f6d-e5d6-4343-96e7-c2dd648b2cf1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RX24%20YZN-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '9edc33d7-192a-5fcd-8823-b4e8eb0a8391',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RX24 YZN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RX24%20YZN&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 18203,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47648,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135170/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43709,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135189/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42899,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135203/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45151,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135228/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42567,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135245/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39474,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135260/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64154,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135279/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68636,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135292/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76113,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135329/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9edc33d7-192a-5fcd-8823-b4e8eb0a8391/9edc33d7-192a-5fcd-8823-b4e8eb0a8391_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68028,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX24YZN/699135343/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 P460E DYNAMIC SE StationWagon',
'transmission': 'automatic',
'trim': 'P460E DYNAMIC SE',
'vin': 'SAL1A2A46RA195939',
'year': 2024}
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX24%2520YZN%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Saving data for RX24%20YZN: {'created_time': 1774821845.26603, 'last_price_update_time': 1774821845.266041, 'auction_closing_time': 1775124000.0}
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RX24%2520YZN') HTTP/1.1" 204 0
2026-03-29 22:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430208/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA16ETX/42812131?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=67cSoD7yDAcPlVUXb6MtFxB8b%2F%2B%2FHPzK%2FRcqJHz%2FIwo%3D)
2026-03-29 22:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430264/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19VSX/42812111?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=qlSeQUbf83xHqWfD9mYZ2SCAALVwdddlxYHgmUNU2tY%3D)
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: MF13%20KTU
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF13%2520KTU%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Scrape type for MF13%20KTU: 0
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: OW19%20EHY
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW19%2520EHY%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Scrape type for OW19%20EHY: 0
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: DA68%20MVY
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA68%2520MVY%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Scrape type for DA68%20MVY: 0
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: DA69%20FGU
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA69%2520FGU%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Scrape type for DA69%20FGU: 0
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: ST59%20MKN
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST59%2520MKN%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Scrape type for ST59%20MKN: 2
2026-03-29 22:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72cdde96-e9b7-5650-a0c3-4625bb35dd6e with identifier: ST59%20MKN
2026-03-29 22:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72cdde96-e9b7-5650-a0c3-4625bb35dd6e with scrape type 2
2026-03-29 22:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72cdde96-e9b7-5650-a0c3-4625bb35dd6e with scrape type 2
2026-03-29 22:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 72cdde96-e9b7-5650-a0c3-4625bb35dd6e, identifier: ST59%20MKN
2026-03-29 22:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180342/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FHZ1603/42805791?sv=2020-08-04&st=2026-03-29T22%3A03%3A51Z&se=2026-03-29T22%3A28%3A51Z&sr=b&sp=r&sig=Qo7fOtclp9X7inziZuofC2kPLk5w0PoXJfJGKaWDDkM%3D)
2026-03-29 22:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 72cdde96-e9b7-5650-a0c3-4625bb35dd6e with identifier: ST59%20MKN
2026-03-29 22:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 72cdde96-e9b7-5650-a0c3-4625bb35dd6e with identifier: ST59%20MKN
2026-03-29 22:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 72cdde96-e9b7-5650-a0c3-4625bb35dd6e with identifier: ST59%20MKN to the API
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ST59%20MKN-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '72cdde96-e9b7-5650-a0c3-4625bb35dd6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ST59 MKN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ST59%20MKN&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 1,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'KIA PICANTO 1.0 1 Hatchback',
'transmission': 'manual',
'trim': '1',
'vin': 'KNABF514LAT859341',
'year': 2009}
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST59%2520MKN%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Saving data for ST59%20MKN: {'auction_closing_time': 1774864800.0, 'created_time': 1774735432.53366, 'last_price_update_time': 1774821845.780448}
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ST59%2520MKN') HTTP/1.1" 204 0
2026-03-29 22:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180360/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FHZ1603/42805791?sv=2020-08-04&st=2026-03-29T22%3A03%3A51Z&se=2026-03-29T22%3A28%3A51Z&sr=b&sp=r&sig=Qo7fOtclp9X7inziZuofC2kPLk5w0PoXJfJGKaWDDkM%3D)
2026-03-29 22:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180351/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FHZ1603/42805791?sv=2020-08-04&st=2026-03-29T22%3A03%3A51Z&se=2026-03-29T22%3A28%3A51Z&sr=b&sp=r&sig=Qo7fOtclp9X7inziZuofC2kPLk5w0PoXJfJGKaWDDkM%3D)
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: KS65%20YFC
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS65%2520YFC%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Scrape type for KS65%20YFC: 0
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: PX64%20PPV
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX64%2520PPV%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Scrape type for PX64%20PPV: 0
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: MK61%20AVT
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK61%2520AVT%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Scrape type for MK61%20AVT: 0
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: PL57%20OVV
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL57%2520OVV%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Scrape type for PL57%20OVV: 0
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: PNZ%205710
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PNZ%25205710%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Scrape type for PNZ%205710: 0
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: YK17%20VSR
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK17%2520VSR%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Scrape type for YK17%20VSR: 0
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: KE18%20FBA
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE18%2520FBA%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Scrape type for KE18%20FBA: 0
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: YH19%20RZP
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH19%2520RZP%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Scrape type for YH19%20RZP: 0
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: FH18%20LKJ
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH18%2520LKJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Scrape type for FH18%20LKJ: 0
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: HV54%20YKM
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV54%2520YKM%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Scrape type for HV54%20YKM: 0
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: SJ63%20LCL
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ63%2520LCL%27 HTTP/1.1" 200 None
2026-03-29 22:04:05 [bca.uk] INFO: Scrape type for SJ63%20LCL: 0
2026-03-29 22:04:05 [bca.uk] INFO: Found listing with ID: R14%20KJJ
2026-03-29 22:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27R14%2520KJJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for R14%20KJJ: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: FT07%20BTO
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT07%2520BTO%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for FT07%20BTO: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: AP08%20SUO
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP08%2520SUO%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for AP08%20SUO: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: TF07%20BRH
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27TF07%2520BRH%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for TF07%20BRH: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: ML59%20FAF
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML59%2520FAF%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for ML59%20FAF: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: KR09%20KHB
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR09%2520KHB%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for KR09%20KHB: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: AE15%20EEH
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE15%2520EEH%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for AE15%20EEH: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: GV08%20OCN
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV08%2520OCN%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for GV08%20OCN: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: MT64%20LPP
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT64%2520LPP%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for MT64%20LPP: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: AF71%20UVS
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF71%2520UVS%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for AF71%20UVS: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: EF11%20ZLX
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF11%2520ZLX%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for EF11%20ZLX: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: WK62%20YZD
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK62%2520YZD%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for WK62%20YZD: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: WP64%20YCG
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP64%2520YCG%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for WP64%20YCG: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: SM16%20PGO
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM16%2520PGO%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for SM16%20PGO: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: MM63%20JRX
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM63%2520JRX%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for MM63%20JRX: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: FV14%20KTC
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV14%2520KTC%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for FV14%20KTC: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: JG03%20DAV
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JG03%2520DAV%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for JG03%20DAV: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: DU12%20ETF
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU12%2520ETF%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for DU12%20ETF: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: CV15%20WKS
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV15%2520WKS%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for CV15%20WKS: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: GK65%20ONX
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK65%2520ONX%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for GK65%20ONX: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: EA64%20EGV
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA64%2520EGV%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for EA64%20EGV: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: AK12%20UEF
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK12%2520UEF%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for AK12%20UEF: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: GU69%20EBF
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU69%2520EBF%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for GU69%20EBF: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: MT61%20GBE
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT61%2520GBE%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for MT61%20GBE: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: KR12%20BZX
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR12%2520BZX%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for KR12%20BZX: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: Y403%20CAV
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y403%2520CAV%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for Y403%20CAV: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: HT68%20DTX
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT68%2520DTX%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for HT68%20DTX: 0
2026-03-29 22:04:06 [bca.uk] INFO: Found listing with ID: YC68%20JHG
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC68%2520JHG%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Scrape type for YC68%20JHG: 2
2026-03-29 22:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62231db9-9d42-5db8-86e2-59b28a2c0f29 with identifier: YC68%20JHG
2026-03-29 22:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62231db9-9d42-5db8-86e2-59b28a2c0f29 with scrape type 2
2026-03-29 22:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62231db9-9d42-5db8-86e2-59b28a2c0f29 with scrape type 2
2026-03-29 22:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 62231db9-9d42-5db8-86e2-59b28a2c0f29, identifier: YC68%20JHG
2026-03-29 22:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575375/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/P17LPT/42573216?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Cei94j6xTuVsYVAtMEIEaOIhWn8jpASCTY7XqjpVl64%3D)
2026-03-29 22:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427824/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE20EVL/42811999?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=QNaGwsE1HTKndyV7dS5jfLI1ozyFJBkYcrsiWmkuv8k%3D)
2026-03-29 22:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427884/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19VXX/42812304?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=YzGWBhkemG5tXMwAwvYpsWX0bEfwiTWFoG%2FIuzQzr2c%3D)
2026-03-29 22:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 62231db9-9d42-5db8-86e2-59b28a2c0f29 with identifier: YC68%20JHG
2026-03-29 22:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 62231db9-9d42-5db8-86e2-59b28a2c0f29 with identifier: YC68%20JHG
2026-03-29 22:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 62231db9-9d42-5db8-86e2-59b28a2c0f29 with identifier: YC68%20JHG to the API
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC68%20JHG-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '62231db9-9d42-5db8-86e2-59b28a2c0f29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC68 JHG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC68%20JHG&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': '730D',
'odometer': 51950,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW 730D 3.0 M SPORT Saloon',
'transmission': 'automatic',
'trim': 'M SPORT',
'vin': 'WBA7C22080B205761',
'year': 2019}
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC68%2520JHG%27 HTTP/1.1" 200 None
2026-03-29 22:04:06 [bca.uk] INFO: Saving data for YC68%20JHG: {'auction_closing_time': 1774864800.0, 'created_time': 1773844746.577514, 'last_price_update_time': 1774821846.920677}
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC68%2520JHG') HTTP/1.1" 204 0
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611cb010>
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFHZ1603%252F699180333%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180333/600 saved to cache
2026-03-29 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96a01409-506c-5e89-901d-52d468f35eff
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6198ed50>
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFHZ1603%252F699180325%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180325/600 saved to cache
2026-03-29 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96a01409-506c-5e89-901d-52d468f35eff
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61965910>
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE19AAK%252F699411573%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411573/600 saved to cache
2026-03-29 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff522792-d041-5ecb-b231-8bf72c190c1e
2026-03-29 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6164e150>
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA16ETX%252F699430208%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430208/600 saved to cache
2026-03-29 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6398c60-fe63-5a45-a148-79cf4bf62bcf
2026-03-29 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614e1250>
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19VSX%252F699430264%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430264/600 saved to cache
2026-03-29 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 732664ff-2041-53f2-83f7-e4a6aeaa1df2
2026-03-29 22:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180434/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180434>
2026-03-29 22:04:07 [bca.uk] INFO: Found listing with ID: W722%20VUA
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27W722%2520VUA%27 HTTP/1.1" 200 None
2026-03-29 22:04:07 [bca.uk] INFO: Scrape type for W722%20VUA: 1
2026-03-29 22:04:07 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-29 22:04:07 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-29 22:04:07 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-29 22:04:07 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-29 22:04:07 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-29 22:04:07 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-29 22:04:07 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-29 22:04:07 [scrapy.core.scraper] ERROR: Spider error processing <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search)
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
yield await it.__anext__()
^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
return await self.data.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
async for o in as_async_generator(it):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
async for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
return await self.data.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
async for o in as_async_generator(it):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
async for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
async for item_or_request in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-29 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180396/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FHZ1603/42805791?sv=2020-08-04&st=2026-03-29T22%3A03%3A51Z&se=2026-03-29T22%3A28%3A51Z&sr=b&sp=r&sig=Qo7fOtclp9X7inziZuofC2kPLk5w0PoXJfJGKaWDDkM%3D)
2026-03-29 22:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180383/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FHZ1603/42805791?sv=2020-08-04&st=2026-03-29T22%3A03%3A51Z&se=2026-03-29T22%3A28%3A51Z&sr=b&sp=r&sig=Qo7fOtclp9X7inziZuofC2kPLk5w0PoXJfJGKaWDDkM%3D)
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac697ede90>
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFHZ1603%252F699180342%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180342/600 saved to cache
2026-03-29 22:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96a01409-506c-5e89-901d-52d468f35eff
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61876f90>
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFHZ1603%252F699180360%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180360/600 saved to cache
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96a01409-506c-5e89-901d-52d468f35eff
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6352ce10>
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFHZ1603%252F699180351%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180351/600 saved to cache
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96a01409-506c-5e89-901d-52d468f35eff
2026-03-29 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406369/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406369>
2026-03-29 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699415028/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699415028>
2026-03-29 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411810/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411810>
2026-03-29 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180367/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699180367>
2026-03-29 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180413/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FHZ1603/42805791?sv=2020-08-04&st=2026-03-29T22%3A03%3A51Z&se=2026-03-29T22%3A28%3A51Z&sr=b&sp=r&sig=Qo7fOtclp9X7inziZuofC2kPLk5w0PoXJfJGKaWDDkM%3D)
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6194df50>
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FP17LPT%252F686575375%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575375/600 saved to cache
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637adc10>
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE20EVL%252F699427824%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427824/600 saved to cache
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b145ed4d-e096-5329-b7ec-7396067fba60
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61afca90>
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19VXX%252F699427884%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427884/600 saved to cache
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 553a9526-308c-5e9f-97f5-1bce769f99d7
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6199b510>
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFHZ1603%252F699180396%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180396/600 saved to cache
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96a01409-506c-5e89-901d-52d468f35eff
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61903150>
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFHZ1603%252F699180383%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180383/600 saved to cache
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96a01409-506c-5e89-901d-52d468f35eff
2026-03-29 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411760/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411760>
2026-03-29 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409268/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409268>
2026-03-29 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040129/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040129>
2026-03-29 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406274/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406274>
2026-03-29 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435139/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435139>
2026-03-29 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409219/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409219>
2026-03-29 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE12RTO/42798205?sv=2020-08-04&st=2026-03-29T22%3A04%3A08Z&se=2026-03-29T22%3A29%3A08Z&sr=b&sp=r&sig=P6g2kdlkhPFl1fuxArrHgwr0hemJKOexpKc32gFHrGE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YE12%20RTO-GB>
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621f4e90>
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFHZ1603%252F699180413%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180413/600 saved to cache
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96a01409-506c-5e89-901d-52d468f35eff
2026-03-29 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180434/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FHZ1603/42805791?sv=2020-08-04&st=2026-03-29T22%3A03%3A51Z&se=2026-03-29T22%3A28%3A51Z&sr=b&sp=r&sig=Qo7fOtclp9X7inziZuofC2kPLk5w0PoXJfJGKaWDDkM%3D)
2026-03-29 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180367/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FHZ1603/42805791?sv=2020-08-04&st=2026-03-29T22%3A03%3A51Z&se=2026-03-29T22%3A28%3A51Z&sr=b&sp=r&sig=Qo7fOtclp9X7inziZuofC2kPLk5w0PoXJfJGKaWDDkM%3D)
2026-03-29 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430239/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430239>
2026-03-29 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430174/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430174>
2026-03-29 22:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411557/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411557>
2026-03-29 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406369/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG69FWY/42811982?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=iIU0ZFwxCrfo9iR2T7l%2BEKiHBXHpV%2FjhvFuNPQMcBwU%3D)
2026-03-29 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699415028/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ72FOT/42812096?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=F1eqEFipUoySPGKOeLKkFyyLLItl9dJbMFy96XQcSRY%3D)
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a0b550>
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFHZ1603%252F699180434%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180434/600 saved to cache
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96a01409-506c-5e89-901d-52d468f35eff
2026-03-29 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040129/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70YYW/42571204?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=3YETERDVJsfcYf9zoGQQnS8MvGAFRjTT6qcrLaHjjZg%3D)
2026-03-29 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409219/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE18CHX/42812000?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=oyBRp8qHoowbCW9kieY0zUV46IZNjY3FwR8NKuxfaxo%3D)
2026-03-29 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411810/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML23KNX/42812081?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Ysjf2AWU3A%2B%2BhkZ4EdoIgPpKhCyN1a54UPjPwLBr1pc%3D)
2026-03-29 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435139/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS68PYY/42812178?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=ilxdzGsr4IgRZDvqZmWhurm4pGkLnzxS3s4veY%2BdCjs%3D)
2026-03-29 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406274/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LA70NPE/42811995?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=1ymICcEKrtpKHFHLQTc1yKaMMeniIFUDVOMDF5neyAs%3D)
2026-03-29 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409268/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PA19DCO/42811984?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=5dad8F2568bHOl2s5RwggeSpVONMrl6yr8ByaoDJDOc%3D)
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61185750>
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFHZ1603%252F699180367%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180367/600 saved to cache
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96a01409-506c-5e89-901d-52d468f35eff
2026-03-29 22:04:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96a01409-506c-5e89-901d-52d468f35eff, skipping ID generation
2026-03-29 22:04:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96a01409-506c-5e89-901d-52d468f35eff sending to next pipeline
2026-03-29 22:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 96a01409-506c-5e89-901d-52d468f35eff, identifier: FHZ%201603
2026-03-29 22:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE12RTO/42798205?sv=2020-08-04&st=2026-03-29T22%3A04%3A08Z&se=2026-03-29T22%3A29%3A08Z&sr=b&sp=r&sig=P6g2kdlkhPFl1fuxArrHgwr0hemJKOexpKc32gFHrGE%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 96a01409-506c-5e89-901d-52d468f35eff with identifier: FHZ%201603
2026-03-29 22:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 96a01409-506c-5e89-901d-52d468f35eff with identifier: FHZ%201603
2026-03-29 22:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 96a01409-506c-5e89-901d-52d468f35eff with identifier: FHZ%201603 to the API
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180367/600>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_expert_report_file_9aae6906-044d-436b-a39f-69a4e74e8a23.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FHZ%201603-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': '96a01409-506c-5e89-901d-52d468f35eff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FHZ 1603',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FHZ%201603&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'C-MAX',
'odometer': 104521,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41260,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180325/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41463,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180333/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38882,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180342/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39512,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180351/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38575,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180360/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37673,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180367/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75531,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180383/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78952,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180396/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85480,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180413/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a01409-506c-5e89-901d-52d468f35eff/96a01409-506c-5e89-901d-52d468f35eff_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84353,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FHZ1603/699180434/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'FORD C-MAX 1.8 TITANIUM MPV',
'transmission': 'manual',
'trim': 'TITANIUM',
'vin': 'WF0EXXGCDE8T17467',
'year': 2009}
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FHZ%25201603%27 HTTP/1.1" 200 None
2026-03-29 22:04:09 [bca.uk] INFO: Saving data for FHZ%201603: {'created_time': 1774821849.038199, 'last_price_update_time': 1774821849.038208, 'auction_closing_time': 1775210400.0}
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FHZ%25201603') HTTP/1.1" 204 0
2026-03-29 22:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430239/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19VSX/42812111?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=qlSeQUbf83xHqWfD9mYZ2SCAALVwdddlxYHgmUNU2tY%3D)
2026-03-29 22:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411557/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE19AAK/42812078?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=MkdK1ykhsLQ%2B%2F2n1Irxn7evFumHYKKFZXmkQdpd8KgM%3D)
2026-03-29 22:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430174/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA16ETX/42812131?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=67cSoD7yDAcPlVUXb6MtFxB8b%2F%2B%2FHPzK%2FRcqJHz%2FIwo%3D)
2026-03-29 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575365/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575365>
2026-03-29 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427805/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427805>
2026-03-29 22:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411760/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP65LKN/42812099?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=YYiddic%2BqcqY2M0XPOfW0%2FrAPtac9opCHs6%2B5ikpuFw%3D)
2026-03-29 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427864/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427864>
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61568290>
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG69FWY%252F699406369%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406369/600 saved to cache
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 23673480-b7c5-5707-903a-2783d4797f75
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62104150>
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ72FOT%252F699415028%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699415028/600 saved to cache
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6207a390>
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70YYW%252F699040129%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040129/600 saved to cache
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01b57636-ffd9-585f-9b00-e6ae7dbcc329
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620ef710>
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE18CHX%252F699409219%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409219/600 saved to cache
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62107e90>
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML23KNX%252F699411810%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411810/600 saved to cache
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c96e7ad0-7cd4-5ea7-b41d-642972a2bf14
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6368ef50>
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS68PYY%252F699435139%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435139/600 saved to cache
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61702450>
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLA70NPE%252F699406274%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406274/600 saved to cache
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4838ed0-a1bc-555f-ae17-73d79e29d1ac
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69970850>
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPA19DCO%252F699409268%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409268/600 saved to cache
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da397772-3003-5876-84de-18e19f2e1e0e
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6207ad90>
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_expert_report_file_c80c6993-41c1-4e42-a8ba-f650785e4f2b.pdf HTTP/1.1" 201 0
2026-03-29 22:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 330dee78-6fed-57ea-9152-2e616c79bf32
2026-03-29 22:04:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 330dee78-6fed-57ea-9152-2e616c79bf32, skipping ID generation
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 330dee78-6fed-57ea-9152-2e616c79bf32
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYE12RTO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YE12RTO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040111/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040111>
2026-03-29 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409249/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409249>
2026-03-29 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411748/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411748>
2026-03-29 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414996/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414996>
2026-03-29 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406346/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406346>
2026-03-29 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406258/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406258>
2026-03-29 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411791/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411791>
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455420%27 HTTP/1.1" 200 None
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455420 not downloaded yet
2026-03-29 22:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427864/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19VXX/42812304?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=YzGWBhkemG5tXMwAwvYpsWX0bEfwiTWFoG%2FIuzQzr2c%3D)
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6219e090>
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19VSX%252F699430239%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430239/600 saved to cache
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 732664ff-2041-53f2-83f7-e4a6aeaa1df2
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615c8450>
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE19AAK%252F699411557%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411557/600 saved to cache
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff522792-d041-5ecb-b231-8bf72c190c1e
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615c9c90>
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA16ETX%252F699430174%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430174/600 saved to cache
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6398c60-fe63-5a45-a148-79cf4bf62bcf
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62247410>
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP65LKN%252F699411760%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411760/600 saved to cache
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6062366a-77b0-5b3c-aa23-49414d769971
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455429%27 HTTP/1.1" 200 None
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455429 not downloaded yet
2026-03-29 22:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455438%27 HTTP/1.1" 200 None
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455438 not downloaded yet
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637d2010>
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19VXX%252F699427864%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427864/600 saved to cache
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 553a9526-308c-5e9f-97f5-1bce769f99d7
2026-03-29 22:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575365/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/P17LPT/42573216?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Cei94j6xTuVsYVAtMEIEaOIhWn8jpASCTY7XqjpVl64%3D)
2026-03-29 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411531/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411531>
2026-03-29 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435131/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435131>
2026-03-29 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409206/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409206>
2026-03-29 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430221/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430221>
2026-03-29 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430155/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430155>
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455446%27 HTTP/1.1" 200 None
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455446 not downloaded yet
2026-03-29 22:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427805/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE20EVL/42811999?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=QNaGwsE1HTKndyV7dS5jfLI1ozyFJBkYcrsiWmkuv8k%3D)
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455455%27 HTTP/1.1" 200 None
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455455 not downloaded yet
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455469%27 HTTP/1.1" 200 None
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455469 not downloaded yet
2026-03-29 22:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411791/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML23KNX/42812081?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Ysjf2AWU3A%2B%2BhkZ4EdoIgPpKhCyN1a54UPjPwLBr1pc%3D)
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455487%27 HTTP/1.1" 200 None
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455487 not downloaded yet
2026-03-29 22:04:09 [bca.uk] INFO: Total items found: 100
2026-03-29 22:04:09 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded
2026-03-29 22:04:09 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:04:09 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406258/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LA70NPE/42811995?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=1ymICcEKrtpKHFHLQTc1yKaMMeniIFUDVOMDF5neyAs%3D)
2026-03-29 22:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040111/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70YYW/42571204?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=3YETERDVJsfcYf9zoGQQnS8MvGAFRjTT6qcrLaHjjZg%3D)
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455498%27 HTTP/1.1" 200 None
2026-03-29 22:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455498 not downloaded yet
2026-03-29 22:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455399/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YE12RTO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411748/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP65LKN/42812099?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=YYiddic%2BqcqY2M0XPOfW0%2FrAPtac9opCHs6%2B5ikpuFw%3D)
2026-03-29 22:04:09 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:04:09 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:04:09 [bca.uk] INFO: Found listing with ID: RX19%20EAW
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX19%2520EAW%27 HTTP/1.1" 200 None
2026-03-29 22:04:09 [bca.uk] INFO: Scrape type for RX19%20EAW: 1
2026-03-29 22:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6 with identifier: RX19%20EAW
2026-03-29 22:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6
2026-03-29 22:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406346/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG69FWY/42811982?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=iIU0ZFwxCrfo9iR2T7l%2BEKiHBXHpV%2FjhvFuNPQMcBwU%3D)
2026-03-29 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414996/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ72FOT/42812096?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=F1eqEFipUoySPGKOeLKkFyyLLItl9dJbMFy96XQcSRY%3D)
2026-03-29 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409249/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PA19DCO/42811984?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=5dad8F2568bHOl2s5RwggeSpVONMrl6yr8ByaoDJDOc%3D)
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455512%27 HTTP/1.1" 200 None
2026-03-29 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455512 not downloaded yet
2026-03-29 22:04:10 [bca.uk] INFO: Found listing with ID: FL68%20UZJ
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL68%2520UZJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:10 [bca.uk] INFO: Scrape type for FL68%20UZJ: 1
2026-03-29 22:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d329060a-a095-5b9c-880a-4e9dfce039e5 with identifier: FL68%20UZJ
2026-03-29 22:04:10 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d329060a-a095-5b9c-880a-4e9dfce039e5
2026-03-29 22:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455429/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455429>
2026-03-29 22:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620b4cd0>
2026-03-29 22:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FP17LPT%252F686575365%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575365/600 saved to cache
2026-03-29 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9
2026-03-29 22:04:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620a99d0>
2026-03-29 22:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE20EVL%252F699427805%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427805/600 saved to cache
2026-03-29 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b145ed4d-e096-5329-b7ec-7396067fba60
2026-03-29 22:04:10 [bca.uk] INFO: Found listing with ID: BK68%20GBV
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK68%2520GBV%27 HTTP/1.1" 200 None
2026-03-29 22:04:10 [bca.uk] INFO: Scrape type for BK68%20GBV: 2
2026-03-29 22:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22fa64cc-e970-5478-9955-9ad040fbd24e with identifier: BK68%20GBV
2026-03-29 22:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22fa64cc-e970-5478-9955-9ad040fbd24e with scrape type 2
2026-03-29 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22fa64cc-e970-5478-9955-9ad040fbd24e with scrape type 2
2026-03-29 22:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 22fa64cc-e970-5478-9955-9ad040fbd24e, identifier: BK68%20GBV
2026-03-29 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430155/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA16ETX/42812131?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=67cSoD7yDAcPlVUXb6MtFxB8b%2F%2B%2FHPzK%2FRcqJHz%2FIwo%3D)
2026-03-29 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430221/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19VSX/42812111?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=qlSeQUbf83xHqWfD9mYZ2SCAALVwdddlxYHgmUNU2tY%3D)
2026-03-29 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409206/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE18CHX/42812000?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=oyBRp8qHoowbCW9kieY0zUV46IZNjY3FwR8NKuxfaxo%3D)
2026-03-29 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411531/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE19AAK/42812078?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=MkdK1ykhsLQ%2B%2F2n1Irxn7evFumHYKKFZXmkQdpd8KgM%3D)
2026-03-29 22:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455420/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455420>
2026-03-29 22:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455438/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455438>
2026-03-29 22:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435131/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS68PYY/42812178?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=ilxdzGsr4IgRZDvqZmWhurm4pGkLnzxS3s4veY%2BdCjs%3D)
2026-03-29 22:04:10 [scrapy.extensions.logstats] INFO: Crawled 121 pages (at 34 pages/min), scraped 204 items (at 68 items/min)
2026-03-29 22:04:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-29 22:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 22fa64cc-e970-5478-9955-9ad040fbd24e with identifier: BK68%20GBV
2026-03-29 22:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 22fa64cc-e970-5478-9955-9ad040fbd24e with identifier: BK68%20GBV
2026-03-29 22:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 22fa64cc-e970-5478-9955-9ad040fbd24e with identifier: BK68%20GBV to the API
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BK68%20GBV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '22fa64cc-e970-5478-9955-9ad040fbd24e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BK68 GBV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BK68%20GBV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'ECOSPORT',
'odometer': 38459,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD ECOSPORT 1.0 E/B 125 ZETEC StationWagon',
'transmission': 'automatic',
'trim': 'E/B 125 ZETEC',
'vin': 'WF01XXERK1JM07677',
'year': 2018}
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK68%2520GBV%27 HTTP/1.1" 200 None
2026-03-29 22:04:10 [bca.uk] INFO: Saving data for BK68%20GBV: {'auction_closing_time': 1774951200.0, 'created_time': 1774091298.141441, 'last_price_update_time': 1774821850.797091}
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BK68%2520GBV') HTTP/1.1" 204 0
2026-03-29 22:04:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61799990>
2026-03-29 22:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML23KNX%252F699411791%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411791/600 saved to cache
2026-03-29 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c96e7ad0-7cd4-5ea7-b41d-642972a2bf14
2026-03-29 22:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455469/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455469>
2026-03-29 22:04:10 [bca.uk] INFO: Found listing with ID: LR18%20XPF
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR18%2520XPF%27 HTTP/1.1" 200 None
2026-03-29 22:04:10 [bca.uk] INFO: Scrape type for LR18%20XPF: 2
2026-03-29 22:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c249076-49cd-5c5a-9eaf-87d7d61b0421 with identifier: LR18%20XPF
2026-03-29 22:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c249076-49cd-5c5a-9eaf-87d7d61b0421 with scrape type 2
2026-03-29 22:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c249076-49cd-5c5a-9eaf-87d7d61b0421 with scrape type 2
2026-03-29 22:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8c249076-49cd-5c5a-9eaf-87d7d61b0421, identifier: LR18%20XPF
2026-03-29 22:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8c249076-49cd-5c5a-9eaf-87d7d61b0421 with identifier: LR18%20XPF
2026-03-29 22:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8c249076-49cd-5c5a-9eaf-87d7d61b0421 with identifier: LR18%20XPF
2026-03-29 22:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8c249076-49cd-5c5a-9eaf-87d7d61b0421 with identifier: LR18%20XPF to the API
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR18%20XPF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8c249076-49cd-5c5a-9eaf-87d7d61b0421',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR18 XPF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LR18%20XPF&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'JAGUAR',
'model': 'E-PACE',
'odometer': 43142,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'JAGUAR E-PACE 2.0 P250 AWD Hatchback',
'transmission': 'automatic',
'trim': 'P250 AWD',
'vin': 'SADFA2AX9J1Z06307',
'year': 2018}
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR18%2520XPF%27 HTTP/1.1" 200 None
2026-03-29 22:04:11 [bca.uk] INFO: Saving data for LR18%20XPF: {'auction_closing_time': 1774951200.0, 'created_time': 1774304246.60247, 'last_price_update_time': 1774821851.424867}
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LR18%2520XPF') HTTP/1.1" 204 0
2026-03-29 22:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455429/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE12RTO/42798205?sv=2020-08-04&st=2026-03-29T22%3A04%3A08Z&se=2026-03-29T22%3A29%3A08Z&sr=b&sp=r&sig=P6g2kdlkhPFl1fuxArrHgwr0hemJKOexpKc32gFHrGE%3D)
2026-03-29 22:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455399/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE12RTO/42798205?sv=2020-08-04&st=2026-03-29T22%3A04%3A08Z&se=2026-03-29T22%3A29%3A08Z&sr=b&sp=r&sig=P6g2kdlkhPFl1fuxArrHgwr0hemJKOexpKc32gFHrGE%3D)
2026-03-29 22:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455446/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455446>
2026-03-29 22:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455455/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455455>
2026-03-29 22:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575354/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575354>
2026-03-29 22:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455498/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455498>
2026-03-29 22:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455487/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455487>
2026-03-29 22:04:11 [bca.uk] INFO: Found listing with ID: BU68%20FGN
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU68%2520FGN%27 HTTP/1.1" 200 None
2026-03-29 22:04:11 [bca.uk] INFO: Scrape type for BU68%20FGN: 1
2026-03-29 22:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f30cd769-41b2-536f-8ff2-a84f39302250 with identifier: BU68%20FGN
2026-03-29 22:04:11 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f30cd769-41b2-536f-8ff2-a84f39302250
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620acad0>
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLA70NPE%252F699406258%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406258/600 saved to cache
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4838ed0-a1bc-555f-ae17-73d79e29d1ac
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61836a50>
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70YYW%252F699040111%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040111/600 saved to cache
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01b57636-ffd9-585f-9b00-e6ae7dbcc329
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61837950>
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP65LKN%252F699411748%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411748/600 saved to cache
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6062366a-77b0-5b3c-aa23-49414d769971
2026-03-29 22:04:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6119a8d0>
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG69FWY%252F699406346%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406346/600 saved to cache
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23673480-b7c5-5707-903a-2783d4797f75
2026-03-29 22:04:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6351d650>
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ72FOT%252F699414996%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414996/600 saved to cache
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a
2026-03-29 22:04:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61634d50>
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPA19DCO%252F699409249%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409249/600 saved to cache
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da397772-3003-5876-84de-18e19f2e1e0e
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61837190>
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA16ETX%252F699430155%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430155/600 saved to cache
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6398c60-fe63-5a45-a148-79cf4bf62bcf
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637da710>
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19VSX%252F699430221%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430221/600 saved to cache
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 732664ff-2041-53f2-83f7-e4a6aeaa1df2
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61817110>
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE18CHX%252F699409206%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409206/600 saved to cache
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61799f10>
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE19AAK%252F699411531%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411531/600 saved to cache
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff522792-d041-5ecb-b231-8bf72c190c1e
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63331810>
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS68PYY%252F699435131%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435131/600 saved to cache
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73
2026-03-29 22:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455438/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE12RTO/42798205?sv=2020-08-04&st=2026-03-29T22%3A04%3A08Z&se=2026-03-29T22%3A29%3A08Z&sr=b&sp=r&sig=P6g2kdlkhPFl1fuxArrHgwr0hemJKOexpKc32gFHrGE%3D)
2026-03-29 22:04:11 [bca.uk] INFO: Found listing with ID: LW66%20EFL
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LW66%2520EFL%27 HTTP/1.1" 200 None
2026-03-29 22:04:11 [bca.uk] INFO: Scrape type for LW66%20EFL: 2
2026-03-29 22:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a915bedf-7f73-5877-89d1-7a1e8169edcb with identifier: LW66%20EFL
2026-03-29 22:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a915bedf-7f73-5877-89d1-7a1e8169edcb with scrape type 2
2026-03-29 22:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a915bedf-7f73-5877-89d1-7a1e8169edcb with scrape type 2
2026-03-29 22:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a915bedf-7f73-5877-89d1-7a1e8169edcb, identifier: LW66%20EFL
2026-03-29 22:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a915bedf-7f73-5877-89d1-7a1e8169edcb with identifier: LW66%20EFL
2026-03-29 22:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a915bedf-7f73-5877-89d1-7a1e8169edcb with identifier: LW66%20EFL
2026-03-29 22:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a915bedf-7f73-5877-89d1-7a1e8169edcb with identifier: LW66%20EFL to the API
2026-03-29 22:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LW66%20EFL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a915bedf-7f73-5877-89d1-7a1e8169edcb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LW66 EFL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LW66%20EFL&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 32149,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 75 STING Hatchback',
'transmission': 'manual',
'trim': '75 STING',
'vin': 'W0L0XEP08H6039085',
'year': 2017}
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LW66%2520EFL%27 HTTP/1.1" 200 None
2026-03-29 22:04:13 [bca.uk] INFO: Saving data for LW66%20EFL: {'auction_closing_time': 1774951200.0, 'created_time': 1774621808.610412, 'last_price_update_time': 1774821853.229273}
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LW66%2520EFL') HTTP/1.1" 204 0
2026-03-29 22:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455512/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455512>
2026-03-29 22:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427776/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427776>
2026-03-29 22:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL68UZJ/42811837?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=nph2F%2FW6m12z%2FYFEj3Ycz1Gy7uXC8be5nXf0j5ESQjw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL68%20UZJ-GB>
2026-03-29 22:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427853/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427853>
2026-03-29 22:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX19EAW/42811440?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=C09nMtphJ%2F5qYIljNXrzNSV5bitAE4G50wbU1PUP8SU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RX19%20EAW-GB>
2026-03-29 22:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455420/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE12RTO/42798205?sv=2020-08-04&st=2026-03-29T22%3A04%3A08Z&se=2026-03-29T22%3A29%3A08Z&sr=b&sp=r&sig=P6g2kdlkhPFl1fuxArrHgwr0hemJKOexpKc32gFHrGE%3D)
2026-03-29 22:04:13 [bca.uk] INFO: Found listing with ID: MW14%20EEM
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW14%2520EEM%27 HTTP/1.1" 200 None
2026-03-29 22:04:13 [bca.uk] INFO: Scrape type for MW14%20EEM: 2
2026-03-29 22:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00136edc-7369-5494-8c33-415339dbdace with identifier: MW14%20EEM
2026-03-29 22:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00136edc-7369-5494-8c33-415339dbdace with scrape type 2
2026-03-29 22:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00136edc-7369-5494-8c33-415339dbdace with scrape type 2
2026-03-29 22:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 00136edc-7369-5494-8c33-415339dbdace, identifier: MW14%20EEM
2026-03-29 22:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455469/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE12RTO/42798205?sv=2020-08-04&st=2026-03-29T22%3A04%3A08Z&se=2026-03-29T22%3A29%3A08Z&sr=b&sp=r&sig=P6g2kdlkhPFl1fuxArrHgwr0hemJKOexpKc32gFHrGE%3D)
2026-03-29 22:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 00136edc-7369-5494-8c33-415339dbdace with identifier: MW14%20EEM
2026-03-29 22:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 00136edc-7369-5494-8c33-415339dbdace with identifier: MW14%20EEM
2026-03-29 22:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 00136edc-7369-5494-8c33-415339dbdace with identifier: MW14%20EEM to the API
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MW14%20EEM-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '00136edc-7369-5494-8c33-415339dbdace',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MW14 EEM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MW14%20EEM&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 43948,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 TEKNA XTRONIC Hatchback',
'transmission': 'automatic',
'trim': 'TEKNA XTRONIC',
'vin': 'SJNFBAF15U7008594',
'year': 2014}
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW14%2520EEM%27 HTTP/1.1" 200 None
2026-03-29 22:04:13 [bca.uk] INFO: Saving data for MW14%20EEM: {'auction_closing_time': 1774951200.0, 'created_time': 1774390033.53707, 'last_price_update_time': 1774821853.700903}
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MW14%2520EEM') HTTP/1.1" 204 0
2026-03-29 22:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61637190>
2026-03-29 22:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE12RTO%252F699455429%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455429/600 saved to cache
2026-03-29 22:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 330dee78-6fed-57ea-9152-2e616c79bf32
2026-03-29 22:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6372fa10>
2026-03-29 22:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE12RTO%252F699455399%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455399/600 saved to cache
2026-03-29 22:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 330dee78-6fed-57ea-9152-2e616c79bf32
2026-03-29 22:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621149d0>
2026-03-29 22:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE12RTO%252F699455438%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455438/600 saved to cache
2026-03-29 22:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 330dee78-6fed-57ea-9152-2e616c79bf32
2026-03-29 22:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455487/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE12RTO/42798205?sv=2020-08-04&st=2026-03-29T22%3A04%3A08Z&se=2026-03-29T22%3A29%3A08Z&sr=b&sp=r&sig=P6g2kdlkhPFl1fuxArrHgwr0hemJKOexpKc32gFHrGE%3D)
2026-03-29 22:04:13 [bca.uk] INFO: Found listing with ID: OV08%20ECZ
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV08%2520ECZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:13 [bca.uk] INFO: Scrape type for OV08%20ECZ: 1
2026-03-29 22:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b1dd0d2-b075-5313-b500-f3a78c134e6f with identifier: OV08%20ECZ
2026-03-29 22:04:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1b1dd0d2-b075-5313-b500-f3a78c134e6f
2026-03-29 22:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632c85d0>
2026-03-29 22:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE12RTO%252F699455420%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455420/600 saved to cache
2026-03-29 22:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 330dee78-6fed-57ea-9152-2e616c79bf32
2026-03-29 22:04:13 [bca.uk] INFO: Found listing with ID: RY65%20SFZ
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY65%2520SFZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:13 [bca.uk] INFO: Scrape type for RY65%20SFZ: 2
2026-03-29 22:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 783f4f07-fbed-5aff-936d-c41566bf005d with identifier: RY65%20SFZ
2026-03-29 22:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 783f4f07-fbed-5aff-936d-c41566bf005d with scrape type 2
2026-03-29 22:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 783f4f07-fbed-5aff-936d-c41566bf005d with scrape type 2
2026-03-29 22:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 783f4f07-fbed-5aff-936d-c41566bf005d, identifier: RY65%20SFZ
2026-03-29 22:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575354/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/P17LPT/42573216?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Cei94j6xTuVsYVAtMEIEaOIhWn8jpASCTY7XqjpVl64%3D)
2026-03-29 22:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455455/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE12RTO/42798205?sv=2020-08-04&st=2026-03-29T22%3A04%3A08Z&se=2026-03-29T22%3A29%3A08Z&sr=b&sp=r&sig=P6g2kdlkhPFl1fuxArrHgwr0hemJKOexpKc32gFHrGE%3D)
2026-03-29 22:04:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414941/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414941>
2026-03-29 22:04:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411777/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411777>
2026-03-29 22:04:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU68FGN/42811417?sv=2020-08-04&st=2026-03-29T22%3A04%3A13Z&se=2026-03-29T22%3A29%3A13Z&sr=b&sp=r&sig=RCrqulUVcgAVBuj9iX2cS9VTIHmOPa8of1NBVC2WuDI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BU68%20FGN-GB>
2026-03-29 22:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 783f4f07-fbed-5aff-936d-c41566bf005d with identifier: RY65%20SFZ
2026-03-29 22:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 783f4f07-fbed-5aff-936d-c41566bf005d with identifier: RY65%20SFZ
2026-03-29 22:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 783f4f07-fbed-5aff-936d-c41566bf005d with identifier: RY65%20SFZ to the API
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RY65%20SFZ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '783f4f07-fbed-5aff-936d-c41566bf005d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RY65 SFZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RY65%20SFZ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'PASSAT',
'odometer': 36048,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN PASSAT 2.0 TDI SCR 190 R LINE DSG Saloon',
'transmission': 'automatic',
'trim': 'TDI SCR 190 R LINE DSG',
'vin': 'WVWZZZ3CZGE119377',
'year': 2015}
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY65%2520SFZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:14 [bca.uk] INFO: Saving data for RY65%20SFZ: {'auction_closing_time': 1774951200.0, 'created_time': 1774216947.938031, 'last_price_update_time': 1774821854.359425}
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RY65%2520SFZ') HTTP/1.1" 204 0
2026-03-29 22:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455446/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE12RTO/42798205?sv=2020-08-04&st=2026-03-29T22%3A04%3A08Z&se=2026-03-29T22%3A29%3A08Z&sr=b&sp=r&sig=P6g2kdlkhPFl1fuxArrHgwr0hemJKOexpKc32gFHrGE%3D)
2026-03-29 22:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455498/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE12RTO/42798205?sv=2020-08-04&st=2026-03-29T22%3A04%3A08Z&se=2026-03-29T22%3A29%3A08Z&sr=b&sp=r&sig=P6g2kdlkhPFl1fuxArrHgwr0hemJKOexpKc32gFHrGE%3D)
2026-03-29 22:04:14 [bca.uk] INFO: Found listing with ID: V20%20LSS
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V20%2520LSS%27 HTTP/1.1" 200 None
2026-03-29 22:04:14 [bca.uk] INFO: Scrape type for V20%20LSS: 2
2026-03-29 22:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e80ee68-6fb2-5452-b3b8-b34c8aeb2d14 with identifier: V20%20LSS
2026-03-29 22:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e80ee68-6fb2-5452-b3b8-b34c8aeb2d14 with scrape type 2
2026-03-29 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e80ee68-6fb2-5452-b3b8-b34c8aeb2d14 with scrape type 2
2026-03-29 22:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5e80ee68-6fb2-5452-b3b8-b34c8aeb2d14, identifier: V20%20LSS
2026-03-29 22:04:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618f9850>
2026-03-29 22:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE12RTO%252F699455469%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455469/600 saved to cache
2026-03-29 22:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 330dee78-6fed-57ea-9152-2e616c79bf32
2026-03-29 22:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5e80ee68-6fb2-5452-b3b8-b34c8aeb2d14 with identifier: V20%20LSS
2026-03-29 22:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5e80ee68-6fb2-5452-b3b8-b34c8aeb2d14 with identifier: V20%20LSS
2026-03-29 22:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5e80ee68-6fb2-5452-b3b8-b34c8aeb2d14 with identifier: V20%20LSS to the API
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 164,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=V20%20LSS-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5e80ee68-6fb2-5452-b3b8-b34c8aeb2d14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'V20 LSS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=V20%20LSS&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': 'X5',
'odometer': 43523,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'BMW X5 3.0 XDRIVE 30D M SPORT StationWagon',
'transmission': 'manual',
'trim': 'XDRIVE 30D M SPORT',
'vin': 'WBAKS420100J41406',
'year': 2014}
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V20%2520LSS%27 HTTP/1.1" 200 None
2026-03-29 22:04:14 [bca.uk] INFO: Saving data for V20%20LSS: {'auction_closing_time': 1774951200.0, 'created_time': 1773986662.276463, 'last_price_update_time': 1774821854.892268}
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='V20%2520LSS') HTTP/1.1" 204 0
2026-03-29 22:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX19EAW/42811440?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=C09nMtphJ%2F5qYIljNXrzNSV5bitAE4G50wbU1PUP8SU%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:04:15 [bca.uk] INFO: Found listing with ID: AO17%20WOX
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO17%2520WOX%27 HTTP/1.1" 200 None
2026-03-29 22:04:15 [bca.uk] INFO: Scrape type for AO17%20WOX: 2
2026-03-29 22:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3235862-d457-5d4b-816b-c1394bbd3ac9 with identifier: AO17%20WOX
2026-03-29 22:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3235862-d457-5d4b-816b-c1394bbd3ac9 with scrape type 2
2026-03-29 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3235862-d457-5d4b-816b-c1394bbd3ac9 with scrape type 2
2026-03-29 22:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e3235862-d457-5d4b-816b-c1394bbd3ac9, identifier: AO17%20WOX
2026-03-29 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61020d50>
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE12RTO%252F699455487%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455487/600 saved to cache
2026-03-29 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 330dee78-6fed-57ea-9152-2e616c79bf32
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632c8a10>
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FP17LPT%252F686575354%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575354/600 saved to cache
2026-03-29 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63502c90>
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE12RTO%252F699455455%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455455/600 saved to cache
2026-03-29 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 330dee78-6fed-57ea-9152-2e616c79bf32
2026-03-29 22:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427776/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE20EVL/42811999?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=QNaGwsE1HTKndyV7dS5jfLI1ozyFJBkYcrsiWmkuv8k%3D)
2026-03-29 22:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406323/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406323>
2026-03-29 22:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411735/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411735>
2026-03-29 22:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409227/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409227>
2026-03-29 22:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427853/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19VXX/42812304?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=YzGWBhkemG5tXMwAwvYpsWX0bEfwiTWFoG%2FIuzQzr2c%3D)
2026-03-29 22:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e3235862-d457-5d4b-816b-c1394bbd3ac9 with identifier: AO17%20WOX
2026-03-29 22:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e3235862-d457-5d4b-816b-c1394bbd3ac9 with identifier: AO17%20WOX
2026-03-29 22:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e3235862-d457-5d4b-816b-c1394bbd3ac9 with identifier: AO17%20WOX to the API
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO17%20WOX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e3235862-d457-5d4b-816b-c1394bbd3ac9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AO17 WOX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AO17%20WOX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'AUDI',
'model': 'A5 CABRIOLET',
'odometer': 51476,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'AUDI A5 CABRIOLET 2.0 TDI 190 QUATTRO S LINE S-T Convertible',
'transmission': 'automatic',
'trim': 'TDI 190 QUATTRO S LINE S-T',
'vin': 'WAUZZZF51HN003179',
'year': 2017}
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO17%2520WOX%27 HTTP/1.1" 200 None
2026-03-29 22:04:15 [bca.uk] INFO: Saving data for AO17%20WOX: {'auction_closing_time': 1774951200.0, 'created_time': 1774304907.97032, 'last_price_update_time': 1774821855.578885}
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AO17%2520WOX') HTTP/1.1" 204 0
2026-03-29 22:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455512/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE12RTO/42798205?sv=2020-08-04&st=2026-03-29T22%3A04%3A08Z&se=2026-03-29T22%3A29%3A08Z&sr=b&sp=r&sig=P6g2kdlkhPFl1fuxArrHgwr0hemJKOexpKc32gFHrGE%3D)
2026-03-29 22:04:15 [bca.uk] INFO: Found listing with ID: FG14%20ZWE
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG14%2520ZWE%27 HTTP/1.1" 200 None
2026-03-29 22:04:15 [bca.uk] INFO: Scrape type for FG14%20ZWE: 1
2026-03-29 22:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e202f37-ad62-5b0d-b809-5a916fb0486e with identifier: FG14%20ZWE
2026-03-29 22:04:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7e202f37-ad62-5b0d-b809-5a916fb0486e
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637e0e90>
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE12RTO%252F699455446%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455446/600 saved to cache
2026-03-29 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 330dee78-6fed-57ea-9152-2e616c79bf32
2026-03-29 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61682bd0>
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE12RTO%252F699455498%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455498/600 saved to cache
2026-03-29 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 330dee78-6fed-57ea-9152-2e616c79bf32
2026-03-29 22:04:15 [bca.uk] INFO: Total items found: 100
2026-03-29 22:04:15 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded
2026-03-29 22:04:15 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:04:15 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6372e6d0>
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_expert_report_file_9f50d8c2-5e23-4c9e-b6f1-94d0715b0a17.pdf HTTP/1.1" 201 0
2026-03-29 22:04:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6
2026-03-29 22:04:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6, skipping ID generation
2026-03-29 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRX19EAW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RX19EAW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040098/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699040098>
2026-03-29 22:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406242/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406242>
2026-03-29 22:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV08ECZ/42811803?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=LKp%2BGx1fZJuecdPvxpleobyFbgQg%2BAeW6RcmgKVyqVk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV08%20ECZ-GB>
2026-03-29 22:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411777/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML23KNX/42812081?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Ysjf2AWU3A%2B%2BhkZ4EdoIgPpKhCyN1a54UPjPwLBr1pc%3D)
2026-03-29 22:04:15 [bca.uk] INFO: Found listing with ID: GX13%20SXE
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX13%2520SXE%27 HTTP/1.1" 200 None
2026-03-29 22:04:15 [bca.uk] INFO: Scrape type for GX13%20SXE: 1
2026-03-29 22:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82d2359b-1b38-5883-aaa0-bf564ebc3211 with identifier: GX13%20SXE
2026-03-29 22:04:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 82d2359b-1b38-5883-aaa0-bf564ebc3211
2026-03-29 22:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL68UZJ/42811837?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=nph2F%2FW6m12z%2FYFEj3Ycz1Gy7uXC8be5nXf0j5ESQjw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU68FGN/42811417?sv=2020-08-04&st=2026-03-29T22%3A04%3A13Z&se=2026-03-29T22%3A29%3A13Z&sr=b&sp=r&sig=RCrqulUVcgAVBuj9iX2cS9VTIHmOPa8of1NBVC2WuDI%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SY15YVR/42786483?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=FK9rDus56J%2FV9P57RamAAihaU4KAtLW5HM1X4F9VrHo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SY15%20YVR-GB>
2026-03-29 22:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414941/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ72FOT/42812096?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=F1eqEFipUoySPGKOeLKkFyyLLItl9dJbMFy96XQcSRY%3D)
2026-03-29 22:04:15 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:04:15 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:04:15 [bca.uk] INFO: Found listing with ID: DV17%20AKG
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV17%2520AKG%27 HTTP/1.1" 200 None
2026-03-29 22:04:15 [bca.uk] INFO: Scrape type for DV17%20AKG: 0
2026-03-29 22:04:15 [bca.uk] INFO: Found listing with ID: MP19%20GVC
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520GVC%27 HTTP/1.1" 200 None
2026-03-29 22:04:15 [bca.uk] INFO: Scrape type for MP19%20GVC: 0
2026-03-29 22:04:15 [bca.uk] INFO: Found listing with ID: VN62%20KOB
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN62%2520KOB%27 HTTP/1.1" 200 None
2026-03-29 22:04:15 [bca.uk] INFO: Scrape type for VN62%20KOB: 0
2026-03-29 22:04:15 [bca.uk] INFO: Found listing with ID: AV57%20XLW
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV57%2520XLW%27 HTTP/1.1" 200 None
2026-03-29 22:04:15 [bca.uk] INFO: Scrape type for AV57%20XLW: 0
2026-03-29 22:04:15 [bca.uk] INFO: Found listing with ID: CP12%20SXF
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP12%2520SXF%27 HTTP/1.1" 200 None
2026-03-29 22:04:15 [bca.uk] INFO: Scrape type for CP12%20SXF: 0
2026-03-29 22:04:15 [bca.uk] INFO: Found listing with ID: WH65%20TTZ
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WH65%2520TTZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:15 [bca.uk] INFO: Scrape type for WH65%20TTZ: 0
2026-03-29 22:04:15 [bca.uk] INFO: Found listing with ID: FG22%20VVP
2026-03-29 22:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG22%2520VVP%27 HTTP/1.1" 200 None
2026-03-29 22:04:16 [bca.uk] INFO: Scrape type for FG22%20VVP: 0
2026-03-29 22:04:16 [bca.uk] INFO: Found listing with ID: BJ10%20FDU
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ10%2520FDU%27 HTTP/1.1" 200 None
2026-03-29 22:04:16 [bca.uk] INFO: Scrape type for BJ10%20FDU: 0
2026-03-29 22:04:16 [bca.uk] INFO: Found listing with ID: DS14%20BYP
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS14%2520BYP%27 HTTP/1.1" 200 None
2026-03-29 22:04:16 [bca.uk] INFO: Scrape type for DS14%20BYP: 0
2026-03-29 22:04:16 [bca.uk] INFO: Found listing with ID: FV14%20GWX
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV14%2520GWX%27 HTTP/1.1" 200 None
2026-03-29 22:04:16 [bca.uk] INFO: Scrape type for FV14%20GWX: 0
2026-03-29 22:04:16 [bca.uk] INFO: Found listing with ID: KX17%20GMJ
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX17%2520GMJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:16 [bca.uk] INFO: Scrape type for KX17%20GMJ: 0
2026-03-29 22:04:16 [bca.uk] INFO: Found listing with ID: OE14%20XKO
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE14%2520XKO%27 HTTP/1.1" 200 None
2026-03-29 22:04:16 [bca.uk] INFO: Scrape type for OE14%20XKO: 0
2026-03-29 22:04:16 [bca.uk] INFO: Found listing with ID: VK58%20ADX
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK58%2520ADX%27 HTTP/1.1" 200 None
2026-03-29 22:04:16 [bca.uk] INFO: Scrape type for VK58%20ADX: 0
2026-03-29 22:04:16 [bca.uk] INFO: Found listing with ID: DP70%20AVE
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP70%2520AVE%27 HTTP/1.1" 200 None
2026-03-29 22:04:16 [bca.uk] INFO: Scrape type for DP70%20AVE: 0
2026-03-29 22:04:16 [bca.uk] INFO: Found listing with ID: KT64%20OEX
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT64%2520OEX%27 HTTP/1.1" 200 None
2026-03-29 22:04:16 [bca.uk] INFO: Scrape type for KT64%20OEX: 0
2026-03-29 22:04:16 [bca.uk] INFO: Found listing with ID: LP71%20TZD
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP71%2520TZD%27 HTTP/1.1" 200 None
2026-03-29 22:04:16 [bca.uk] INFO: Scrape type for LP71%20TZD: 0
2026-03-29 22:04:16 [bca.uk] INFO: Found listing with ID: YD66%20GXJ
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD66%2520GXJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:16 [bca.uk] INFO: Scrape type for YD66%20GXJ: 0
2026-03-29 22:04:16 [bca.uk] INFO: Found listing with ID: YT68%20LWE
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT68%2520LWE%27 HTTP/1.1" 200 None
2026-03-29 22:04:16 [bca.uk] INFO: Scrape type for YT68%20LWE: 0
2026-03-29 22:04:16 [bca.uk] INFO: Found listing with ID: ESZ%208751
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ESZ%25208751%27 HTTP/1.1" 200 None
2026-03-29 22:04:16 [bca.uk] INFO: Scrape type for ESZ%208751: 2
2026-03-29 22:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b811d9d-1a1c-58d9-805a-f5408809f7ae with identifier: ESZ%208751
2026-03-29 22:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b811d9d-1a1c-58d9-805a-f5408809f7ae with scrape type 2
2026-03-29 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b811d9d-1a1c-58d9-805a-f5408809f7ae with scrape type 2
2026-03-29 22:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6b811d9d-1a1c-58d9-805a-f5408809f7ae, identifier: ESZ%208751
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146453%27 HTTP/1.1" 200 None
2026-03-29 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146453 not downloaded yet
2026-03-29 22:04:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61795a90>
2026-03-29 22:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE20EVL%252F699427776%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427776/600 saved to cache
2026-03-29 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b145ed4d-e096-5329-b7ec-7396067fba60
2026-03-29 22:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6184de50>
2026-03-29 22:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19VXX%252F699427853%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427853/600 saved to cache
2026-03-29 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 553a9526-308c-5e9f-97f5-1bce769f99d7
2026-03-29 22:04:16 [bca.uk] INFO: Found listing with ID: HJ13%20FDL
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ13%2520FDL%27 HTTP/1.1" 200 None
2026-03-29 22:04:16 [bca.uk] INFO: Scrape type for HJ13%20FDL: 2
2026-03-29 22:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0f28475-8b82-53ef-aa2b-7b61d2aaf891 with identifier: HJ13%20FDL
2026-03-29 22:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0f28475-8b82-53ef-aa2b-7b61d2aaf891 with scrape type 2
2026-03-29 22:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0f28475-8b82-53ef-aa2b-7b61d2aaf891 with scrape type 2
2026-03-29 22:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a0f28475-8b82-53ef-aa2b-7b61d2aaf891, identifier: HJ13%20FDL
2026-03-29 22:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6b811d9d-1a1c-58d9-805a-f5408809f7ae with identifier: ESZ%208751
2026-03-29 22:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6b811d9d-1a1c-58d9-805a-f5408809f7ae with identifier: ESZ%208751
2026-03-29 22:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6b811d9d-1a1c-58d9-805a-f5408809f7ae with identifier: ESZ%208751 to the API
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 247,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ESZ%208751-GB',
'category': 'LightCommercialVehicle',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.3L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6b811d9d-1a1c-58d9-805a-f5408809f7ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ESZ 8751',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ESZ%208751&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'NAVARA',
'odometer': 110677,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'NISSAN NAVARA 2.3 DCI 190 TT 4WD TEKNA CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'DCI 190 TT 4WD TEKNA',
'vin': 'VSKCTND23U0161715',
'year': 2021}
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ESZ%25208751%27 HTTP/1.1" 200 None
2026-03-29 22:04:16 [bca.uk] INFO: Saving data for ESZ%208751: {'auction_closing_time': 1774951200.0, 'created_time': 1774524491.030042, 'last_price_update_time': 1774821856.830004}
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ESZ%25208751') HTTP/1.1" 204 0
2026-03-29 22:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a0f28475-8b82-53ef-aa2b-7b61d2aaf891 with identifier: HJ13%20FDL
2026-03-29 22:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a0f28475-8b82-53ef-aa2b-7b61d2aaf891 with identifier: HJ13%20FDL
2026-03-29 22:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a0f28475-8b82-53ef-aa2b-7b61d2aaf891 with identifier: HJ13%20FDL to the API
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HJ13%20FDL-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a0f28475-8b82-53ef-aa2b-7b61d2aaf891',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HJ13 FDL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HJ13%20FDL&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'DACIA',
'model': 'SANDERO',
'odometer': 20667,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'DACIA SANDERO 1.2 75 16V ACCESS Hatchback',
'transmission': 'manual',
'trim': '75 16V ACCESS',
'vin': 'UU15SDAG548617685',
'year': 2013}
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ13%2520FDL%27 HTTP/1.1" 200 None
2026-03-29 22:04:17 [bca.uk] INFO: Saving data for HJ13%20FDL: {'auction_closing_time': 1774951200.0, 'created_time': 1774216960.365923, 'last_price_update_time': 1774821857.256906}
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HJ13%2520FDL') HTTP/1.1" 204 0
2026-03-29 22:04:17 [bca.uk] INFO: Found listing with ID: MK70%20LXC
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK70%2520LXC%27 HTTP/1.1" 200 None
2026-03-29 22:04:17 [bca.uk] INFO: Scrape type for MK70%20LXC: 0
2026-03-29 22:04:17 [bca.uk] INFO: Found listing with ID: BT68%20ZZD
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT68%2520ZZD%27 HTTP/1.1" 200 None
2026-03-29 22:04:17 [bca.uk] INFO: Scrape type for BT68%20ZZD: 2
2026-03-29 22:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46249640-b59a-56d3-9a56-96bd36917701 with identifier: BT68%20ZZD
2026-03-29 22:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46249640-b59a-56d3-9a56-96bd36917701 with scrape type 2
2026-03-29 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46249640-b59a-56d3-9a56-96bd36917701 with scrape type 2
2026-03-29 22:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 46249640-b59a-56d3-9a56-96bd36917701, identifier: BT68%20ZZD
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146460%27 HTTP/1.1" 200 None
2026-03-29 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146460 not downloaded yet
2026-03-29 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430144/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430144>
2026-03-29 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409184/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409184>
2026-03-29 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430204/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430204>
2026-03-29 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435123/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435123>
2026-03-29 22:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411520/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411520>
2026-03-29 22:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411735/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP65LKN/42812099?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=YYiddic%2BqcqY2M0XPOfW0%2FrAPtac9opCHs6%2B5ikpuFw%3D)
2026-03-29 22:04:17 [bca.uk] INFO: Found listing with ID: LF18%20KBP
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF18%2520KBP%27 HTTP/1.1" 200 None
2026-03-29 22:04:17 [bca.uk] INFO: Scrape type for LF18%20KBP: 2
2026-03-29 22:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 728099f1-fe18-53bc-a334-ecf1c67610d3 with identifier: LF18%20KBP
2026-03-29 22:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 728099f1-fe18-53bc-a334-ecf1c67610d3 with scrape type 2
2026-03-29 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 728099f1-fe18-53bc-a334-ecf1c67610d3 with scrape type 2
2026-03-29 22:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 728099f1-fe18-53bc-a334-ecf1c67610d3, identifier: LF18%20KBP
2026-03-29 22:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 46249640-b59a-56d3-9a56-96bd36917701 with identifier: BT68%20ZZD
2026-03-29 22:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 46249640-b59a-56d3-9a56-96bd36917701 with identifier: BT68%20ZZD
2026-03-29 22:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 46249640-b59a-56d3-9a56-96bd36917701 with identifier: BT68%20ZZD to the API
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 189,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT68%20ZZD-GB',
'category': 'LightCommercialVehicle',
'color': 'orange',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '46249640-b59a-56d3-9a56-96bd36917701',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BT68 ZZD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BT68%20ZZD&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'TOYOTA',
'model': 'HILUX',
'odometer': 83506,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'TOYOTA HILUX 2.4 D INVINCIBLE X LTD.ED.4WD CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'D INVINCIBLE X LTD.ED.4WD',
'vin': 'AHTBB3CDX01752580',
'year': 2019}
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT68%2520ZZD%27 HTTP/1.1" 200 None
2026-03-29 22:04:17 [bca.uk] INFO: Saving data for BT68%20ZZD: {'auction_closing_time': 1774951200.0, 'created_time': 1774524543.359364, 'last_price_update_time': 1774821857.878026}
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BT68%2520ZZD') HTTP/1.1" 204 0
2026-03-29 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61161050>
2026-03-29 22:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE12RTO%252F699455512%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455512/600 saved to cache
2026-03-29 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 330dee78-6fed-57ea-9152-2e616c79bf32
2026-03-29 22:04:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 330dee78-6fed-57ea-9152-2e616c79bf32, skipping ID generation
2026-03-29 22:04:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 330dee78-6fed-57ea-9152-2e616c79bf32 sending to next pipeline
2026-03-29 22:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 330dee78-6fed-57ea-9152-2e616c79bf32, identifier: YE12%20RTO
2026-03-29 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62066650>
2026-03-29 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML23KNX%252F699411777%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411777/600 saved to cache
2026-03-29 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c96e7ad0-7cd4-5ea7-b41d-642972a2bf14
2026-03-29 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6105b550>
2026-03-29 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_expert_report_file_dcc3a80f-3430-4c02-8ee0-db0fb2b32c09.pdf HTTP/1.1" 201 0
2026-03-29 22:04:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d329060a-a095-5b9c-880a-4e9dfce039e5
2026-03-29 22:04:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d329060a-a095-5b9c-880a-4e9dfce039e5, skipping ID generation
2026-03-29 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d329060a-a095-5b9c-880a-4e9dfce039e5
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFL68UZJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FL68UZJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636a7c90>
2026-03-29 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_expert_report_file_b5a14909-cd33-44c1-97e8-a381d8f4564e.pdf HTTP/1.1" 201 0
2026-03-29 22:04:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f30cd769-41b2-536f-8ff2-a84f39302250
2026-03-29 22:04:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f30cd769-41b2-536f-8ff2-a84f39302250, skipping ID generation
2026-03-29 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f30cd769-41b2-536f-8ff2-a84f39302250
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBU68FGN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BU68FGN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a1f290>
2026-03-29 22:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ72FOT%252F699414941%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414941/600 saved to cache
2026-03-29 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a
2026-03-29 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409227/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PA19DCO/42811984?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=5dad8F2568bHOl2s5RwggeSpVONMrl6yr8ByaoDJDOc%3D)
2026-03-29 22:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406323/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG69FWY/42811982?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=iIU0ZFwxCrfo9iR2T7l%2BEKiHBXHpV%2FjhvFuNPQMcBwU%3D)
2026-03-29 22:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 728099f1-fe18-53bc-a334-ecf1c67610d3 with identifier: LF18%20KBP
2026-03-29 22:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 728099f1-fe18-53bc-a334-ecf1c67610d3 with identifier: LF18%20KBP
2026-03-29 22:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 728099f1-fe18-53bc-a334-ecf1c67610d3 with identifier: LF18%20KBP to the API
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LF18%20KBP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '728099f1-fe18-53bc-a334-ecf1c67610d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LF18 KBP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LF18%20KBP&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 12159,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 65 BEATS Hatchback',
'transmission': 'manual',
'trim': '65 BEATS',
'vin': 'WVWZZZAWZJU009881',
'year': 2018}
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF18%2520KBP%27 HTTP/1.1" 200 None
2026-03-29 22:04:18 [bca.uk] INFO: Saving data for LF18%20KBP: {'auction_closing_time': 1774951200.0, 'created_time': 1774477887.420727, 'last_price_update_time': 1774821858.683306}
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LF18%2520KBP') HTTP/1.1" 204 0
2026-03-29 22:04:18 [bca.uk] INFO: Found listing with ID: BW19%20TUY
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW19%2520TUY%27 HTTP/1.1" 200 None
2026-03-29 22:04:18 [bca.uk] INFO: Scrape type for BW19%20TUY: 2
2026-03-29 22:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb377dc9-368c-577f-a6cc-a6dab671daf2 with identifier: BW19%20TUY
2026-03-29 22:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb377dc9-368c-577f-a6cc-a6dab671daf2 with scrape type 2
2026-03-29 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb377dc9-368c-577f-a6cc-a6dab671daf2 with scrape type 2
2026-03-29 22:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fb377dc9-368c-577f-a6cc-a6dab671daf2, identifier: BW19%20TUY
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146466%27 HTTP/1.1" 200 None
2026-03-29 22:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146466 not downloaded yet
2026-03-29 22:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 330dee78-6fed-57ea-9152-2e616c79bf32 with identifier: YE12%20RTO
2026-03-29 22:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 330dee78-6fed-57ea-9152-2e616c79bf32 with identifier: YE12%20RTO
2026-03-29 22:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 330dee78-6fed-57ea-9152-2e616c79bf32 with identifier: YE12%20RTO to the API
2026-03-29 22:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455512/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_expert_report_file_c80c6993-41c1-4e42-a8ba-f650785e4f2b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YE12%20RTO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': '330dee78-6fed-57ea-9152-2e616c79bf32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YE12 RTO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YE12%20RTO&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'NISSAN',
'model': 'QASHQAI +2',
'odometer': 171213,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39905,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455399/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40137,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455420/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37286,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455429/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37866,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455438/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34546,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455446/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34466,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455455/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93061,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455469/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87056,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455487/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87750,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455498/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_330dee78-6fed-57ea-9152-2e616c79bf32/330dee78-6fed-57ea-9152-2e616c79bf32_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84257,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE12RTO/699455512/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI +2 1.5 DCI 110 ACENTA MPV',
'transmission': 'manual',
'trim': 'DCI 110 ACENTA',
'vin': 'SJNJCAJ10U7125357',
'year': 2012}
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE12%2520RTO%27 HTTP/1.1" 200 None
2026-03-29 22:04:19 [bca.uk] INFO: Saving data for YE12%20RTO: {'created_time': 1774821859.169687, 'last_price_update_time': 1774821859.169697, 'auction_closing_time': 1775210400.0}
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YE12%2520RTO') HTTP/1.1" 204 0
2026-03-29 22:04:19 [bca.uk] INFO: Found listing with ID: LJZ%203517
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJZ%25203517%27 HTTP/1.1" 200 None
2026-03-29 22:04:19 [bca.uk] INFO: Scrape type for LJZ%203517: 2
2026-03-29 22:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4311c89d-f384-5cac-8e58-15bcdbec590d with identifier: LJZ%203517
2026-03-29 22:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4311c89d-f384-5cac-8e58-15bcdbec590d with scrape type 2
2026-03-29 22:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4311c89d-f384-5cac-8e58-15bcdbec590d with scrape type 2
2026-03-29 22:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4311c89d-f384-5cac-8e58-15bcdbec590d, identifier: LJZ%203517
2026-03-29 22:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fb377dc9-368c-577f-a6cc-a6dab671daf2 with identifier: BW19%20TUY
2026-03-29 22:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fb377dc9-368c-577f-a6cc-a6dab671daf2 with identifier: BW19%20TUY
2026-03-29 22:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fb377dc9-368c-577f-a6cc-a6dab671daf2 with identifier: BW19%20TUY to the API
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BW19%20TUY-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'fb377dc9-368c-577f-a6cc-a6dab671daf2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BW19 TUY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BW19%20TUY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'TRANSIT CONNECT',
'odometer': 85701,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD TRANSIT CONNECT 1.5 EBL 120 240 L2 LTD.L/R P/S Van',
'transmission': 'automatic',
'trim': 'EBL 120 240 L2 LTD.L/R P/S',
'vin': 'WF0SXXWPGSKK26886',
'year': 2019}
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW19%2520TUY%27 HTTP/1.1" 200 None
2026-03-29 22:04:19 [bca.uk] INFO: Saving data for BW19%20TUY: {'auction_closing_time': 1775037600.0, 'created_time': 1773908354.689774, 'last_price_update_time': 1774821859.625337}
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BW19%2520TUY') HTTP/1.1" 204 0
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388270%27 HTTP/1.1" 200 None
2026-03-29 22:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388270 not downloaded yet
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126406%27 HTTP/1.1" 200 None
2026-03-29 22:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126406 not downloaded yet
2026-03-29 22:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040098/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70YYW/42571204?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=3YETERDVJsfcYf9zoGQQnS8MvGAFRjTT6qcrLaHjjZg%3D)
2026-03-29 22:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG14ZWE/42811220?sv=2020-08-04&st=2026-03-29T22%3A04%3A18Z&se=2026-03-29T22%3A29%3A18Z&sr=b&sp=r&sig=cnrBVHx917608ZNQdYLaL9kbd9WqnADMOSSO4ZVtpmw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG14%20ZWE-GB>
2026-03-29 22:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146447/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RX19EAW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406242/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LA70NPE/42811995?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=1ymICcEKrtpKHFHLQTc1yKaMMeniIFUDVOMDF5neyAs%3D)
2026-03-29 22:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4311c89d-f384-5cac-8e58-15bcdbec590d with identifier: LJZ%203517
2026-03-29 22:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4311c89d-f384-5cac-8e58-15bcdbec590d with identifier: LJZ%203517
2026-03-29 22:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4311c89d-f384-5cac-8e58-15bcdbec590d with identifier: LJZ%203517 to the API
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 189,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LJZ%203517-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4311c89d-f384-5cac-8e58-15bcdbec590d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LJZ 3517',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LJZ%203517&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'CITROEN',
'model': 'C5',
'odometer': 27348,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'CITROEN C5 2.0 HDI 136 EXCLUSIVE Estate',
'transmission': 'automatic',
'trim': 'HDI 136 EXCLUSIVE',
'vin': 'VF7RCRHRJ76732695',
'year': 2006}
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJZ%25203517%27 HTTP/1.1" 200 None
2026-03-29 22:04:20 [bca.uk] INFO: Saving data for LJZ%203517: {'auction_closing_time': 1774951200.0, 'created_time': 1774277731.474746, 'last_price_update_time': 1774821860.030695}
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LJZ%25203517') HTTP/1.1" 204 0
2026-03-29 22:04:20 [bca.uk] INFO: Found listing with ID: NGZ%203835
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NGZ%25203835%27 HTTP/1.1" 200 None
2026-03-29 22:04:20 [bca.uk] INFO: Scrape type for NGZ%203835: 0
2026-03-29 22:04:20 [bca.uk] INFO: Found listing with ID: KW70%20OXP
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW70%2520OXP%27 HTTP/1.1" 200 None
2026-03-29 22:04:20 [bca.uk] INFO: Scrape type for KW70%20OXP: 0
2026-03-29 22:04:20 [bca.uk] INFO: Found listing with ID: RO21%20FRN
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO21%2520FRN%27 HTTP/1.1" 200 None
2026-03-29 22:04:20 [bca.uk] INFO: Scrape type for RO21%20FRN: 0
2026-03-29 22:04:20 [bca.uk] INFO: Found listing with ID: WR69%20UBV
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR69%2520UBV%27 HTTP/1.1" 200 None
2026-03-29 22:04:20 [bca.uk] INFO: Scrape type for WR69%20UBV: 0
2026-03-29 22:04:20 [bca.uk] INFO: Found listing with ID: VN59%20KBK
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN59%2520KBK%27 HTTP/1.1" 200 None
2026-03-29 22:04:20 [bca.uk] INFO: Scrape type for VN59%20KBK: 2
2026-03-29 22:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bdd5ed1-6f9b-53ee-9fe5-05197e2a1731 with identifier: VN59%20KBK
2026-03-29 22:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bdd5ed1-6f9b-53ee-9fe5-05197e2a1731 with scrape type 2
2026-03-29 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bdd5ed1-6f9b-53ee-9fe5-05197e2a1731 with scrape type 2
2026-03-29 22:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9bdd5ed1-6f9b-53ee-9fe5-05197e2a1731, identifier: VN59%20KBK
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146472%27 HTTP/1.1" 200 None
2026-03-29 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146472 not downloaded yet
2026-03-29 22:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61875490>
2026-03-29 22:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP65LKN%252F699411735%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411735/600 saved to cache
2026-03-29 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6062366a-77b0-5b3c-aa23-49414d769971
2026-03-29 22:04:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6062366a-77b0-5b3c-aa23-49414d769971, skipping ID generation
2026-03-29 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6062366a-77b0-5b3c-aa23-49414d769971 sending to next pipeline
2026-03-29 22:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6062366a-77b0-5b3c-aa23-49414d769971, identifier: MP65%20LKN
2026-03-29 22:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411520/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE19AAK/42812078?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=MkdK1ykhsLQ%2B%2F2n1Irxn7evFumHYKKFZXmkQdpd8KgM%3D)
2026-03-29 22:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575349/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575349>
2026-03-29 22:04:20 [bca.uk] INFO: Found listing with ID: HK54%20OMR
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK54%2520OMR%27 HTTP/1.1" 200 None
2026-03-29 22:04:20 [bca.uk] INFO: Scrape type for HK54%20OMR: 1
2026-03-29 22:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6514c1-40ff-58ca-8a22-0509f974be50 with identifier: HK54%20OMR
2026-03-29 22:04:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2e6514c1-40ff-58ca-8a22-0509f974be50
2026-03-29 22:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9bdd5ed1-6f9b-53ee-9fe5-05197e2a1731 with identifier: VN59%20KBK
2026-03-29 22:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9bdd5ed1-6f9b-53ee-9fe5-05197e2a1731 with identifier: VN59%20KBK
2026-03-29 22:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9bdd5ed1-6f9b-53ee-9fe5-05197e2a1731 with identifier: VN59%20KBK to the API
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 106,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VN59%20KBK-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9bdd5ed1-6f9b-53ee-9fe5-05197e2a1731',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VN59 KBK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VN59%20KBK&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'TOYOTA',
'model': 'AYGO',
'odometer': 30905,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'TOYOTA AYGO 1.0 VVT-I + Hatchback',
'transmission': 'manual',
'trim': 'VVT-I +',
'vin': 'JTDJG18C10N410958',
'year': 2009}
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN59%2520KBK%27 HTTP/1.1" 200 None
2026-03-29 22:04:20 [bca.uk] INFO: Saving data for VN59%20KBK: {'auction_closing_time': 1774951200.0, 'created_time': 1774610828.971111, 'last_price_update_time': 1774821860.706716}
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VN59%2520KBK') HTTP/1.1" 204 0
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388285%27 HTTP/1.1" 200 None
2026-03-29 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388285 not downloaded yet
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126413%27 HTTP/1.1" 200 None
2026-03-29 22:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126413 not downloaded yet
2026-03-29 22:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6062366a-77b0-5b3c-aa23-49414d769971 with identifier: MP65%20LKN
2026-03-29 22:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6062366a-77b0-5b3c-aa23-49414d769971 with identifier: MP65%20LKN
2026-03-29 22:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6062366a-77b0-5b3c-aa23-49414d769971 with identifier: MP65%20LKN to the API
2026-03-29 22:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411735/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_expert_report_file_874d2876-8464-4d07-8173-7b18b02ee7a1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MP65%20LKN-GB',
'category': 'Car',
'color': 'multicoloured',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6062366a-77b0-5b3c-aa23-49414d769971',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MP65 LKN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MP65%20LKN&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 52176,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40497,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411726/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40318,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411735/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40198,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411748/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42029,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411760/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39221,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411770/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37470,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411781/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88745,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411792/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63609,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411803/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85378,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411816/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6062366a-77b0-5b3c-aa23-49414d769971/6062366a-77b0-5b3c-aa23-49414d769971_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78126,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP65LKN/699411831/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'RENAULT CAPTUR 0.9 TCE 90 DYNAMIQUE Hatchback',
'transmission': 'manual',
'trim': 'TCE 90 DYNAMIQUE',
'vin': 'VF12RD11A54354909',
'year': 2016}
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP65%2520LKN%27 HTTP/1.1" 200 None
2026-03-29 22:04:21 [bca.uk] INFO: Saving data for MP65%20LKN: {'created_time': 1774821861.228582, 'last_price_update_time': 1774821861.228596, 'auction_closing_time': 1774951200.0}
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MP65%2520LKN') HTTP/1.1" 204 0
2026-03-29 22:04:21 [bca.uk] INFO: Found listing with ID: YP15%20FGX
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP15%2520FGX%27 HTTP/1.1" 200 None
2026-03-29 22:04:21 [bca.uk] INFO: Scrape type for YP15%20FGX: 2
2026-03-29 22:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f29c3f8c-5a3f-5b47-87f7-bc272a90ef9a with identifier: YP15%20FGX
2026-03-29 22:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f29c3f8c-5a3f-5b47-87f7-bc272a90ef9a with scrape type 2
2026-03-29 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f29c3f8c-5a3f-5b47-87f7-bc272a90ef9a with scrape type 2
2026-03-29 22:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f29c3f8c-5a3f-5b47-87f7-bc272a90ef9a, identifier: YP15%20FGX
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146479%27 HTTP/1.1" 200 None
2026-03-29 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146479 not downloaded yet
2026-03-29 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac635019d0>
2026-03-29 22:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPA19DCO%252F699409227%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409227/600 saved to cache
2026-03-29 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da397772-3003-5876-84de-18e19f2e1e0e
2026-03-29 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632b9550>
2026-03-29 22:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG69FWY%252F699406323%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406323/600 saved to cache
2026-03-29 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23673480-b7c5-5707-903a-2783d4797f75
2026-03-29 22:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SY15YVR/42786483?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=FK9rDus56J%2FV9P57RamAAihaU4KAtLW5HM1X4F9VrHo%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409184/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE18CHX/42812000?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=oyBRp8qHoowbCW9kieY0zUV46IZNjY3FwR8NKuxfaxo%3D)
2026-03-29 22:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430204/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19VSX/42812111?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=qlSeQUbf83xHqWfD9mYZ2SCAALVwdddlxYHgmUNU2tY%3D)
2026-03-29 22:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430144/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA16ETX/42812131?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=67cSoD7yDAcPlVUXb6MtFxB8b%2F%2B%2FHPzK%2FRcqJHz%2FIwo%3D)
2026-03-29 22:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435123/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS68PYY/42812178?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=ilxdzGsr4IgRZDvqZmWhurm4pGkLnzxS3s4veY%2BdCjs%3D)
2026-03-29 22:04:21 [bca.uk] INFO: Found listing with ID: LM54%20XHA
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM54%2520XHA%27 HTTP/1.1" 200 None
2026-03-29 22:04:21 [bca.uk] INFO: Scrape type for LM54%20XHA: 1
2026-03-29 22:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b0931c6-e1ee-59a1-940a-2866b34dd8e0 with identifier: LM54%20XHA
2026-03-29 22:04:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8b0931c6-e1ee-59a1-940a-2866b34dd8e0
2026-03-29 22:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f29c3f8c-5a3f-5b47-87f7-bc272a90ef9a with identifier: YP15%20FGX
2026-03-29 22:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f29c3f8c-5a3f-5b47-87f7-bc272a90ef9a with identifier: YP15%20FGX
2026-03-29 22:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f29c3f8c-5a3f-5b47-87f7-bc272a90ef9a with identifier: YP15%20FGX to the API
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YP15%20FGX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f29c3f8c-5a3f-5b47-87f7-bc272a90ef9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YP15 FGX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YP15%20FGX&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'AUDI',
'model': 'A4 AVANT',
'odometer': 92984,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'AUDI A4 AVANT 2.0 TDI 190 BLACK ED.M-T Estate',
'transmission': 'manual',
'trim': 'TDI 190 BLACK ED.M-T',
'vin': 'WAUZZZ8K3FA158064',
'year': 2015}
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP15%2520FGX%27 HTTP/1.1" 200 None
2026-03-29 22:04:21 [bca.uk] INFO: Saving data for YP15%20FGX: {'auction_closing_time': 1774864800.0, 'created_time': 1774620226.806489, 'last_price_update_time': 1774821861.78704}
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YP15%2520FGX') HTTP/1.1" 204 0
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388297%27 HTTP/1.1" 200 None
2026-03-29 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388297 not downloaded yet
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126426%27 HTTP/1.1" 200 None
2026-03-29 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126426 not downloaded yet
2026-03-29 22:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146453/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146453>
2026-03-29 22:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146460/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146460>
2026-03-29 22:04:21 [bca.uk] INFO: Found listing with ID: AU60%20RJO
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU60%2520RJO%27 HTTP/1.1" 200 None
2026-03-29 22:04:21 [bca.uk] INFO: Scrape type for AU60%20RJO: 2
2026-03-29 22:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 404a27ad-6bea-5012-8a00-6af9d2555ff9 with identifier: AU60%20RJO
2026-03-29 22:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 404a27ad-6bea-5012-8a00-6af9d2555ff9 with scrape type 2
2026-03-29 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 404a27ad-6bea-5012-8a00-6af9d2555ff9 with scrape type 2
2026-03-29 22:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 404a27ad-6bea-5012-8a00-6af9d2555ff9, identifier: AU60%20RJO
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146489%27 HTTP/1.1" 200 None
2026-03-29 22:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146489 not downloaded yet
2026-03-29 22:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611726d0>
2026-03-29 22:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70YYW%252F699040098%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040098/600 saved to cache
2026-03-29 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01b57636-ffd9-585f-9b00-e6ae7dbcc329
2026-03-29 22:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637e1090>
2026-03-29 22:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLA70NPE%252F699406242%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406242/600 saved to cache
2026-03-29 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4838ed0-a1bc-555f-ae17-73d79e29d1ac
2026-03-29 22:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610557d0>
2026-03-29 22:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE19AAK%252F699411520%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411520/600 saved to cache
2026-03-29 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff522792-d041-5ecb-b231-8bf72c190c1e
2026-03-29 22:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV08ECZ/42811803?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=LKp%2BGx1fZJuecdPvxpleobyFbgQg%2BAeW6RcmgKVyqVk%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:04:22 [bca.uk] INFO: Found listing with ID: LT57%20DYH
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT57%2520DYH%27 HTTP/1.1" 200 None
2026-03-29 22:04:22 [bca.uk] INFO: Scrape type for LT57%20DYH: 1
2026-03-29 22:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ba7d5c4-734f-5e05-8725-12f4a7e78af1 with identifier: LT57%20DYH
2026-03-29 22:04:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3ba7d5c4-734f-5e05-8725-12f4a7e78af1
2026-03-29 22:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 404a27ad-6bea-5012-8a00-6af9d2555ff9 with identifier: AU60%20RJO
2026-03-29 22:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 404a27ad-6bea-5012-8a00-6af9d2555ff9 with identifier: AU60%20RJO
2026-03-29 22:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 404a27ad-6bea-5012-8a00-6af9d2555ff9 with identifier: AU60%20RJO to the API
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 215,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AU60%20RJO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '404a27ad-6bea-5012-8a00-6af9d2555ff9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AU60 RJO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AU60%20RJO&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'MERCEDES-BENZ',
'model': 'CLS 350',
'odometer': 103294,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLS 350 3.0 CDI GRAND EDITION TIP Coupe',
'transmission': 'manual',
'trim': 'CDI GRAND EDITION TIP',
'vin': 'WDD2193222A171353',
'year': 2010}
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU60%2520RJO%27 HTTP/1.1" 200 None
2026-03-29 22:04:22 [bca.uk] INFO: Saving data for AU60%20RJO: {'auction_closing_time': 1774864800.0, 'created_time': 1774390101.082182, 'last_price_update_time': 1774821862.461179}
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AU60%2520RJO') HTTP/1.1" 204 0
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388308%27 HTTP/1.1" 200 None
2026-03-29 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388308 not downloaded yet
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126445%27 HTTP/1.1" 200 None
2026-03-29 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126445 not downloaded yet
2026-03-29 22:04:22 [bca.uk] INFO: Found listing with ID: MJ62%20FZE
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ62%2520FZE%27 HTTP/1.1" 200 None
2026-03-29 22:04:22 [bca.uk] INFO: Scrape type for MJ62%20FZE: 0
2026-03-29 22:04:22 [bca.uk] INFO: Found listing with ID: BG11%20CSZ
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG11%2520CSZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:22 [bca.uk] INFO: Scrape type for BG11%20CSZ: 2
2026-03-29 22:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6f02d3f-f631-51f5-8cda-247f25e306e9 with identifier: BG11%20CSZ
2026-03-29 22:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6f02d3f-f631-51f5-8cda-247f25e306e9 with scrape type 2
2026-03-29 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6f02d3f-f631-51f5-8cda-247f25e306e9 with scrape type 2
2026-03-29 22:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f6f02d3f-f631-51f5-8cda-247f25e306e9, identifier: BG11%20CSZ
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146501%27 HTTP/1.1" 200 None
2026-03-29 22:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146501 not downloaded yet
2026-03-29 22:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575349/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/P17LPT/42573216?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Cei94j6xTuVsYVAtMEIEaOIhWn8jpASCTY7XqjpVl64%3D)
2026-03-29 22:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146447/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX19EAW/42811440?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=C09nMtphJ%2F5qYIljNXrzNSV5bitAE4G50wbU1PUP8SU%3D)
2026-03-29 22:04:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146466/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146466>
2026-03-29 22:04:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX13SXE/42811806?sv=2020-08-04&st=2026-03-29T22%3A04%3A22Z&se=2026-03-29T22%3A29%3A22Z&sr=b&sp=r&sig=3r1JvnjimdGw6bIdCU3v28PgEf%2BVL2n8uM1aCSphqNo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GX13%20SXE-GB>
2026-03-29 22:04:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126400/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BU68FGN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:04:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126406/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126406>
2026-03-29 22:04:22 [bca.uk] INFO: Found listing with ID: NC08%20ONX
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC08%2520ONX%27 HTTP/1.1" 200 None
2026-03-29 22:04:22 [bca.uk] INFO: Scrape type for NC08%20ONX: 1
2026-03-29 22:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40b88b0b-760b-5e8d-8f49-074bf256e466 with identifier: NC08%20ONX
2026-03-29 22:04:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 40b88b0b-760b-5e8d-8f49-074bf256e466
2026-03-29 22:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f6f02d3f-f631-51f5-8cda-247f25e306e9 with identifier: BG11%20CSZ
2026-03-29 22:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f6f02d3f-f631-51f5-8cda-247f25e306e9 with identifier: BG11%20CSZ
2026-03-29 22:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f6f02d3f-f631-51f5-8cda-247f25e306e9 with identifier: BG11%20CSZ to the API
2026-03-29 22:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG11%20CSZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f6f02d3f-f631-51f5-8cda-247f25e306e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG11 CSZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BG11%20CSZ&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BMW',
'model': '118D',
'odometer': 111410,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'BMW 118D 2.0 M SPORT STEP Coupe',
'transmission': 'manual',
'trim': 'M SPORT STEP',
'vin': 'WBAUR12090VM19670',
'year': 2011}
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG11%2520CSZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:23 [bca.uk] INFO: Saving data for BG11%20CSZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774505193.364573, 'last_price_update_time': 1774821863.296946}
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BG11%2520CSZ') HTTP/1.1" 204 0
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388327%27 HTTP/1.1" 200 None
2026-03-29 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388327 not downloaded yet
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126467%27 HTTP/1.1" 200 None
2026-03-29 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126467 not downloaded yet
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6a87f550>
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_expert_report_file_d291f0b0-6dc2-4682-9b12-4620dd7f83d8.pdf HTTP/1.1" 201 0
2026-03-29 22:04:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 96224006-57cb-587c-9533-8a4dcc309913
2026-03-29 22:04:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96224006-57cb-587c-9533-8a4dcc309913, skipping ID generation
2026-03-29 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96224006-57cb-587c-9533-8a4dcc309913
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSY15YVR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SY15YVR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63576450>
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE18CHX%252F699409184%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409184/600 saved to cache
2026-03-29 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611d29d0>
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19VSX%252F699430204%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430204/600 saved to cache
2026-03-29 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 732664ff-2041-53f2-83f7-e4a6aeaa1df2
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6109fd50>
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA16ETX%252F699430144%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430144/600 saved to cache
2026-03-29 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6398c60-fe63-5a45-a148-79cf4bf62bcf
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61161d90>
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS68PYY%252F699435123%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435123/600 saved to cache
2026-03-29 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73
2026-03-29 22:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146460/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX19EAW/42811440?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=C09nMtphJ%2F5qYIljNXrzNSV5bitAE4G50wbU1PUP8SU%3D)
2026-03-29 22:04:23 [bca.uk] INFO: Found listing with ID: NA55%20RWJ
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA55%2520RWJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:23 [bca.uk] INFO: Scrape type for NA55%20RWJ: 2
2026-03-29 22:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8f01490-6423-5923-91af-5ee6fce8e9e8 with identifier: NA55%20RWJ
2026-03-29 22:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8f01490-6423-5923-91af-5ee6fce8e9e8 with scrape type 2
2026-03-29 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8f01490-6423-5923-91af-5ee6fce8e9e8 with scrape type 2
2026-03-29 22:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a8f01490-6423-5923-91af-5ee6fce8e9e8, identifier: NA55%20RWJ
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146515%27 HTTP/1.1" 200 None
2026-03-29 22:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146515 not downloaded yet
2026-03-29 22:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG14ZWE/42811220?sv=2020-08-04&st=2026-03-29T22%3A04%3A18Z&se=2026-03-29T22%3A29%3A18Z&sr=b&sp=r&sig=cnrBVHx917608ZNQdYLaL9kbd9WqnADMOSSO4ZVtpmw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:04:23 [bca.uk] INFO: Found listing with ID: PL07%20HRM
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL07%2520HRM%27 HTTP/1.1" 200 None
2026-03-29 22:04:23 [bca.uk] INFO: Scrape type for PL07%20HRM: 1
2026-03-29 22:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f87fc02-985b-5b39-b30d-ff94e761a881 with identifier: PL07%20HRM
2026-03-29 22:04:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3f87fc02-985b-5b39-b30d-ff94e761a881
2026-03-29 22:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a8f01490-6423-5923-91af-5ee6fce8e9e8 with identifier: NA55%20RWJ
2026-03-29 22:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a8f01490-6423-5923-91af-5ee6fce8e9e8 with identifier: NA55%20RWJ
2026-03-29 22:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a8f01490-6423-5923-91af-5ee6fce8e9e8 with identifier: NA55%20RWJ to the API
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NA55%20RWJ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a8f01490-6423-5923-91af-5ee6fce8e9e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NA55 RWJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NA55%20RWJ&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 67643,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 GHIA Hatchback',
'transmission': 'automatic',
'trim': 'GHIA',
'vin': 'WF05XXWPD55G28352',
'year': 2005}
2026-03-29 22:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA55%2520RWJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Saving data for NA55%20RWJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774217341.258697, 'last_price_update_time': 1774821864.00095}
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NA55%2520RWJ') HTTP/1.1" 204 0
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388354%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388354 not downloaded yet
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126491%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126491 not downloaded yet
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455813%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455813 not downloaded yet
2026-03-29 22:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146453/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX19EAW/42811440?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=C09nMtphJ%2F5qYIljNXrzNSV5bitAE4G50wbU1PUP8SU%3D)
2026-03-29 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126413/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126413>
2026-03-29 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146472/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146472>
2026-03-29 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146479/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146479>
2026-03-29 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388285/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388285>
2026-03-29 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK54OMR/42811990?sv=2020-08-04&st=2026-03-29T22%3A04%3A23Z&se=2026-03-29T22%3A29%3A23Z&sr=b&sp=r&sig=VkfxGSyJ7FeZDeyrP5eg1nwFrw5WiMaWZ44byiJeVbU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK54%20OMR-GB>
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: CT62%20GYZ
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT62%2520GYZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for CT62%20GYZ: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: CN13%20NXJ
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN13%2520NXJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for CN13%20NXJ: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: A3%20BJT
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27A3%2520BJT%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for A3%20BJT: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: FJ70%20SUF
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ70%2520SUF%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for FJ70%20SUF: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: OU18%20RUY
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU18%2520RUY%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for OU18%20RUY: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: SL71%20OCC
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL71%2520OCC%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for SL71%20OCC: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: SN71%20GWP
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN71%2520GWP%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for SN71%20GWP: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: SO69%20JVX
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO69%2520JVX%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for SO69%20JVX: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: WF69%20GCK
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF69%2520GCK%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for WF69%20GCK: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: KN22%20NPC
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN22%2520NPC%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for KN22%20NPC: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: RF72%20AYB
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF72%2520AYB%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for RF72%20AYB: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: FD18%20UGG
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD18%2520UGG%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for FD18%20UGG: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: AJ64%20FXV
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ64%2520FXV%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for AJ64%20FXV: 2
2026-03-29 22:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9c90331-8a21-5785-a0b4-b9675eaebcdf with identifier: AJ64%20FXV
2026-03-29 22:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9c90331-8a21-5785-a0b4-b9675eaebcdf with scrape type 2
2026-03-29 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9c90331-8a21-5785-a0b4-b9675eaebcdf with scrape type 2
2026-03-29 22:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d9c90331-8a21-5785-a0b4-b9675eaebcdf, identifier: AJ64%20FXV
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146525%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146525 not downloaded yet
2026-03-29 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611bfa90>
2026-03-29 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_expert_report_file_404ee40e-23a3-4c5c-9350-efa370b462d4.pdf HTTP/1.1" 201 0
2026-03-29 22:04:24 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1b1dd0d2-b075-5313-b500-f3a78c134e6f
2026-03-29 22:04:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b1dd0d2-b075-5313-b500-f3a78c134e6f, skipping ID generation
2026-03-29 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b1dd0d2-b075-5313-b500-f3a78c134e6f
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOV08ECZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV08ECZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6112be50>
2026-03-29 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FP17LPT%252F686575349%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575349/600 saved to cache
2026-03-29 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9
2026-03-29 22:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6112f790>
2026-03-29 22:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX19EAW%252F699146447%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146447/600 saved to cache
2026-03-29 22:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6
2026-03-29 22:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126426/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126426>
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: RN55%20LJO
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RN55%2520LJO%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for RN55%20LJO: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: GP07%20MXH
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP07%2520MXH%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for GP07%20MXH: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: MV55%20NGY
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV55%2520NGY%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for MV55%20NGY: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: ST64%20XKB
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST64%2520XKB%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for ST64%20XKB: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: VK14%20FOH
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK14%2520FOH%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for VK14%20FOH: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: YK65%20EHU
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK65%2520EHU%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for YK65%20EHU: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: FN65%20TSO
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN65%2520TSO%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for FN65%20TSO: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: GL16%20YMC
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL16%2520YMC%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for GL16%20YMC: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: LA66%20BZK
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA66%2520BZK%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for LA66%20BZK: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: MV65%20VGA
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV65%2520VGA%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for MV65%20VGA: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: OE14%20RHA
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE14%2520RHA%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for OE14%20RHA: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: OV67%20VJU
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV67%2520VJU%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for OV67%20VJU: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: RE17%20OYR
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE17%2520OYR%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for RE17%20OYR: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: SB17%20NXA
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB17%2520NXA%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for SB17%20NXA: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: BG67%20KOD
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG67%2520KOD%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for BG67%20KOD: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: DU64%20BVB
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU64%2520BVB%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for DU64%20BVB: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: HN15%20RRX
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN15%2520RRX%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for HN15%20RRX: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: MK58%20UPV
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK58%2520UPV%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for MK58%20UPV: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: PY16%20BBU
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY16%2520BBU%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for PY16%20BBU: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: CE08%20LTJ
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE08%2520LTJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for CE08%20LTJ: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: WK61%20UXR
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK61%2520UXR%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for WK61%20UXR: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: MX09%20EXN
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX09%2520EXN%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for MX09%20EXN: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: VF15%20SWN
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF15%2520SWN%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for VF15%20SWN: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: YP58%20TTV
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP58%2520TTV%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for YP58%20TTV: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: DN20%20OOC
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN20%2520OOC%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for DN20%20OOC: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: DV69%20CWO
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV69%2520CWO%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for DV69%20CWO: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: L30%20TEG
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L30%2520TEG%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for L30%20TEG: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: BK23%20XKA
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK23%2520XKA%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for BK23%20XKA: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: HS71%20CVW
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HS71%2520CVW%27 HTTP/1.1" 200 None
2026-03-29 22:04:24 [bca.uk] INFO: Scrape type for HS71%20CVW: 0
2026-03-29 22:04:24 [bca.uk] INFO: Found listing with ID: KW73%20UBC
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW73%2520UBC%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for KW73%20UBC: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: DA71%20MYO
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA71%2520MYO%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for DA71%20MYO: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: DM21%20HLO
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DM21%2520HLO%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for DM21%20HLO: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: DN68%20UDD
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN68%2520UDD%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for DN68%20UDD: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: DY11%20NRK
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY11%2520NRK%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for DY11%20NRK: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: PN70%20MWJ
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN70%2520MWJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for PN70%20MWJ: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: YG72%20XFU
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG72%2520XFU%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for YG72%20XFU: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: YL72%20BFZ
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL72%2520BFZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for YL72%20BFZ: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: MW68%20VUP
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW68%2520VUP%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for MW68%20VUP: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: YM70%20OXV
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM70%2520OXV%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for YM70%20OXV: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: AK65%20EWX
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK65%2520EWX%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for AK65%20EWX: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: DS69%20ZZG
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS69%2520ZZG%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for DS69%20ZZG: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: GJ21%20XBW
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ21%2520XBW%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for GJ21%20XBW: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: GX15%20BPV
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX15%2520BPV%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for GX15%20BPV: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: LM69%20UOE
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM69%2520UOE%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for LM69%20UOE: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: LX13%20YTO
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX13%2520YTO%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for LX13%20YTO: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: PJ71%20MWM
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ71%2520MWM%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for PJ71%20MWM: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: SL67%20GZU
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL67%2520GZU%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for SL67%20GZU: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: FE70%20WJM
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE70%2520WJM%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for FE70%20WJM: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: FX24%20TLO
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX24%2520TLO%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for FX24%20TLO: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: DY63%20YYG
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY63%2520YYG%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for DY63%20YYG: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: EF67%20WZZ
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF67%2520WZZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for EF67%20WZZ: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: FD23%20AYV
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD23%2520AYV%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for FD23%20AYV: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: MT19%20OHR
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT19%2520OHR%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for MT19%20OHR: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: RK15%20VFL
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK15%2520VFL%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for RK15%20VFL: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: YS70%20AEG
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS70%2520AEG%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for YS70%20AEG: 0
2026-03-29 22:04:25 [bca.uk] INFO: Found listing with ID: YT19%20XLR
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT19%2520XLR%27 HTTP/1.1" 200 None
2026-03-29 22:04:25 [bca.uk] INFO: Scrape type for YT19%20XLR: 2
2026-03-29 22:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a478850-9e1b-5eb6-ae39-e00e28c70dc9 with identifier: YT19%20XLR
2026-03-29 22:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a478850-9e1b-5eb6-ae39-e00e28c70dc9 with scrape type 2
2026-03-29 22:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a478850-9e1b-5eb6-ae39-e00e28c70dc9 with scrape type 2
2026-03-29 22:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8a478850-9e1b-5eb6-ae39-e00e28c70dc9, identifier: YT19%20XLR
2026-03-29 22:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d9c90331-8a21-5785-a0b4-b9675eaebcdf with identifier: AJ64%20FXV
2026-03-29 22:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d9c90331-8a21-5785-a0b4-b9675eaebcdf with identifier: AJ64%20FXV
2026-03-29 22:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d9c90331-8a21-5785-a0b4-b9675eaebcdf with identifier: AJ64%20FXV to the API
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AJ64%20FXV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd9c90331-8a21-5785-a0b4-b9675eaebcdf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AJ64 FXV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AJ64%20FXV&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BMW',
'model': '420I',
'odometer': 49513,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'BMW 420I 2.0 T M SPORT Coupe',
'transmission': 'manual',
'trim': 'T M SPORT',
'vin': 'WBA3N12060KK99545',
'year': 2015}
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ64%2520FXV%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Saving data for AJ64%20FXV: {'auction_closing_time': 1774951200.0, 'created_time': 1774610825.378438, 'last_price_update_time': 1774821866.09285}
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AJ64%2520FXV') HTTP/1.1" 204 0
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388388%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388388 not downloaded yet
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126524%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126524 not downloaded yet
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455816%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455816 not downloaded yet
2026-03-29 22:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8a478850-9e1b-5eb6-ae39-e00e28c70dc9 with identifier: YT19%20XLR
2026-03-29 22:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8a478850-9e1b-5eb6-ae39-e00e28c70dc9 with identifier: YT19%20XLR
2026-03-29 22:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8a478850-9e1b-5eb6-ae39-e00e28c70dc9 with identifier: YT19%20XLR to the API
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 164,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YT19%20XLR-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8a478850-9e1b-5eb6-ae39-e00e28c70dc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YT19 XLR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YT19%20XLR&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VAUXHALL',
'model': 'VIVARO 2.9T',
'odometer': 35312,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL VIVARO 2.9T 1.6 CDTI 120 LWB COMBI CrewCab Van',
'transmission': 'manual',
'trim': 'CDTI 120 LWB COMBI',
'vin': 'W0VJ7H60XKV631839',
'year': 2019}
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT19%2520XLR%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Saving data for YT19%20XLR: {'auction_closing_time': 1775037600.0, 'created_time': 1774004737.072236, 'last_price_update_time': 1774821866.592486}
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YT19%2520XLR') HTTP/1.1" 204 0
2026-03-29 22:04:26 [bca.uk] INFO: Found listing with ID: LH16%20AFY
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LH16%2520AFY%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Scrape type for LH16%20AFY: 0
2026-03-29 22:04:26 [bca.uk] INFO: Found listing with ID: MT64%20YKC
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT64%2520YKC%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Scrape type for MT64%20YKC: 0
2026-03-29 22:04:26 [bca.uk] INFO: Found listing with ID: OV59%20AUR
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV59%2520AUR%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Scrape type for OV59%20AUR: 0
2026-03-29 22:04:26 [bca.uk] INFO: Found listing with ID: BD17%20FTU
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD17%2520FTU%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Scrape type for BD17%20FTU: 0
2026-03-29 22:04:26 [bca.uk] INFO: Found listing with ID: LC14%20LME
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC14%2520LME%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Scrape type for LC14%20LME: 0
2026-03-29 22:04:26 [bca.uk] INFO: Found listing with ID: WU61%20WUW
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU61%2520WUW%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Scrape type for WU61%20WUW: 0
2026-03-29 22:04:26 [bca.uk] INFO: Found listing with ID: YC13%20XDV
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC13%2520XDV%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Scrape type for YC13%20XDV: 0
2026-03-29 22:04:26 [bca.uk] INFO: Found listing with ID: AE13%20RKK
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE13%2520RKK%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Scrape type for AE13%20RKK: 2
2026-03-29 22:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a026f4c-2ec7-5510-942a-43523cf01cd0 with identifier: AE13%20RKK
2026-03-29 22:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a026f4c-2ec7-5510-942a-43523cf01cd0 with scrape type 2
2026-03-29 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a026f4c-2ec7-5510-942a-43523cf01cd0 with scrape type 2
2026-03-29 22:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3a026f4c-2ec7-5510-942a-43523cf01cd0, identifier: AE13%20RKK
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145974%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145974 not downloaded yet
2026-03-29 22:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126400/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU68FGN/42811417?sv=2020-08-04&st=2026-03-29T22%3A04%3A13Z&se=2026-03-29T22%3A29%3A13Z&sr=b&sp=r&sig=RCrqulUVcgAVBuj9iX2cS9VTIHmOPa8of1NBVC2WuDI%3D)
2026-03-29 22:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146466/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX19EAW/42811440?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=C09nMtphJ%2F5qYIljNXrzNSV5bitAE4G50wbU1PUP8SU%3D)
2026-03-29 22:04:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388308/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388308>
2026-03-29 22:04:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126445/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126445>
2026-03-29 22:04:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146501/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146501>
2026-03-29 22:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126406/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU68FGN/42811417?sv=2020-08-04&st=2026-03-29T22%3A04%3A13Z&se=2026-03-29T22%3A29%3A13Z&sr=b&sp=r&sig=RCrqulUVcgAVBuj9iX2cS9VTIHmOPa8of1NBVC2WuDI%3D)
2026-03-29 22:04:26 [bca.uk] INFO: Found listing with ID: SR19%20HYZ
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520HYZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Scrape type for SR19%20HYZ: 0
2026-03-29 22:04:26 [bca.uk] INFO: Found listing with ID: OV25%20LLU
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV25%2520LLU%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Scrape type for OV25%20LLU: 0
2026-03-29 22:04:26 [bca.uk] INFO: Found listing with ID: DA12%20XBB
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA12%2520XBB%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Scrape type for DA12%20XBB: 0
2026-03-29 22:04:26 [bca.uk] INFO: Found listing with ID: YY56%20OTV
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY56%2520OTV%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Scrape type for YY56%20OTV: 0
2026-03-29 22:04:26 [bca.uk] INFO: Found listing with ID: YY62%20JFU
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY62%2520JFU%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Scrape type for YY62%20JFU: 0
2026-03-29 22:04:26 [bca.uk] INFO: Found listing with ID: V90%20PWH
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V90%2520PWH%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Scrape type for V90%20PWH: 0
2026-03-29 22:04:26 [bca.uk] INFO: Found listing with ID: F28%20FXY
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27F28%2520FXY%27 HTTP/1.1" 200 None
2026-03-29 22:04:26 [bca.uk] INFO: Scrape type for F28%20FXY: 0
2026-03-29 22:04:26 [bca.uk] INFO: Found listing with ID: MX69%20MZL
2026-03-29 22:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX69%2520MZL%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for MX69%20MZL: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: SV21%20OYP
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV21%2520OYP%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for SV21%20OYP: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: PS61%20BAD
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PS61%2520BAD%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for PS61%20BAD: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: LV17%20NZE
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV17%2520NZE%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for LV17%20NZE: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: GD70%20SRV
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD70%2520SRV%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for GD70%20SRV: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: FE62%20FMX
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE62%2520FMX%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for FE62%20FMX: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: S17%20GON
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S17%2520GON%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for S17%20GON: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: SD22%20AXR
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD22%2520AXR%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for SD22%20AXR: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: YM70%20KJX
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM70%2520KJX%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for YM70%20KJX: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: CU68%20XJE
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU68%2520XJE%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for CU68%20XJE: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: HT71%20UUJ
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT71%2520UUJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for HT71%20UUJ: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: MF69%20WCU
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF69%2520WCU%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for MF69%20WCU: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: SH71%20GJJ
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH71%2520GJJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for SH71%20GJJ: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: GK21%20KXX
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK21%2520KXX%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for GK21%20KXX: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: EO09%20NDU
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO09%2520NDU%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for EO09%20NDU: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: CE64%20ONC
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE64%2520ONC%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for CE64%20ONC: 0
2026-03-29 22:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3a026f4c-2ec7-5510-942a-43523cf01cd0 with identifier: AE13%20RKK
2026-03-29 22:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3a026f4c-2ec7-5510-942a-43523cf01cd0 with identifier: AE13%20RKK
2026-03-29 22:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3a026f4c-2ec7-5510-942a-43523cf01cd0 with identifier: AE13%20RKK to the API
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE13%20RKK-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3a026f4c-2ec7-5510-942a-43523cf01cd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE13 RKK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AE13%20RKK&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 100015,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TI-VCT 125 ZETEC P/S Hatchback',
'transmission': 'automatic',
'trim': 'TI-VCT 125 ZETEC P/S',
'vin': 'WF0KXXGCBKDJ59375',
'year': 2013}
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE13%2520RKK%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Saving data for AE13%20RKK: {'auction_closing_time': 1774864800.0, 'created_time': 1774505164.573796, 'last_price_update_time': 1774821867.661874}
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AE13%2520RKK') HTTP/1.1" 204 0
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388424%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388424 not downloaded yet
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126551%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126551 not downloaded yet
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455819%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455819 not downloaded yet
2026-03-29 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614de210>
2026-03-29 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX19EAW%252F699146460%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146460/600 saved to cache
2026-03-29 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6
2026-03-29 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636ce290>
2026-03-29 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_expert_report_file_311e466d-1b94-457e-a041-c34ef2fe8761.pdf HTTP/1.1" 201 0
2026-03-29 22:04:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7e202f37-ad62-5b0d-b809-5a916fb0486e
2026-03-29 22:04:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e202f37-ad62-5b0d-b809-5a916fb0486e, skipping ID generation
2026-03-29 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e202f37-ad62-5b0d-b809-5a916fb0486e
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFG14ZWE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FG14ZWE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61596b10>
2026-03-29 22:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX19EAW%252F699146453%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146453/600 saved to cache
2026-03-29 22:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: YG61%20DFL
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG61%2520DFL%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for YG61%20DFL: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: YJ63%20YJY
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ63%2520YJY%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for YJ63%20YJY: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: AV61%20LYA
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV61%2520LYA%27 HTTP/1.1" 200 None
2026-03-29 22:04:27 [bca.uk] INFO: Scrape type for AV61%20LYA: 0
2026-03-29 22:04:27 [bca.uk] INFO: Found listing with ID: BF13%20DZX
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF13%2520DZX%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [bca.uk] INFO: Scrape type for BF13%20DZX: 0
2026-03-29 22:04:28 [bca.uk] INFO: Found listing with ID: BG67%20GBE
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG67%2520GBE%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [bca.uk] INFO: Scrape type for BG67%20GBE: 0
2026-03-29 22:04:28 [bca.uk] INFO: Found listing with ID: BJ07%20OXE
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ07%2520OXE%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [bca.uk] INFO: Scrape type for BJ07%20OXE: 0
2026-03-29 22:04:28 [bca.uk] INFO: Found listing with ID: CX11%20XLL
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX11%2520XLL%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [bca.uk] INFO: Scrape type for CX11%20XLL: 0
2026-03-29 22:04:28 [bca.uk] INFO: Found listing with ID: DP11%20NCY
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP11%2520NCY%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [bca.uk] INFO: Scrape type for DP11%20NCY: 0
2026-03-29 22:04:28 [bca.uk] INFO: Found listing with ID: EX15%20XAZ
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX15%2520XAZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [bca.uk] INFO: Scrape type for EX15%20XAZ: 0
2026-03-29 22:04:28 [bca.uk] INFO: Found listing with ID: EY56%20YMJ
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY56%2520YMJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [bca.uk] INFO: Scrape type for EY56%20YMJ: 0
2026-03-29 22:04:28 [bca.uk] INFO: Found listing with ID: GU62%20GHN
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU62%2520GHN%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [bca.uk] INFO: Scrape type for GU62%20GHN: 0
2026-03-29 22:04:28 [bca.uk] INFO: Found listing with ID: KU14%20VPZ
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU14%2520VPZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [bca.uk] INFO: Scrape type for KU14%20VPZ: 0
2026-03-29 22:04:28 [bca.uk] INFO: Found listing with ID: RE62%20CVJ
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE62%2520CVJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [bca.uk] INFO: Scrape type for RE62%20CVJ: 0
2026-03-29 22:04:28 [bca.uk] INFO: Found listing with ID: WN57%20EYX
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN57%2520EYX%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [bca.uk] INFO: Scrape type for WN57%20EYX: 0
2026-03-29 22:04:28 [bca.uk] INFO: Found listing with ID: AP57%20OHZ
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP57%2520OHZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [bca.uk] INFO: Scrape type for AP57%20OHZ: 0
2026-03-29 22:04:28 [bca.uk] INFO: Found listing with ID: KW68%20KFK
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW68%2520KFK%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [bca.uk] INFO: Scrape type for KW68%20KFK: 0
2026-03-29 22:04:28 [bca.uk] INFO: Found listing with ID: BG18%20KHJ
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG18%2520KHJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [bca.uk] INFO: Scrape type for BG18%20KHJ: 0
2026-03-29 22:04:28 [bca.uk] INFO: Found listing with ID: MD18%20JVV
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD18%2520JVV%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [bca.uk] INFO: Scrape type for MD18%20JVV: 2
2026-03-29 22:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c40d80cd-61c7-51ad-9a2c-c9c85c7995e3 with identifier: MD18%20JVV
2026-03-29 22:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c40d80cd-61c7-51ad-9a2c-c9c85c7995e3 with scrape type 2
2026-03-29 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c40d80cd-61c7-51ad-9a2c-c9c85c7995e3 with scrape type 2
2026-03-29 22:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c40d80cd-61c7-51ad-9a2c-c9c85c7995e3, identifier: MD18%20JVV
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145982%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145982 not downloaded yet
2026-03-29 22:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c40d80cd-61c7-51ad-9a2c-c9c85c7995e3 with identifier: MD18%20JVV
2026-03-29 22:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c40d80cd-61c7-51ad-9a2c-c9c85c7995e3 with identifier: MD18%20JVV
2026-03-29 22:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c40d80cd-61c7-51ad-9a2c-c9c85c7995e3 with identifier: MD18%20JVV to the API
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 96,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MD18%20JVV-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c40d80cd-61c7-51ad-9a2c-c9c85c7995e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MD18 JVV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MD18%20JVV&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'SKODA',
'model': 'CITIGO',
'odometer': 43230,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'SKODA CITIGO 1.0 MPI 60 SE GREENTECH Hatchback',
'transmission': 'manual',
'trim': 'MPI 60 SE GREENTECH',
'vin': 'TMBZZZAAZJD634761',
'year': 2018}
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD18%2520JVV%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [bca.uk] INFO: Saving data for MD18%20JVV: {'auction_closing_time': 1774951200.0, 'created_time': 1774610797.710252, 'last_price_update_time': 1774821868.807544}
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MD18%2520JVV') HTTP/1.1" 204 0
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388441%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388441 not downloaded yet
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126569%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126569 not downloaded yet
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455821%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455821 not downloaded yet
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143520%27 HTTP/1.1" 200 None
2026-03-29 22:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143520 not downloaded yet
2026-03-29 22:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX13SXE/42811806?sv=2020-08-04&st=2026-03-29T22%3A04%3A22Z&se=2026-03-29T22%3A29%3A22Z&sr=b&sp=r&sig=3r1JvnjimdGw6bIdCU3v28PgEf%2BVL2n8uM1aCSphqNo%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126413/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU68FGN/42811417?sv=2020-08-04&st=2026-03-29T22%3A04%3A13Z&se=2026-03-29T22%3A29%3A13Z&sr=b&sp=r&sig=RCrqulUVcgAVBuj9iX2cS9VTIHmOPa8of1NBVC2WuDI%3D)
2026-03-29 22:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146479/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX19EAW/42811440?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=C09nMtphJ%2F5qYIljNXrzNSV5bitAE4G50wbU1PUP8SU%3D)
2026-03-29 22:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388285/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL68UZJ/42811837?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=nph2F%2FW6m12z%2FYFEj3Ycz1Gy7uXC8be5nXf0j5ESQjw%3D)
2026-03-29 22:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146472/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX19EAW/42811440?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=C09nMtphJ%2F5qYIljNXrzNSV5bitAE4G50wbU1PUP8SU%3D)
2026-03-29 22:04:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146515/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146515>
2026-03-29 22:04:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455810/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SY15YVR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:04:29 [bca.uk] INFO: Found listing with ID: PK67%20ZVU
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK67%2520ZVU%27 HTTP/1.1" 200 None
2026-03-29 22:04:29 [bca.uk] INFO: Scrape type for PK67%20ZVU: 2
2026-03-29 22:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4387cdd-cb03-51cb-9d55-c69adf922e47 with identifier: PK67%20ZVU
2026-03-29 22:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4387cdd-cb03-51cb-9d55-c69adf922e47 with scrape type 2
2026-03-29 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4387cdd-cb03-51cb-9d55-c69adf922e47 with scrape type 2
2026-03-29 22:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f4387cdd-cb03-51cb-9d55-c69adf922e47, identifier: PK67%20ZVU
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145988%27 HTTP/1.1" 200 None
2026-03-29 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145988 not downloaded yet
2026-03-29 22:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b3f50>
2026-03-29 22:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU68FGN%252F699126400%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126400/600 saved to cache
2026-03-29 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f30cd769-41b2-536f-8ff2-a84f39302250
2026-03-29 22:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6363ab90>
2026-03-29 22:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX19EAW%252F699146466%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146466/600 saved to cache
2026-03-29 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6
2026-03-29 22:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61047fd0>
2026-03-29 22:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU68FGN%252F699126406%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126406/600 saved to cache
2026-03-29 22:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f30cd769-41b2-536f-8ff2-a84f39302250
2026-03-29 22:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK54OMR/42811990?sv=2020-08-04&st=2026-03-29T22%3A04%3A23Z&se=2026-03-29T22%3A29%3A23Z&sr=b&sp=r&sig=VkfxGSyJ7FeZDeyrP5eg1nwFrw5WiMaWZ44byiJeVbU%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f4387cdd-cb03-51cb-9d55-c69adf922e47 with identifier: PK67%20ZVU
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 22:04:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f4387cdd-cb03-51cb-9d55-c69adf922e47 with identifier: PK67%20ZVU
2026-03-29 22:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f4387cdd-cb03-51cb-9d55-c69adf922e47 with identifier: PK67%20ZVU to the API
2026-03-29 22:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK67%20ZVU-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f4387cdd-cb03-51cb-9d55-c69adf922e47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK67 ZVU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PK67%20ZVU&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'BMW',
'model': '318I',
'odometer': 96613,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'BMW 318I 1.5 T SPORT TOURING STEP Estate',
'transmission': 'automatic',
'trim': 'T SPORT TOURING STEP',
'vin': 'WBA8K12050A032918',
'year': 2017}
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK67%2520ZVU%27 HTTP/1.1" 200 None
2026-03-29 22:04:30 [bca.uk] INFO: Saving data for PK67%20ZVU: {'auction_closing_time': 1774864800.0, 'created_time': 1774620224.15586, 'last_price_update_time': 1774821870.316663}
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PK67%2520ZVU') HTTP/1.1" 204 0
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455824%27 HTTP/1.1" 200 None
2026-03-29 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455824 not downloaded yet
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143532%27 HTTP/1.1" 200 None
2026-03-29 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143532 not downloaded yet
2026-03-29 22:04:30 [bca.uk] INFO: Found listing with ID: EG17%20GCX
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EG17%2520GCX%27 HTTP/1.1" 200 None
2026-03-29 22:04:30 [bca.uk] INFO: Scrape type for EG17%20GCX: 0
2026-03-29 22:04:30 [bca.uk] INFO: Found listing with ID: KY16%20YLL
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY16%2520YLL%27 HTTP/1.1" 200 None
2026-03-29 22:04:30 [bca.uk] INFO: Scrape type for KY16%20YLL: 0
2026-03-29 22:04:30 [bca.uk] INFO: Found listing with ID: LN12%20FCM
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN12%2520FCM%27 HTTP/1.1" 200 None
2026-03-29 22:04:30 [bca.uk] INFO: Scrape type for LN12%20FCM: 2
2026-03-29 22:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a73df775-249e-50c5-b56f-6c6c97beefc5 with identifier: LN12%20FCM
2026-03-29 22:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a73df775-249e-50c5-b56f-6c6c97beefc5 with scrape type 2
2026-03-29 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a73df775-249e-50c5-b56f-6c6c97beefc5 with scrape type 2
2026-03-29 22:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a73df775-249e-50c5-b56f-6c6c97beefc5, identifier: LN12%20FCM
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145994%27 HTTP/1.1" 200 None
2026-03-29 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145994 not downloaded yet
2026-03-29 22:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126524/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126524>
2026-03-29 22:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126445/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU68FGN/42811417?sv=2020-08-04&st=2026-03-29T22%3A04%3A13Z&se=2026-03-29T22%3A29%3A13Z&sr=b&sp=r&sig=RCrqulUVcgAVBuj9iX2cS9VTIHmOPa8of1NBVC2WuDI%3D)
2026-03-29 22:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388388/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388388>
2026-03-29 22:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455816/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455816>
2026-03-29 22:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126426/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU68FGN/42811417?sv=2020-08-04&st=2026-03-29T22%3A04%3A13Z&se=2026-03-29T22%3A29%3A13Z&sr=b&sp=r&sig=RCrqulUVcgAVBuj9iX2cS9VTIHmOPa8of1NBVC2WuDI%3D)
2026-03-29 22:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388308/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL68UZJ/42811837?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=nph2F%2FW6m12z%2FYFEj3Ycz1Gy7uXC8be5nXf0j5ESQjw%3D)
2026-03-29 22:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a73df775-249e-50c5-b56f-6c6c97beefc5 with identifier: LN12%20FCM
2026-03-29 22:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a73df775-249e-50c5-b56f-6c6c97beefc5 with identifier: LN12%20FCM
2026-03-29 22:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a73df775-249e-50c5-b56f-6c6c97beefc5 with identifier: LN12%20FCM to the API
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LN12%20FCM-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a73df775-249e-50c5-b56f-6c6c97beefc5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LN12 FCM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LN12%20FCM&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'AUDI',
'model': 'A1',
'odometer': 51546,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'AUDI A1 1.4 TFSI 125 S LINE S-T Hatchback',
'transmission': 'automatic',
'trim': 'TFSI 125 S LINE S-T',
'vin': 'WAUZZZ8X8DB003352',
'year': 2023}
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN12%2520FCM%27 HTTP/1.1" 200 None
2026-03-29 22:04:30 [bca.uk] INFO: Saving data for LN12%20FCM: {'auction_closing_time': 1774864800.0, 'created_time': 1774391926.916378, 'last_price_update_time': 1774821870.883786}
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LN12%2520FCM') HTTP/1.1" 204 0
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455828%27 HTTP/1.1" 200 None
2026-03-29 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455828 not downloaded yet
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143543%27 HTTP/1.1" 200 None
2026-03-29 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143543 not downloaded yet
2026-03-29 22:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146501/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX19EAW/42811440?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=C09nMtphJ%2F5qYIljNXrzNSV5bitAE4G50wbU1PUP8SU%3D)
2026-03-29 22:04:30 [bca.uk] INFO: Found listing with ID: EU56%20DXM
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU56%2520DXM%27 HTTP/1.1" 200 None
2026-03-29 22:04:30 [bca.uk] INFO: Scrape type for EU56%20DXM: 2
2026-03-29 22:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21ffa1bb-824d-55f6-b035-f6cfc93459bb with identifier: EU56%20DXM
2026-03-29 22:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21ffa1bb-824d-55f6-b035-f6cfc93459bb with scrape type 2
2026-03-29 22:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21ffa1bb-824d-55f6-b035-f6cfc93459bb with scrape type 2
2026-03-29 22:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 21ffa1bb-824d-55f6-b035-f6cfc93459bb, identifier: EU56%20DXM
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146000%27 HTTP/1.1" 200 None
2026-03-29 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146000 not downloaded yet
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61200dd0>
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_expert_report_file_3ab8d9a5-7bd3-4ff8-89b7-e3fa725beb0e.pdf HTTP/1.1" 201 0
2026-03-29 22:04:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 82d2359b-1b38-5883-aaa0-bf564ebc3211
2026-03-29 22:04:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82d2359b-1b38-5883-aaa0-bf564ebc3211, skipping ID generation
2026-03-29 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82d2359b-1b38-5883-aaa0-bf564ebc3211
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGX13SXE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GX13SXE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61187b90>
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU68FGN%252F699126413%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126413/600 saved to cache
2026-03-29 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f30cd769-41b2-536f-8ff2-a84f39302250
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620968d0>
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX19EAW%252F699146479%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146479/600 saved to cache
2026-03-29 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61745650>
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL68UZJ%252F699388285%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388285/600 saved to cache
2026-03-29 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d329060a-a095-5b9c-880a-4e9dfce039e5
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6117cc10>
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX19EAW%252F699146472%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146472/600 saved to cache
2026-03-29 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6
2026-03-29 22:04:31 [bca.uk] INFO: Total items found: 100
2026-03-29 22:04:31 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded
2026-03-29 22:04:31 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:04:31 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620668d0>
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_expert_report_file_2a6e1367-28e7-4193-9f67-b4fc7ea3745e.pdf HTTP/1.1" 201 0
2026-03-29 22:04:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2e6514c1-40ff-58ca-8a22-0509f974be50
2026-03-29 22:04:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e6514c1-40ff-58ca-8a22-0509f974be50, skipping ID generation
2026-03-29 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 2e6514c1-40ff-58ca-8a22-0509f974be50
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHK54OMR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HK54OMR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455810/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SY15YVR/42786483?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=FK9rDus56J%2FV9P57RamAAihaU4KAtLW5HM1X4F9VrHo%3D)
2026-03-29 22:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 21ffa1bb-824d-55f6-b035-f6cfc93459bb with identifier: EU56%20DXM
2026-03-29 22:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 21ffa1bb-824d-55f6-b035-f6cfc93459bb with identifier: EU56%20DXM
2026-03-29 22:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 21ffa1bb-824d-55f6-b035-f6cfc93459bb with identifier: EU56%20DXM to the API
2026-03-29 22:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 410,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EU56%20DXM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '6.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '21ffa1bb-824d-55f6-b035-f6cfc93459bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EU56 DXM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EU56%20DXM&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'BENTLEY',
'model': 'CONTINENTAL GT',
'odometer': 71234,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'BENTLEY CONTINENTAL GT 6.0 W12 Coupe',
'transmission': 'manual',
'trim': 'W12',
'vin': 'SCBCE63W27C042683',
'year': 2006}
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU56%2520DXM%27 HTTP/1.1" 200 None
2026-03-29 22:04:32 [bca.uk] INFO: Saving data for EU56%20DXM: {'auction_closing_time': 1774864800.0, 'created_time': 1773823586.231394, 'last_price_update_time': 1774821872.743521}
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EU56%2520DXM') HTTP/1.1" 204 0
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455831%27 HTTP/1.1" 200 None
2026-03-29 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455831 not downloaded yet
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143566%27 HTTP/1.1" 200 None
2026-03-29 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143566 not downloaded yet
2026-03-29 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455819/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455819>
2026-03-29 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126551/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126551>
2026-03-29 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145982/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145982>
2026-03-29 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388424/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388424>
2026-03-29 22:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143510/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FG14ZWE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:04:32 [bca.uk] INFO: Found listing with ID: EA63%20PVE
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA63%2520PVE%27 HTTP/1.1" 200 None
2026-03-29 22:04:32 [bca.uk] INFO: Scrape type for EA63%20PVE: 0
2026-03-29 22:04:32 [bca.uk] INFO: Found listing with ID: FH08%20KSZ
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH08%2520KSZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:32 [bca.uk] INFO: Scrape type for FH08%20KSZ: 0
2026-03-29 22:04:32 [bca.uk] INFO: Found listing with ID: GL67%20YWJ
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL67%2520YWJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:32 [bca.uk] INFO: Scrape type for GL67%20YWJ: 0
2026-03-29 22:04:32 [bca.uk] INFO: Found listing with ID: T140%20LPV
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T140%2520LPV%27 HTTP/1.1" 200 None
2026-03-29 22:04:32 [bca.uk] INFO: Scrape type for T140%20LPV: 0
2026-03-29 22:04:32 [bca.uk] INFO: Found listing with ID: WJ61%20HNH
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ61%2520HNH%27 HTTP/1.1" 200 None
2026-03-29 22:04:32 [bca.uk] INFO: Scrape type for WJ61%20HNH: 0
2026-03-29 22:04:32 [bca.uk] INFO: Found listing with ID: VN17%20XMU
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN17%2520XMU%27 HTTP/1.1" 200 None
2026-03-29 22:04:32 [bca.uk] INFO: Scrape type for VN17%20XMU: 2
2026-03-29 22:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c18cdca-d5d0-5915-ac3b-d36940c73bb9 with identifier: VN17%20XMU
2026-03-29 22:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c18cdca-d5d0-5915-ac3b-d36940c73bb9 with scrape type 2
2026-03-29 22:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c18cdca-d5d0-5915-ac3b-d36940c73bb9 with scrape type 2
2026-03-29 22:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9c18cdca-d5d0-5915-ac3b-d36940c73bb9, identifier: VN17%20XMU
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146012%27 HTTP/1.1" 200 None
2026-03-29 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146012 not downloaded yet
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144224%27 HTTP/1.1" 200 None
2026-03-29 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144224 not downloaded yet
2026-03-29 22:04:33 [bca.uk] INFO: Found listing with ID: GL12%20WVA
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL12%2520WVA%27 HTTP/1.1" 200 None
2026-03-29 22:04:33 [bca.uk] INFO: Scrape type for GL12%20WVA: 0
2026-03-29 22:04:33 [bca.uk] INFO: Found listing with ID: LS59%20WLK
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS59%2520WLK%27 HTTP/1.1" 200 None
2026-03-29 22:04:33 [bca.uk] INFO: Scrape type for LS59%20WLK: 0
2026-03-29 22:04:33 [bca.uk] INFO: Found listing with ID: PN60%20GZE
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN60%2520GZE%27 HTTP/1.1" 200 None
2026-03-29 22:04:33 [bca.uk] INFO: Scrape type for PN60%20GZE: 0
2026-03-29 22:04:33 [bca.uk] INFO: Found listing with ID: YF10%20RDV
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF10%2520RDV%27 HTTP/1.1" 200 None
2026-03-29 22:04:33 [bca.uk] INFO: Scrape type for YF10%20RDV: 0
2026-03-29 22:04:33 [bca.uk] INFO: Found listing with ID: OY14%20RPZ
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY14%2520RPZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:33 [bca.uk] INFO: Scrape type for OY14%20RPZ: 0
2026-03-29 22:04:33 [bca.uk] INFO: Found listing with ID: LM64%20MUY
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM64%2520MUY%27 HTTP/1.1" 200 None
2026-03-29 22:04:33 [bca.uk] INFO: Scrape type for LM64%20MUY: 2
2026-03-29 22:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30ca613c-fbca-5035-b9ac-c29ab48945e3 with identifier: LM64%20MUY
2026-03-29 22:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ca613c-fbca-5035-b9ac-c29ab48945e3 with scrape type 2
2026-03-29 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30ca613c-fbca-5035-b9ac-c29ab48945e3 with scrape type 2
2026-03-29 22:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 30ca613c-fbca-5035-b9ac-c29ab48945e3, identifier: LM64%20MUY
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391444%27 HTTP/1.1" 200 None
2026-03-29 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391444 not downloaded yet
2026-03-29 22:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63682750>
2026-03-29 22:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU68FGN%252F699126445%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126445/600 saved to cache
2026-03-29 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f30cd769-41b2-536f-8ff2-a84f39302250
2026-03-29 22:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61753e90>
2026-03-29 22:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU68FGN%252F699126426%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126426/600 saved to cache
2026-03-29 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f30cd769-41b2-536f-8ff2-a84f39302250
2026-03-29 22:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61704b90>
2026-03-29 22:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL68UZJ%252F699388308%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388308/600 saved to cache
2026-03-29 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d329060a-a095-5b9c-880a-4e9dfce039e5
2026-03-29 22:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145988/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145988>
2026-03-29 22:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146515/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX19EAW/42811440?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=C09nMtphJ%2F5qYIljNXrzNSV5bitAE4G50wbU1PUP8SU%3D)
2026-03-29 22:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9c18cdca-d5d0-5915-ac3b-d36940c73bb9 with identifier: VN17%20XMU
2026-03-29 22:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9c18cdca-d5d0-5915-ac3b-d36940c73bb9 with identifier: VN17%20XMU
2026-03-29 22:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9c18cdca-d5d0-5915-ac3b-d36940c73bb9 with identifier: VN17%20XMU to the API
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VN17%20XMU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9c18cdca-d5d0-5915-ac3b-d36940c73bb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VN17 XMU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VN17%20XMU&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'BMW',
'model': '2 GRAN TOURER',
'odometer': 119073,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'BMW 2 GRAN TOURER 1.5 218I T SE MPV',
'transmission': 'manual',
'trim': '218I T SE',
'vin': 'WBA2D320305H47414',
'year': 2017}
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN17%2520XMU%27 HTTP/1.1" 200 None
2026-03-29 22:04:33 [bca.uk] INFO: Saving data for VN17%20XMU: {'auction_closing_time': 1774864800.0, 'created_time': 1773958056.28463, 'last_price_update_time': 1774821873.752433}
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VN17%2520XMU') HTTP/1.1" 204 0
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455836%27 HTTP/1.1" 200 None
2026-03-29 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455836 not downloaded yet
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143581%27 HTTP/1.1" 200 None
2026-03-29 22:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143581 not downloaded yet
2026-03-29 22:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 30ca613c-fbca-5035-b9ac-c29ab48945e3 with identifier: LM64%20MUY
2026-03-29 22:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 30ca613c-fbca-5035-b9ac-c29ab48945e3 with identifier: LM64%20MUY
2026-03-29 22:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 30ca613c-fbca-5035-b9ac-c29ab48945e3 with identifier: LM64%20MUY to the API
2026-03-29 22:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM64%20MUY-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '30ca613c-fbca-5035-b9ac-c29ab48945e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM64 MUY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM64%20MUY&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'VAUXHALL',
'model': 'MERIVA',
'odometer': 82907,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL MERIVA 1.4 16V TECH LINE MPV',
'transmission': 'manual',
'trim': '16V TECH LINE',
'vin': 'W0LSH9EC1F4006219',
'year': 2014}
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM64%2520MUY%27 HTTP/1.1" 200 None
2026-03-29 22:04:34 [bca.uk] INFO: Saving data for LM64%20MUY: {'auction_closing_time': 1774864800.0, 'created_time': 1774275069.962502, 'last_price_update_time': 1774821874.746486}
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM64%2520MUY') HTTP/1.1" 204 0
2026-03-29 22:04:34 [bca.uk] INFO: Found listing with ID: GN64%20XOK
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN64%2520XOK%27 HTTP/1.1" 200 None
2026-03-29 22:04:34 [bca.uk] INFO: Scrape type for GN64%20XOK: 2
2026-03-29 22:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c96d199-e262-5e28-9dee-d16d66f5672e with identifier: GN64%20XOK
2026-03-29 22:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c96d199-e262-5e28-9dee-d16d66f5672e with scrape type 2
2026-03-29 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c96d199-e262-5e28-9dee-d16d66f5672e with scrape type 2
2026-03-29 22:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4c96d199-e262-5e28-9dee-d16d66f5672e, identifier: GN64%20XOK
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146022%27 HTTP/1.1" 200 None
2026-03-29 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146022 not downloaded yet
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144230%27 HTTP/1.1" 200 None
2026-03-29 22:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144230 not downloaded yet
2026-03-29 22:04:34 [bca.uk] INFO: Found listing with ID: BD07%20PXG
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD07%2520PXG%27 HTTP/1.1" 200 None
2026-03-29 22:04:34 [bca.uk] INFO: Scrape type for BD07%20PXG: 0
2026-03-29 22:04:34 [bca.uk] INFO: Found listing with ID: EK06%20NPN
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK06%2520NPN%27 HTTP/1.1" 200 None
2026-03-29 22:04:34 [bca.uk] INFO: Scrape type for EK06%20NPN: 0
2026-03-29 22:04:34 [bca.uk] INFO: Found listing with ID: EO58%20AFK
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO58%2520AFK%27 HTTP/1.1" 200 None
2026-03-29 22:04:34 [bca.uk] INFO: Scrape type for EO58%20AFK: 0
2026-03-29 22:04:34 [bca.uk] INFO: Found listing with ID: HN55%20YJE
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN55%2520YJE%27 HTTP/1.1" 200 None
2026-03-29 22:04:34 [bca.uk] INFO: Scrape type for HN55%20YJE: 0
2026-03-29 22:04:34 [bca.uk] INFO: Found listing with ID: KM63%20TVA
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM63%2520TVA%27 HTTP/1.1" 200 None
2026-03-29 22:04:34 [bca.uk] INFO: Scrape type for KM63%20TVA: 0
2026-03-29 22:04:34 [bca.uk] INFO: Found listing with ID: LY56%20OFC
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY56%2520OFC%27 HTTP/1.1" 200 None
2026-03-29 22:04:34 [bca.uk] INFO: Scrape type for LY56%20OFC: 0
2026-03-29 22:04:34 [bca.uk] INFO: Found listing with ID: OY10%20WZO
2026-03-29 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY10%2520WZO%27 HTTP/1.1" 200 None
2026-03-29 22:04:35 [bca.uk] INFO: Scrape type for OY10%20WZO: 0
2026-03-29 22:04:35 [bca.uk] INFO: Found listing with ID: PN60%20AXJ
2026-03-29 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN60%2520AXJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:35 [bca.uk] INFO: Scrape type for PN60%20AXJ: 0
2026-03-29 22:04:35 [bca.uk] INFO: Found listing with ID: CE66%20WTG
2026-03-29 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE66%2520WTG%27 HTTP/1.1" 200 None
2026-03-29 22:04:35 [bca.uk] INFO: Scrape type for CE66%20WTG: 0
2026-03-29 22:04:35 [bca.uk] INFO: Found listing with ID: GM65%20XJX
2026-03-29 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM65%2520XJX%27 HTTP/1.1" 200 None
2026-03-29 22:04:35 [bca.uk] INFO: Scrape type for GM65%20XJX: 2
2026-03-29 22:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fb7b7d6-0d46-5f90-b930-f849a6c33f45 with identifier: GM65%20XJX
2026-03-29 22:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fb7b7d6-0d46-5f90-b930-f849a6c33f45 with scrape type 2
2026-03-29 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fb7b7d6-0d46-5f90-b930-f849a6c33f45 with scrape type 2
2026-03-29 22:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8fb7b7d6-0d46-5f90-b930-f849a6c33f45, identifier: GM65%20XJX
2026-03-29 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391471%27 HTTP/1.1" 200 None
2026-03-29 22:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391471 not downloaded yet
2026-03-29 22:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455816/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SY15YVR/42786483?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=FK9rDus56J%2FV9P57RamAAihaU4KAtLW5HM1X4F9VrHo%3D)
2026-03-29 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143520/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143520>
2026-03-29 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143532/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143532>
2026-03-29 22:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455824/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455824>
2026-03-29 22:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4c96d199-e262-5e28-9dee-d16d66f5672e with identifier: GN64%20XOK
2026-03-29 22:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4c96d199-e262-5e28-9dee-d16d66f5672e with identifier: GN64%20XOK
2026-03-29 22:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4c96d199-e262-5e28-9dee-d16d66f5672e with identifier: GN64%20XOK to the API
2026-03-29 22:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 132,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GN64%20XOK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4c96d199-e262-5e28-9dee-d16d66f5672e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GN64 XOK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GN64%20XOK&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'MERCEDES-BENZ',
'model': 'GLA 220',
'odometer': 80067,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ GLA 220 2.1 CDI 170 AMG LINE PREMIUM+ 4M StationWagon',
'transmission': 'automatic',
'trim': 'CDI 170 AMG LINE PREMIUM+ 4M',
'vin': 'WDC1569052J034917',
'year': 2014}
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN64%2520XOK%27 HTTP/1.1" 200 None
2026-03-29 22:04:36 [bca.uk] INFO: Saving data for GN64%20XOK: {'auction_closing_time': 1774864800.0, 'created_time': 1774620238.24492, 'last_price_update_time': 1774821876.223757}
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GN64%2520XOK') HTTP/1.1" 204 0
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455841%27 HTTP/1.1" 200 None
2026-03-29 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455841 not downloaded yet
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143598%27 HTTP/1.1" 200 None
2026-03-29 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143598 not downloaded yet
2026-03-29 22:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8fb7b7d6-0d46-5f90-b930-f849a6c33f45 with identifier: GM65%20XJX
2026-03-29 22:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8fb7b7d6-0d46-5f90-b930-f849a6c33f45 with identifier: GM65%20XJX
2026-03-29 22:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8fb7b7d6-0d46-5f90-b930-f849a6c33f45 with identifier: GM65%20XJX to the API
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GM65%20XJX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8fb7b7d6-0d46-5f90-b930-f849a6c33f45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GM65 XJX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GM65%20XJX&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 49884,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.2 ACENTA Hatchback',
'transmission': 'manual',
'trim': 'ACENTA',
'vin': 'MDHFBUK13U0862682',
'year': 2016}
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM65%2520XJX%27 HTTP/1.1" 200 None
2026-03-29 22:04:36 [bca.uk] INFO: Saving data for GM65%20XJX: {'auction_closing_time': 1774951200.0, 'created_time': 1774477842.107196, 'last_price_update_time': 1774821876.683637}
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GM65%2520XJX') HTTP/1.1" 204 0
2026-03-29 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617077d0>
2026-03-29 22:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX19EAW%252F699146501%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146501/600 saved to cache
2026-03-29 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6
2026-03-29 22:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615a1350>
2026-03-29 22:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSY15YVR%252F699455810%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455810/600 saved to cache
2026-03-29 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96224006-57cb-587c-9533-8a4dcc309913
2026-03-29 22:04:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455821/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455821>
2026-03-29 22:04:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145994/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145994>
2026-03-29 22:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126524/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU68FGN/42811417?sv=2020-08-04&st=2026-03-29T22%3A04%3A13Z&se=2026-03-29T22%3A29%3A13Z&sr=b&sp=r&sig=RCrqulUVcgAVBuj9iX2cS9VTIHmOPa8of1NBVC2WuDI%3D)
2026-03-29 22:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388388/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL68UZJ/42811837?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=nph2F%2FW6m12z%2FYFEj3Ycz1Gy7uXC8be5nXf0j5ESQjw%3D)
2026-03-29 22:04:36 [bca.uk] INFO: Found listing with ID: SE66%20MHY
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE66%2520MHY%27 HTTP/1.1" 200 None
2026-03-29 22:04:36 [bca.uk] INFO: Scrape type for SE66%20MHY: 2
2026-03-29 22:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15f2a34d-0d63-5d43-b26d-74102f1f9143 with identifier: SE66%20MHY
2026-03-29 22:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f2a34d-0d63-5d43-b26d-74102f1f9143 with scrape type 2
2026-03-29 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15f2a34d-0d63-5d43-b26d-74102f1f9143 with scrape type 2
2026-03-29 22:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 15f2a34d-0d63-5d43-b26d-74102f1f9143, identifier: SE66%20MHY
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146033%27 HTTP/1.1" 200 None
2026-03-29 22:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146033 not downloaded yet
2026-03-29 22:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144233%27 HTTP/1.1" 200 None
2026-03-29 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144233 not downloaded yet
2026-03-29 22:04:37 [bca.uk] INFO: Found listing with ID: LM13%20OUD
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM13%2520OUD%27 HTTP/1.1" 200 None
2026-03-29 22:04:37 [bca.uk] INFO: Scrape type for LM13%20OUD: 0
2026-03-29 22:04:37 [bca.uk] INFO: Found listing with ID: YK16%20DVY
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK16%2520DVY%27 HTTP/1.1" 200 None
2026-03-29 22:04:37 [bca.uk] INFO: Scrape type for YK16%20DVY: 0
2026-03-29 22:04:37 [bca.uk] INFO: Found listing with ID: AV20%20NND
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV20%2520NND%27 HTTP/1.1" 200 None
2026-03-29 22:04:37 [bca.uk] INFO: Scrape type for AV20%20NND: 0
2026-03-29 22:04:37 [bca.uk] INFO: Found listing with ID: BU68%20WHE
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU68%2520WHE%27 HTTP/1.1" 200 None
2026-03-29 22:04:37 [bca.uk] INFO: Scrape type for BU68%20WHE: 0
2026-03-29 22:04:37 [bca.uk] INFO: Found listing with ID: HY66%20HXR
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY66%2520HXR%27 HTTP/1.1" 200 None
2026-03-29 22:04:37 [bca.uk] INFO: Scrape type for HY66%20HXR: 0
2026-03-29 22:04:37 [bca.uk] INFO: Found listing with ID: KV16%20LZF
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV16%2520LZF%27 HTTP/1.1" 200 None
2026-03-29 22:04:37 [bca.uk] INFO: Scrape type for KV16%20LZF: 0
2026-03-29 22:04:37 [bca.uk] INFO: Found listing with ID: SC14%20THU
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC14%2520THU%27 HTTP/1.1" 200 None
2026-03-29 22:04:37 [bca.uk] INFO: Scrape type for SC14%20THU: 0
2026-03-29 22:04:37 [bca.uk] INFO: Found listing with ID: SF17%20SCY
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF17%2520SCY%27 HTTP/1.1" 200 None
2026-03-29 22:04:37 [bca.uk] INFO: Scrape type for SF17%20SCY: 0
2026-03-29 22:04:37 [bca.uk] INFO: Found listing with ID: DJZ%208625
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DJZ%25208625%27 HTTP/1.1" 200 None
2026-03-29 22:04:37 [bca.uk] INFO: Scrape type for DJZ%208625: 0
2026-03-29 22:04:37 [bca.uk] INFO: Found listing with ID: AK17%20XMM
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK17%2520XMM%27 HTTP/1.1" 200 None
2026-03-29 22:04:37 [bca.uk] INFO: Scrape type for AK17%20XMM: 2
2026-03-29 22:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ca8cc4d-bd44-5ffd-a0ea-2019df79ffac with identifier: AK17%20XMM
2026-03-29 22:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ca8cc4d-bd44-5ffd-a0ea-2019df79ffac with scrape type 2
2026-03-29 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ca8cc4d-bd44-5ffd-a0ea-2019df79ffac with scrape type 2
2026-03-29 22:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9ca8cc4d-bd44-5ffd-a0ea-2019df79ffac, identifier: AK17%20XMM
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391504%27 HTTP/1.1" 200 None
2026-03-29 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391504 not downloaded yet
2026-03-29 22:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 15f2a34d-0d63-5d43-b26d-74102f1f9143 with identifier: SE66%20MHY
2026-03-29 22:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 15f2a34d-0d63-5d43-b26d-74102f1f9143 with identifier: SE66%20MHY
2026-03-29 22:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 15f2a34d-0d63-5d43-b26d-74102f1f9143 with identifier: SE66%20MHY to the API
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SE66%20MHY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '15f2a34d-0d63-5d43-b26d-74102f1f9143',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SE66 MHY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SE66%20MHY&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'KIA',
'model': 'SORENTO',
'odometer': 99764,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'KIA SORENTO 2.2 CRDI KX-3 StationWagon',
'transmission': 'automatic',
'trim': 'CRDI KX-3',
'vin': 'KNAPH81BSG5257191',
'year': 2017}
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE66%2520MHY%27 HTTP/1.1" 200 None
2026-03-29 22:04:37 [bca.uk] INFO: Saving data for SE66%20MHY: {'auction_closing_time': 1774864800.0, 'created_time': 1774620240.4991, 'last_price_update_time': 1774821877.594003}
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SE66%2520MHY') HTTP/1.1" 204 0
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143621%27 HTTP/1.1" 200 None
2026-03-29 22:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143621 not downloaded yet
2026-03-29 22:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9ca8cc4d-bd44-5ffd-a0ea-2019df79ffac with identifier: AK17%20XMM
2026-03-29 22:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9ca8cc4d-bd44-5ffd-a0ea-2019df79ffac with identifier: AK17%20XMM
2026-03-29 22:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9ca8cc4d-bd44-5ffd-a0ea-2019df79ffac with identifier: AK17%20XMM to the API
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK17%20XMM-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9ca8cc4d-bd44-5ffd-a0ea-2019df79ffac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AK17 XMM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AK17%20XMM&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'DACIA',
'model': 'SANDERO',
'odometer': 48324,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'DACIA SANDERO 1.0 SCE AMBIANCE Hatchback',
'transmission': 'manual',
'trim': 'SCE AMBIANCE',
'vin': 'UU15SDMC557970766',
'year': 2017}
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK17%2520XMM%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Saving data for AK17%20XMM: {'auction_closing_time': 1774951200.0, 'created_time': 1774620615.466095, 'last_price_update_time': 1774821878.074999}
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AK17%2520XMM') HTTP/1.1" 204 0
2026-03-29 22:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145982/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV08ECZ/42811803?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=LKp%2BGx1fZJuecdPvxpleobyFbgQg%2BAeW6RcmgKVyqVk%3D)
2026-03-29 22:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143510/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG14ZWE/42811220?sv=2020-08-04&st=2026-03-29T22%3A04%3A18Z&se=2026-03-29T22%3A29%3A18Z&sr=b&sp=r&sig=cnrBVHx917608ZNQdYLaL9kbd9WqnADMOSSO4ZVtpmw%3D)
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: VA65%20YYK
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA65%2520YYK%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for VA65%20YYK: 2
2026-03-29 22:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 580a2d5f-1182-5a32-9fc1-d1ffa664789e with identifier: VA65%20YYK
2026-03-29 22:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 580a2d5f-1182-5a32-9fc1-d1ffa664789e with scrape type 2
2026-03-29 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 580a2d5f-1182-5a32-9fc1-d1ffa664789e with scrape type 2
2026-03-29 22:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 580a2d5f-1182-5a32-9fc1-d1ffa664789e, identifier: VA65%20YYK
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146046%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146046 not downloaded yet
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144240%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144240 not downloaded yet
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: AV55%20WUY
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV55%2520WUY%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for AV55%20WUY: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: BJ07%20VOG
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ07%2520VOG%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for BJ07%20VOG: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: CX06%20LLW
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX06%2520LLW%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for CX06%20LLW: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: DE07%20JYC
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE07%2520JYC%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for DE07%20JYC: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: FE10%20YUW
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE10%2520YUW%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for FE10%20YUW: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: HG60%20HNL
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG60%2520HNL%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for HG60%20HNL: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: JG08%20CAZ
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JG08%2520CAZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for JG08%20CAZ: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: KS58%20LFY
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS58%2520LFY%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for KS58%20LFY: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: MA51%20VAE
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA51%2520VAE%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for MA51%20VAE: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: SB54%20UKM
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB54%2520UKM%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for SB54%20UKM: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: SB57%20VXW
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB57%2520VXW%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for SB57%20VXW: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: VO02%20XLA
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO02%2520XLA%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for VO02%20XLA: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: WL05%20GXS
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WL05%2520GXS%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for WL05%20GXS: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: FY16%20JXD
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY16%2520JXD%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for FY16%20JXD: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: FY67%20MKA
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY67%2520MKA%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for FY67%20MKA: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: LW17%20JXZ
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LW17%2520JXZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for LW17%20JXZ: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: SY16%20SZP
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY16%2520SZP%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for SY16%20SZP: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: PT51%20GPT
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PT51%2520GPT%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for PT51%20GPT: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: EK60%20TCU
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK60%2520TCU%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for EK60%20TCU: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: PX63%20SHZ
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX63%2520SHZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for PX63%20SHZ: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: SA14%20EWY
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA14%2520EWY%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for SA14%20EWY: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: L13%20CEE
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L13%2520CEE%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for L13%20CEE: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: NL62%20GFE
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL62%2520GFE%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for NL62%20GFE: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: NU10%20OWC
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU10%2520OWC%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for NU10%20OWC: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: YK15%20CTB
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK15%2520CTB%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for YK15%20CTB: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: AK07%20ZFD
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK07%2520ZFD%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for AK07%20ZFD: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: BX62%20FVM
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX62%2520FVM%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for BX62%20FVM: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: YM64%20PGY
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM64%2520PGY%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for YM64%20PGY: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: FN10%20WDR
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN10%2520WDR%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for FN10%20WDR: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: NJ09%20LWY
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ09%2520LWY%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for NJ09%20LWY: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: NL61%20XJX
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL61%2520XJX%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for NL61%20XJX: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: NX13%20HAA
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX13%2520HAA%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for NX13%20HAA: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: NX13%20YBP
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX13%2520YBP%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for NX13%20YBP: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: YD12%20YLM
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD12%2520YLM%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for YD12%20YLM: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: YF63%20ANV
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF63%2520ANV%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for YF63%20ANV: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: FM14%20DTZ
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM14%2520DTZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for FM14%20DTZ: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: SK10%20GUC
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK10%2520GUC%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for SK10%20GUC: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: NA68%20MZO
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA68%2520MZO%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for NA68%20MZO: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: RY19%20XDA
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY19%2520XDA%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for RY19%20XDA: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: PK16%20DAA
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK16%2520DAA%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for PK16%20DAA: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: ST18%20ZDH
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST18%2520ZDH%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for ST18%20ZDH: 0
2026-03-29 22:04:38 [bca.uk] INFO: Found listing with ID: WD18%20XLJ
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD18%2520XLJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:38 [bca.uk] INFO: Scrape type for WD18%20XLJ: 2
2026-03-29 22:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3e6449f-96ed-5ca6-9648-4d9e2425ac32 with identifier: WD18%20XLJ
2026-03-29 22:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3e6449f-96ed-5ca6-9648-4d9e2425ac32 with scrape type 2
2026-03-29 22:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3e6449f-96ed-5ca6-9648-4d9e2425ac32 with scrape type 2
2026-03-29 22:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b3e6449f-96ed-5ca6-9648-4d9e2425ac32, identifier: WD18%20XLJ
2026-03-29 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391539%27 HTTP/1.1" 200 None
2026-03-29 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391539 not downloaded yet
2026-03-29 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6207b2d0>
2026-03-29 22:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX19EAW%252F699146515%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146515/600 saved to cache
2026-03-29 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6
2026-03-29 22:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61adfed0>
2026-03-29 22:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSY15YVR%252F699455816%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455816/600 saved to cache
2026-03-29 22:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96224006-57cb-587c-9533-8a4dcc309913
2026-03-29 22:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145988/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV08ECZ/42811803?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=LKp%2BGx1fZJuecdPvxpleobyFbgQg%2BAeW6RcmgKVyqVk%3D)
2026-03-29 22:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143566/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143566>
2026-03-29 22:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455819/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SY15YVR/42786483?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=FK9rDus56J%2FV9P57RamAAihaU4KAtLW5HM1X4F9VrHo%3D)
2026-03-29 22:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391428/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HK54OMR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126551/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU68FGN/42811417?sv=2020-08-04&st=2026-03-29T22%3A04%3A13Z&se=2026-03-29T22%3A29%3A13Z&sr=b&sp=r&sig=RCrqulUVcgAVBuj9iX2cS9VTIHmOPa8of1NBVC2WuDI%3D)
2026-03-29 22:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388424/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL68UZJ/42811837?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=nph2F%2FW6m12z%2FYFEj3Ycz1Gy7uXC8be5nXf0j5ESQjw%3D)
2026-03-29 22:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 580a2d5f-1182-5a32-9fc1-d1ffa664789e with identifier: VA65%20YYK
2026-03-29 22:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 580a2d5f-1182-5a32-9fc1-d1ffa664789e with identifier: VA65%20YYK
2026-03-29 22:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 580a2d5f-1182-5a32-9fc1-d1ffa664789e with identifier: VA65%20YYK to the API
2026-03-29 22:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VA65%20YYK-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '580a2d5f-1182-5a32-9fc1-d1ffa664789e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VA65 YYK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VA65%20YYK&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 88355,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 N-CONNECTA Hatchback',
'transmission': 'automatic',
'trim': 'N-CONNECTA',
'vin': 'SJNFBAF15U7178489',
'year': 2016}
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA65%2520YYK%27 HTTP/1.1" 200 None
2026-03-29 22:04:40 [bca.uk] INFO: Saving data for VA65%20YYK: {'auction_closing_time': 1774864800.0, 'created_time': 1774620436.14272, 'last_price_update_time': 1774821880.206546}
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VA65%2520YYK') HTTP/1.1" 204 0
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143643%27 HTTP/1.1" 200 None
2026-03-29 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143643 not downloaded yet
2026-03-29 22:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b3e6449f-96ed-5ca6-9648-4d9e2425ac32 with identifier: WD18%20XLJ
2026-03-29 22:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b3e6449f-96ed-5ca6-9648-4d9e2425ac32 with identifier: WD18%20XLJ
2026-03-29 22:04:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b3e6449f-96ed-5ca6-9648-4d9e2425ac32 with identifier: WD18%20XLJ to the API
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WD18%20XLJ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b3e6449f-96ed-5ca6-9648-4d9e2425ac32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WD18 XLJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WD18%20XLJ&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'FORD',
'model': 'GRAND CONNECT',
'odometer': 59344,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD GRAND CONNECT 1.5 EBL 120 TITANIUM MPV',
'transmission': 'manual',
'trim': 'EBL 120 TITANIUM',
'vin': 'WF0UXXWPGUHK59315',
'year': 2018}
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD18%2520XLJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:40 [bca.uk] INFO: Saving data for WD18%20XLJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774390867.462399, 'last_price_update_time': 1774821880.646268}
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WD18%2520XLJ') HTTP/1.1" 204 0
2026-03-29 22:04:40 [bca.uk] INFO: Found listing with ID: BP14%20WHB
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP14%2520WHB%27 HTTP/1.1" 200 None
2026-03-29 22:04:40 [bca.uk] INFO: Scrape type for BP14%20WHB: 0
2026-03-29 22:04:40 [bca.uk] INFO: Found listing with ID: FV55%20GHG
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV55%2520GHG%27 HTTP/1.1" 200 None
2026-03-29 22:04:40 [bca.uk] INFO: Scrape type for FV55%20GHG: 0
2026-03-29 22:04:40 [bca.uk] INFO: Found listing with ID: SB63%20OHW
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB63%2520OHW%27 HTTP/1.1" 200 None
2026-03-29 22:04:40 [bca.uk] INFO: Scrape type for SB63%20OHW: 2
2026-03-29 22:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e8163c5-65c9-5add-8c1f-05b948bb928b with identifier: SB63%20OHW
2026-03-29 22:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e8163c5-65c9-5add-8c1f-05b948bb928b with scrape type 2
2026-03-29 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e8163c5-65c9-5add-8c1f-05b948bb928b with scrape type 2
2026-03-29 22:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2e8163c5-65c9-5add-8c1f-05b948bb928b, identifier: SB63%20OHW
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144245%27 HTTP/1.1" 200 None
2026-03-29 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144245 not downloaded yet
2026-03-29 22:04:40 [bca.uk] INFO: Found listing with ID: FY65%20MYB
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY65%2520MYB%27 HTTP/1.1" 200 None
2026-03-29 22:04:40 [bca.uk] INFO: Scrape type for FY65%20MYB: 0
2026-03-29 22:04:40 [bca.uk] INFO: Found listing with ID: VO17%20HSY
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO17%2520HSY%27 HTTP/1.1" 200 None
2026-03-29 22:04:40 [bca.uk] INFO: Scrape type for VO17%20HSY: 0
2026-03-29 22:04:40 [bca.uk] INFO: Found listing with ID: DA14%20ORY
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA14%2520ORY%27 HTTP/1.1" 200 None
2026-03-29 22:04:40 [bca.uk] INFO: Scrape type for DA14%20ORY: 0
2026-03-29 22:04:40 [bca.uk] INFO: Found listing with ID: SC14%20NFN
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC14%2520NFN%27 HTTP/1.1" 200 None
2026-03-29 22:04:40 [bca.uk] INFO: Scrape type for SC14%20NFN: 2
2026-03-29 22:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59b7727d-49c8-5685-bc4a-615d45a3eba9 with identifier: SC14%20NFN
2026-03-29 22:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59b7727d-49c8-5685-bc4a-615d45a3eba9 with scrape type 2
2026-03-29 22:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59b7727d-49c8-5685-bc4a-615d45a3eba9 with scrape type 2
2026-03-29 22:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 59b7727d-49c8-5685-bc4a-615d45a3eba9, identifier: SC14%20NFN
2026-03-29 22:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391555%27 HTTP/1.1" 200 None
2026-03-29 22:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391555 not downloaded yet
2026-03-29 22:04:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6195ae10>
2026-03-29 22:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU68FGN%252F699126524%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126524/600 saved to cache
2026-03-29 22:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f30cd769-41b2-536f-8ff2-a84f39302250
2026-03-29 22:04:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6176ce90>
2026-03-29 22:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL68UZJ%252F699388388%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388388/600 saved to cache
2026-03-29 22:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d329060a-a095-5b9c-880a-4e9dfce039e5
2026-03-29 22:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143532/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG14ZWE/42811220?sv=2020-08-04&st=2026-03-29T22%3A04%3A18Z&se=2026-03-29T22%3A29%3A18Z&sr=b&sp=r&sig=cnrBVHx917608ZNQdYLaL9kbd9WqnADMOSSO4ZVtpmw%3D)
2026-03-29 22:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455824/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SY15YVR/42786483?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=FK9rDus56J%2FV9P57RamAAihaU4KAtLW5HM1X4F9VrHo%3D)
2026-03-29 22:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2e8163c5-65c9-5add-8c1f-05b948bb928b with identifier: SB63%20OHW
2026-03-29 22:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2e8163c5-65c9-5add-8c1f-05b948bb928b with identifier: SB63%20OHW
2026-03-29 22:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2e8163c5-65c9-5add-8c1f-05b948bb928b with identifier: SB63%20OHW to the API
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB63%20OHW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2e8163c5-65c9-5add-8c1f-05b948bb928b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB63 OHW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB63%20OHW&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 85682,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.6 E-HDI 115 ACTIVE EGC MPV',
'transmission': 'automatic',
'trim': 'E-HDI 115 ACTIVE EGC',
'vin': 'VF30U9HD8DS222085',
'year': 2013}
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB63%2520OHW%27 HTTP/1.1" 200 None
2026-03-29 22:04:41 [bca.uk] INFO: Saving data for SB63%20OHW: {'auction_closing_time': 1774864800.0, 'created_time': 1774620453.620844, 'last_price_update_time': 1774821881.448085}
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB63%2520OHW') HTTP/1.1" 204 0
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143662%27 HTTP/1.1" 200 None
2026-03-29 22:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143662 not downloaded yet
2026-03-29 22:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 59b7727d-49c8-5685-bc4a-615d45a3eba9 with identifier: SC14%20NFN
2026-03-29 22:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 59b7727d-49c8-5685-bc4a-615d45a3eba9 with identifier: SC14%20NFN
2026-03-29 22:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 59b7727d-49c8-5685-bc4a-615d45a3eba9 with identifier: SC14%20NFN to the API
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SC14%20NFN-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '59b7727d-49c8-5685-bc4a-615d45a3eba9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SC14 NFN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SC14%20NFN&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'KIA',
'model': 'VENGA',
'odometer': 65938,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'KIA VENGA 1.4 1 ECODYNAMICS MPV',
'transmission': 'manual',
'trim': '1 ECODYNAMICS',
'vin': 'U5YEG811LEL086355',
'year': 2014}
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC14%2520NFN%27 HTTP/1.1" 200 None
2026-03-29 22:04:41 [bca.uk] INFO: Saving data for SC14%20NFN: {'auction_closing_time': 1774864800.0, 'created_time': 1774620782.391294, 'last_price_update_time': 1774821881.840802}
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SC14%2520NFN') HTTP/1.1" 204 0
2026-03-29 22:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611cb510>
2026-03-29 22:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV08ECZ%252F699145982%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145982/600 saved to cache
2026-03-29 22:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b1dd0d2-b075-5313-b500-f3a78c134e6f
2026-03-29 22:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a24250>
2026-03-29 22:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG14ZWE%252F699143510%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143510/600 saved to cache
2026-03-29 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e202f37-ad62-5b0d-b809-5a916fb0486e
2026-03-29 22:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143520/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG14ZWE/42811220?sv=2020-08-04&st=2026-03-29T22%3A04%3A18Z&se=2026-03-29T22%3A29%3A18Z&sr=b&sp=r&sig=cnrBVHx917608ZNQdYLaL9kbd9WqnADMOSSO4ZVtpmw%3D)
2026-03-29 22:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145994/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV08ECZ/42811803?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=LKp%2BGx1fZJuecdPvxpleobyFbgQg%2BAeW6RcmgKVyqVk%3D)
2026-03-29 22:04:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143581/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143581>
2026-03-29 22:04:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391471/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391471>
2026-03-29 22:04:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144230/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144230>
2026-03-29 22:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455821/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SY15YVR/42786483?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=FK9rDus56J%2FV9P57RamAAihaU4KAtLW5HM1X4F9VrHo%3D)
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: WN21%20ZGE
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN21%2520ZGE%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for WN21%20ZGE: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: WT18%20AFV
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT18%2520AFV%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for WT18%20AFV: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: FL10%20FUV
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL10%2520FUV%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for FL10%20FUV: 2
2026-03-29 22:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d30ec3f4-cf30-5286-8ee6-139e2672c43a with identifier: FL10%20FUV
2026-03-29 22:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d30ec3f4-cf30-5286-8ee6-139e2672c43a with scrape type 2
2026-03-29 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d30ec3f4-cf30-5286-8ee6-139e2672c43a with scrape type 2
2026-03-29 22:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d30ec3f4-cf30-5286-8ee6-139e2672c43a, identifier: FL10%20FUV
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144256%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144256 not downloaded yet
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: SO14%20FTD
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO14%2520FTD%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for SO14%20FTD: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: WO15%20WBN
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO15%2520WBN%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for WO15%20WBN: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: CE68%20ACJ
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE68%2520ACJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for CE68%20ACJ: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: FX17%20CHK
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX17%2520CHK%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for FX17%20CHK: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: FY65%20VLD
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY65%2520VLD%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for FY65%20VLD: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: YX63%20EZW
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX63%2520EZW%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for YX63%20EZW: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: YF14%20KTO
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF14%2520KTO%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for YF14%20KTO: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: YF15%20FFE
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF15%2520FFE%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for YF15%20FFE: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: AK64%20WNF
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK64%2520WNF%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for AK64%20WNF: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: GF64%20UPV
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF64%2520UPV%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for GF64%20UPV: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: YC10%20UTO
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC10%2520UTO%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for YC10%20UTO: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: DV68%20LFL
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV68%2520LFL%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for DV68%20LFL: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: TO05%20LWW
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27TO05%2520LWW%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for TO05%20LWW: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: GJ68%20DWO
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ68%2520DWO%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for GJ68%20DWO: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: SB15%20HXA
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB15%2520HXA%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for SB15%20HXA: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: HK66%20JYB
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK66%2520JYB%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for HK66%20JYB: 0
2026-03-29 22:04:42 [bca.uk] INFO: Found listing with ID: LS16%20HCY
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS16%2520HCY%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [bca.uk] INFO: Scrape type for LS16%20HCY: 2
2026-03-29 22:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c030f202-a5c3-5653-90d8-f63c3047aaf5 with identifier: LS16%20HCY
2026-03-29 22:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c030f202-a5c3-5653-90d8-f63c3047aaf5 with scrape type 2
2026-03-29 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c030f202-a5c3-5653-90d8-f63c3047aaf5 with scrape type 2
2026-03-29 22:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c030f202-a5c3-5653-90d8-f63c3047aaf5, identifier: LS16%20HCY
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391571%27 HTTP/1.1" 200 None
2026-03-29 22:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391571 not downloaded yet
2026-03-29 22:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d30ec3f4-cf30-5286-8ee6-139e2672c43a with identifier: FL10%20FUV
2026-03-29 22:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d30ec3f4-cf30-5286-8ee6-139e2672c43a with identifier: FL10%20FUV
2026-03-29 22:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d30ec3f4-cf30-5286-8ee6-139e2672c43a with identifier: FL10%20FUV to the API
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 210,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL10%20FUV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd30ec3f4-cf30-5286-8ee6-139e2672c43a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL10 FUV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL10%20FUV&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 48949,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 2.0 CRDI 138 XS 2WD StationWagon',
'transmission': 'automatic',
'trim': 'CRDI 138 XS 2WD',
'vin': 'U6YKH815MAL083581',
'year': 2010}
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL10%2520FUV%27 HTTP/1.1" 200 None
2026-03-29 22:04:43 [bca.uk] INFO: Saving data for FL10%20FUV: {'auction_closing_time': 1774951200.0, 'created_time': 1773838422.554939, 'last_price_update_time': 1774821883.019429}
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL10%2520FUV') HTTP/1.1" 204 0
2026-03-29 22:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c030f202-a5c3-5653-90d8-f63c3047aaf5 with identifier: LS16%20HCY
2026-03-29 22:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c030f202-a5c3-5653-90d8-f63c3047aaf5 with identifier: LS16%20HCY
2026-03-29 22:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c030f202-a5c3-5653-90d8-f63c3047aaf5 with identifier: LS16%20HCY to the API
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 101,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LS16%20HCY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c030f202-a5c3-5653-90d8-f63c3047aaf5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LS16 HCY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LS16%20HCY&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'MERCEDES-BENZ',
'model': 'A180 D',
'odometer': 25439,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A180 D 1.5 SPORT DCT Hatchback',
'transmission': 'automatic',
'trim': 'SPORT DCT',
'vin': 'WDD1760122V127258',
'year': 2016}
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS16%2520HCY%27 HTTP/1.1" 200 None
2026-03-29 22:04:43 [bca.uk] INFO: Saving data for LS16%20HCY: {'auction_closing_time': 1774951200.0, 'created_time': 1774005622.798485, 'last_price_update_time': 1774821883.457627}
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LS16%2520HCY') HTTP/1.1" 204 0
2026-03-29 22:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62150e10>
2026-03-29 22:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV08ECZ%252F699145988%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145988/600 saved to cache
2026-03-29 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b1dd0d2-b075-5313-b500-f3a78c134e6f
2026-03-29 22:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619f3550>
2026-03-29 22:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSY15YVR%252F699455819%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455819/600 saved to cache
2026-03-29 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96224006-57cb-587c-9533-8a4dcc309913
2026-03-29 22:04:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611bb750>
2026-03-29 22:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU68FGN%252F699126551%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126551/600 saved to cache
2026-03-29 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f30cd769-41b2-536f-8ff2-a84f39302250
2026-03-29 22:04:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61186390>
2026-03-29 22:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL68UZJ%252F699388424%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388424/600 saved to cache
2026-03-29 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d329060a-a095-5b9c-880a-4e9dfce039e5
2026-03-29 22:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391504/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391504>
2026-03-29 22:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144233/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144233>
2026-03-29 22:04:43 [bca.uk] INFO: Found listing with ID: LB67%20WHR
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB67%2520WHR%27 HTTP/1.1" 200 None
2026-03-29 22:04:43 [bca.uk] INFO: Scrape type for LB67%20WHR: 0
2026-03-29 22:04:43 [bca.uk] INFO: Found listing with ID: WV18%20GNY
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV18%2520GNY%27 HTTP/1.1" 200 None
2026-03-29 22:04:43 [bca.uk] INFO: Scrape type for WV18%20GNY: 2
2026-03-29 22:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 178c831d-40be-5610-8b45-8ee9d265dc2f with identifier: WV18%20GNY
2026-03-29 22:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178c831d-40be-5610-8b45-8ee9d265dc2f with scrape type 2
2026-03-29 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 178c831d-40be-5610-8b45-8ee9d265dc2f with scrape type 2
2026-03-29 22:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 178c831d-40be-5610-8b45-8ee9d265dc2f, identifier: WV18%20GNY
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144261%27 HTTP/1.1" 200 None
2026-03-29 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144261 not downloaded yet
2026-03-29 22:04:43 [bca.uk] INFO: Found listing with ID: SD67%20XHY
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD67%2520XHY%27 HTTP/1.1" 200 None
2026-03-29 22:04:43 [bca.uk] INFO: Scrape type for SD67%20XHY: 0
2026-03-29 22:04:43 [bca.uk] INFO: Found listing with ID: SC66%20RUU
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC66%2520RUU%27 HTTP/1.1" 200 None
2026-03-29 22:04:43 [bca.uk] INFO: Scrape type for SC66%20RUU: 0
2026-03-29 22:04:43 [bca.uk] INFO: Found listing with ID: SJ15%20ZWE
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ15%2520ZWE%27 HTTP/1.1" 200 None
2026-03-29 22:04:43 [bca.uk] INFO: Scrape type for SJ15%20ZWE: 0
2026-03-29 22:04:43 [bca.uk] INFO: Found listing with ID: SK67%20UUF
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK67%2520UUF%27 HTTP/1.1" 200 None
2026-03-29 22:04:43 [bca.uk] INFO: Scrape type for SK67%20UUF: 0
2026-03-29 22:04:43 [bca.uk] INFO: Found listing with ID: SM65%20WDL
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM65%2520WDL%27 HTTP/1.1" 200 None
2026-03-29 22:04:43 [bca.uk] INFO: Scrape type for SM65%20WDL: 2
2026-03-29 22:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 876bf807-40e7-5fcc-95fc-54f8c76e1e78 with identifier: SM65%20WDL
2026-03-29 22:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 876bf807-40e7-5fcc-95fc-54f8c76e1e78 with scrape type 2
2026-03-29 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 876bf807-40e7-5fcc-95fc-54f8c76e1e78 with scrape type 2
2026-03-29 22:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 876bf807-40e7-5fcc-95fc-54f8c76e1e78, identifier: SM65%20WDL
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391584%27 HTTP/1.1" 200 None
2026-03-29 22:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391584 not downloaded yet
2026-03-29 22:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 178c831d-40be-5610-8b45-8ee9d265dc2f with identifier: WV18%20GNY
2026-03-29 22:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 178c831d-40be-5610-8b45-8ee9d265dc2f with identifier: WV18%20GNY
2026-03-29 22:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 178c831d-40be-5610-8b45-8ee9d265dc2f with identifier: WV18%20GNY to the API
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 95,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV18%20GNY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '178c831d-40be-5610-8b45-8ee9d265dc2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WV18 GNY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WV18%20GNY&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'TOYOTA',
'model': 'AYGO',
'odometer': 29272,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'TOYOTA AYGO 1.0 VVT-I X-PRESS Hatchback',
'transmission': 'manual',
'trim': 'VVT-I X-PRESS',
'vin': 'JTDKGNEC40N318923',
'year': 2018}
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV18%2520GNY%27 HTTP/1.1" 200 None
2026-03-29 22:04:44 [bca.uk] INFO: Saving data for WV18%20GNY: {'auction_closing_time': 1774951200.0, 'created_time': 1774477807.966832, 'last_price_update_time': 1774821884.324861}
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WV18%2520GNY') HTTP/1.1" 204 0
2026-03-29 22:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 876bf807-40e7-5fcc-95fc-54f8c76e1e78 with identifier: SM65%20WDL
2026-03-29 22:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 876bf807-40e7-5fcc-95fc-54f8c76e1e78 with identifier: SM65%20WDL
2026-03-29 22:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 876bf807-40e7-5fcc-95fc-54f8c76e1e78 with identifier: SM65%20WDL to the API
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SM65%20WDL-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '876bf807-40e7-5fcc-95fc-54f8c76e1e78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SM65 WDL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SM65%20WDL&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'FORD',
'model': 'GRAND C-MAX',
'odometer': 107710,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD GRAND C-MAX 1.5 TDCI 120 TITANIUM MPV',
'transmission': 'manual',
'trim': 'TDCI 120 TITANIUM',
'vin': 'WF0WXXGCEWFT53809',
'year': 2016}
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM65%2520WDL%27 HTTP/1.1" 200 None
2026-03-29 22:04:44 [bca.uk] INFO: Saving data for SM65%20WDL: {'auction_closing_time': 1774864800.0, 'created_time': 1774620770.013383, 'last_price_update_time': 1774821884.684894}
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SM65%2520WDL') HTTP/1.1" 204 0
2026-03-29 22:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143566/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG14ZWE/42811220?sv=2020-08-04&st=2026-03-29T22%3A04%3A18Z&se=2026-03-29T22%3A29%3A18Z&sr=b&sp=r&sig=cnrBVHx917608ZNQdYLaL9kbd9WqnADMOSSO4ZVtpmw%3D)
2026-03-29 22:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143598/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143598>
2026-03-29 22:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455841/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455841>
2026-03-29 22:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146033/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146033>
2026-03-29 22:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143621/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143621>
2026-03-29 22:04:44 [bca.uk] INFO: Found listing with ID: AE67%20AWJ
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE67%2520AWJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:44 [bca.uk] INFO: Scrape type for AE67%20AWJ: 0
2026-03-29 22:04:44 [bca.uk] INFO: Found listing with ID: DA64%20AWP
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA64%2520AWP%27 HTTP/1.1" 200 None
2026-03-29 22:04:44 [bca.uk] INFO: Scrape type for DA64%20AWP: 0
2026-03-29 22:04:44 [bca.uk] INFO: Found listing with ID: AD15%20LAO
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD15%2520LAO%27 HTTP/1.1" 200 None
2026-03-29 22:04:44 [bca.uk] INFO: Scrape type for AD15%20LAO: 0
2026-03-29 22:04:44 [bca.uk] INFO: Found listing with ID: CT19%20VYM
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT19%2520VYM%27 HTTP/1.1" 200 None
2026-03-29 22:04:44 [bca.uk] INFO: Scrape type for CT19%20VYM: 0
2026-03-29 22:04:44 [bca.uk] INFO: Found listing with ID: LB69%20LHJ
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB69%2520LHJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:44 [bca.uk] INFO: Scrape type for LB69%20LHJ: 0
2026-03-29 22:04:44 [bca.uk] INFO: Found listing with ID: WG66%20JSV
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG66%2520JSV%27 HTTP/1.1" 200 None
2026-03-29 22:04:44 [bca.uk] INFO: Scrape type for WG66%20JSV: 0
2026-03-29 22:04:44 [bca.uk] INFO: Found listing with ID: SH51%20YHV
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH51%2520YHV%27 HTTP/1.1" 200 None
2026-03-29 22:04:44 [bca.uk] INFO: Scrape type for SH51%20YHV: 0
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144272%27 HTTP/1.1" 200 None
2026-03-29 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144272 not downloaded yet
2026-03-29 22:04:44 [bca.uk] INFO: Found listing with ID: SY16%20OXD
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY16%2520OXD%27 HTTP/1.1" 200 None
2026-03-29 22:04:44 [bca.uk] INFO: Scrape type for SY16%20OXD: 0
2026-03-29 22:04:44 [bca.uk] INFO: Found listing with ID: YY66%20PPX
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY66%2520PPX%27 HTTP/1.1" 200 None
2026-03-29 22:04:44 [bca.uk] INFO: Scrape type for YY66%20PPX: 0
2026-03-29 22:04:44 [bca.uk] INFO: Found listing with ID: DG16%20ZDM
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG16%2520ZDM%27 HTTP/1.1" 200 None
2026-03-29 22:04:44 [bca.uk] INFO: Scrape type for DG16%20ZDM: 0
2026-03-29 22:04:44 [bca.uk] INFO: Found listing with ID: DL14%20OCO
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL14%2520OCO%27 HTTP/1.1" 200 None
2026-03-29 22:04:44 [bca.uk] INFO: Scrape type for DL14%20OCO: 2
2026-03-29 22:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cbda9c6-fd91-5ee4-818a-9a09794168a0 with identifier: DL14%20OCO
2026-03-29 22:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cbda9c6-fd91-5ee4-818a-9a09794168a0 with scrape type 2
2026-03-29 22:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cbda9c6-fd91-5ee4-818a-9a09794168a0 with scrape type 2
2026-03-29 22:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3cbda9c6-fd91-5ee4-818a-9a09794168a0, identifier: DL14%20OCO
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391602%27 HTTP/1.1" 200 None
2026-03-29 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391602 not downloaded yet
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6334bf50>
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG14ZWE%252F699143532%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143532/600 saved to cache
2026-03-29 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e202f37-ad62-5b0d-b809-5a916fb0486e
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69c1b690>
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSY15YVR%252F699455824%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455824/600 saved to cache
2026-03-29 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96224006-57cb-587c-9533-8a4dcc309913
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632ce310>
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG14ZWE%252F699143520%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143520/600 saved to cache
2026-03-29 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e202f37-ad62-5b0d-b809-5a916fb0486e
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6224e350>
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV08ECZ%252F699145994%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145994/600 saved to cache
2026-03-29 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b1dd0d2-b075-5313-b500-f3a78c134e6f
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63691150>
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSY15YVR%252F699455821%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455821/600 saved to cache
2026-03-29 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96224006-57cb-587c-9533-8a4dcc309913
2026-03-29 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391539/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391539>
2026-03-29 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143643/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143643>
2026-03-29 22:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3cbda9c6-fd91-5ee4-818a-9a09794168a0 with identifier: DL14%20OCO
2026-03-29 22:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3cbda9c6-fd91-5ee4-818a-9a09794168a0 with identifier: DL14%20OCO
2026-03-29 22:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3cbda9c6-fd91-5ee4-818a-9a09794168a0 with identifier: DL14%20OCO to the API
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DL14%20OCO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3cbda9c6-fd91-5ee4-818a-9a09794168a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DL14 OCO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DL14%20OCO&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 67865,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 VVT S Hatchback',
'transmission': 'manual',
'trim': 'VVT S',
'vin': 'W0L0SDL68E4240685',
'year': 2014}
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL14%2520OCO%27 HTTP/1.1" 200 None
2026-03-29 22:04:45 [bca.uk] INFO: Saving data for DL14%20OCO: {'auction_closing_time': 1774864800.0, 'created_time': 1774621417.095292, 'last_price_update_time': 1774821885.575997}
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DL14%2520OCO') HTTP/1.1" 204 0
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699144282%27 HTTP/1.1" 200 None
2026-03-29 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144282 not downloaded yet
2026-03-29 22:04:45 [bca.uk] INFO: Found listing with ID: KY66%20CUX
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY66%2520CUX%27 HTTP/1.1" 200 None
2026-03-29 22:04:45 [bca.uk] INFO: Scrape type for KY66%20CUX: 2
2026-03-29 22:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0275349a-c384-5aae-9f91-781de60f1a30 with identifier: KY66%20CUX
2026-03-29 22:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0275349a-c384-5aae-9f91-781de60f1a30 with scrape type 2
2026-03-29 22:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0275349a-c384-5aae-9f91-781de60f1a30 with scrape type 2
2026-03-29 22:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0275349a-c384-5aae-9f91-781de60f1a30, identifier: KY66%20CUX
2026-03-29 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391428/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK54OMR/42811990?sv=2020-08-04&st=2026-03-29T22%3A04%3A23Z&se=2026-03-29T22%3A29%3A23Z&sr=b&sp=r&sig=VkfxGSyJ7FeZDeyrP5eg1nwFrw5WiMaWZ44byiJeVbU%3D)
2026-03-29 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144230/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX13SXE/42811806?sv=2020-08-04&st=2026-03-29T22%3A04%3A22Z&se=2026-03-29T22%3A29%3A22Z&sr=b&sp=r&sig=3r1JvnjimdGw6bIdCU3v28PgEf%2BVL2n8uM1aCSphqNo%3D)
2026-03-29 22:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143581/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG14ZWE/42811220?sv=2020-08-04&st=2026-03-29T22%3A04%3A18Z&se=2026-03-29T22%3A29%3A18Z&sr=b&sp=r&sig=cnrBVHx917608ZNQdYLaL9kbd9WqnADMOSSO4ZVtpmw%3D)
2026-03-29 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143662/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143662>
2026-03-29 22:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391555/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391555>
2026-03-29 22:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0275349a-c384-5aae-9f91-781de60f1a30 with identifier: KY66%20CUX
2026-03-29 22:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0275349a-c384-5aae-9f91-781de60f1a30 with identifier: KY66%20CUX
2026-03-29 22:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0275349a-c384-5aae-9f91-781de60f1a30 with identifier: KY66%20CUX to the API
2026-03-29 22:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 97,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY66%20CUX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0275349a-c384-5aae-9f91-781de60f1a30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY66 CUX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KY66%20CUX&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 86970,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 CDTI 16V 110 SRI Hatchback',
'transmission': 'manual',
'trim': 'CDTI 16V 110 SRI',
'vin': 'W0LBF6EK0G8113302',
'year': 2016}
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY66%2520CUX%27 HTTP/1.1" 200 None
2026-03-29 22:04:46 [bca.uk] INFO: Saving data for KY66%20CUX: {'auction_closing_time': 1774864800.0, 'created_time': 1774044945.451452, 'last_price_update_time': 1774821886.175346}
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KY66%2520CUX') HTTP/1.1" 204 0
2026-03-29 22:04:46 [bca.uk] INFO: Found listing with ID: MT67%20JTY
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT67%2520JTY%27 HTTP/1.1" 200 None
2026-03-29 22:04:46 [bca.uk] INFO: Scrape type for MT67%20JTY: 0
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391471/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK54OMR/42811990?sv=2020-08-04&st=2026-03-29T22%3A04%3A23Z&se=2026-03-29T22%3A29%3A23Z&sr=b&sp=r&sig=VkfxGSyJ7FeZDeyrP5eg1nwFrw5WiMaWZ44byiJeVbU%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144233/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX13SXE/42811806?sv=2020-08-04&st=2026-03-29T22%3A04%3A22Z&se=2026-03-29T22%3A29%3A22Z&sr=b&sp=r&sig=3r1JvnjimdGw6bIdCU3v28PgEf%2BVL2n8uM1aCSphqNo%3D)
2026-03-29 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144245/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144245>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632cc810>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG14ZWE%252F699143566%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143566/600 saved to cache
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e202f37-ad62-5b0d-b809-5a916fb0486e
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637ee310>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK54OMR%252F699391428%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391428/600 saved to cache
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e6514c1-40ff-58ca-8a22-0509f974be50
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6209d9d0>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX13SXE%252F699144230%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144230/600 saved to cache
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82d2359b-1b38-5883-aaa0-bf564ebc3211
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6198b390>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG14ZWE%252F699143581%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143581/600 saved to cache
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e202f37-ad62-5b0d-b809-5a916fb0486e
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146033/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV08ECZ/42811803?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=LKp%2BGx1fZJuecdPvxpleobyFbgQg%2BAeW6RcmgKVyqVk%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143621/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG14ZWE/42811220?sv=2020-08-04&st=2026-03-29T22%3A04%3A18Z&se=2026-03-29T22%3A29%3A18Z&sr=b&sp=r&sig=cnrBVHx917608ZNQdYLaL9kbd9WqnADMOSSO4ZVtpmw%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143598/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG14ZWE/42811220?sv=2020-08-04&st=2026-03-29T22%3A04%3A18Z&se=2026-03-29T22%3A29%3A18Z&sr=b&sp=r&sig=cnrBVHx917608ZNQdYLaL9kbd9WqnADMOSSO4ZVtpmw%3D)
2026-03-29 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391584/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391584>
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455841/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SY15YVR/42786483?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=FK9rDus56J%2FV9P57RamAAihaU4KAtLW5HM1X4F9VrHo%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143643/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG14ZWE/42811220?sv=2020-08-04&st=2026-03-29T22%3A04%3A18Z&se=2026-03-29T22%3A29%3A18Z&sr=b&sp=r&sig=cnrBVHx917608ZNQdYLaL9kbd9WqnADMOSSO4ZVtpmw%3D)
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69adfad0>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK54OMR%252F699391471%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391471/600 saved to cache
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e6514c1-40ff-58ca-8a22-0509f974be50
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620d79d0>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX13SXE%252F699144233%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144233/600 saved to cache
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82d2359b-1b38-5883-aaa0-bf564ebc3211
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391504/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK54OMR/42811990?sv=2020-08-04&st=2026-03-29T22%3A04%3A23Z&se=2026-03-29T22%3A29%3A23Z&sr=b&sp=r&sig=VkfxGSyJ7FeZDeyrP5eg1nwFrw5WiMaWZ44byiJeVbU%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391539/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK54OMR/42811990?sv=2020-08-04&st=2026-03-29T22%3A04%3A23Z&se=2026-03-29T22%3A29%3A23Z&sr=b&sp=r&sig=VkfxGSyJ7FeZDeyrP5eg1nwFrw5WiMaWZ44byiJeVbU%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391555/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK54OMR/42811990?sv=2020-08-04&st=2026-03-29T22%3A04%3A23Z&se=2026-03-29T22%3A29%3A23Z&sr=b&sp=r&sig=VkfxGSyJ7FeZDeyrP5eg1nwFrw5WiMaWZ44byiJeVbU%3D)
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6158ead0>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV08ECZ%252F699146033%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146033/600 saved to cache
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b1dd0d2-b075-5313-b500-f3a78c134e6f
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63614c50>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG14ZWE%252F699143621%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143621/600 saved to cache
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7e202f37-ad62-5b0d-b809-5a916fb0486e
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6115e190>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG14ZWE%252F699143598%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143598/600 saved to cache
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7e202f37-ad62-5b0d-b809-5a916fb0486e
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63779cd0>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSY15YVR%252F699455841%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455841/600 saved to cache
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96224006-57cb-587c-9533-8a4dcc309913
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63779b90>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG14ZWE%252F699143643%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143643/600 saved to cache
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7e202f37-ad62-5b0d-b809-5a916fb0486e
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143662/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG14ZWE/42811220?sv=2020-08-04&st=2026-03-29T22%3A04%3A18Z&se=2026-03-29T22%3A29%3A18Z&sr=b&sp=r&sig=cnrBVHx917608ZNQdYLaL9kbd9WqnADMOSSO4ZVtpmw%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144245/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX13SXE/42811806?sv=2020-08-04&st=2026-03-29T22%3A04%3A22Z&se=2026-03-29T22%3A29%3A22Z&sr=b&sp=r&sig=3r1JvnjimdGw6bIdCU3v28PgEf%2BVL2n8uM1aCSphqNo%3D)
2026-03-29 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391571/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391571>
2026-03-29 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144272/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144272>
2026-03-29 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391602/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391602>
2026-03-29 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144261/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144261>
2026-03-29 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144256/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144256>
2026-03-29 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144282/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144282>
2026-03-29 22:04:46 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:04:46 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6158d890>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK54OMR%252F699391504%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391504/600 saved to cache
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e6514c1-40ff-58ca-8a22-0509f974be50
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617591d0>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK54OMR%252F699391539%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391539/600 saved to cache
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e6514c1-40ff-58ca-8a22-0509f974be50
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61509050>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK54OMR%252F699391555%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391555/600 saved to cache
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e6514c1-40ff-58ca-8a22-0509f974be50
2026-03-29 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146022/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146022>
2026-03-29 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146012/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146012>
2026-03-29 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144224/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144224>
2026-03-29 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391444/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391444>
2026-03-29 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144240/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699144240>
2026-03-29 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146046/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146046>
2026-03-29 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455836/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455836>
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6352f950>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG14ZWE%252F699143662%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143662/600 saved to cache
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7e202f37-ad62-5b0d-b809-5a916fb0486e
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6224ed50>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX13SXE%252F699144245%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144245/600 saved to cache
2026-03-29 22:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82d2359b-1b38-5883-aaa0-bf564ebc3211
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391584/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK54OMR/42811990?sv=2020-08-04&st=2026-03-29T22%3A04%3A23Z&se=2026-03-29T22%3A29%3A23Z&sr=b&sp=r&sig=VkfxGSyJ7FeZDeyrP5eg1nwFrw5WiMaWZ44byiJeVbU%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144272/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX13SXE/42811806?sv=2020-08-04&st=2026-03-29T22%3A04%3A22Z&se=2026-03-29T22%3A29%3A22Z&sr=b&sp=r&sig=3r1JvnjimdGw6bIdCU3v28PgEf%2BVL2n8uM1aCSphqNo%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144256/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX13SXE/42811806?sv=2020-08-04&st=2026-03-29T22%3A04%3A22Z&se=2026-03-29T22%3A29%3A22Z&sr=b&sp=r&sig=3r1JvnjimdGw6bIdCU3v28PgEf%2BVL2n8uM1aCSphqNo%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144261/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX13SXE/42811806?sv=2020-08-04&st=2026-03-29T22%3A04%3A22Z&se=2026-03-29T22%3A29%3A22Z&sr=b&sp=r&sig=3r1JvnjimdGw6bIdCU3v28PgEf%2BVL2n8uM1aCSphqNo%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391571/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK54OMR/42811990?sv=2020-08-04&st=2026-03-29T22%3A04%3A23Z&se=2026-03-29T22%3A29%3A23Z&sr=b&sp=r&sig=VkfxGSyJ7FeZDeyrP5eg1nwFrw5WiMaWZ44byiJeVbU%3D)
2026-03-29 22:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455831/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455831>
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391602/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK54OMR/42811990?sv=2020-08-04&st=2026-03-29T22%3A04%3A23Z&se=2026-03-29T22%3A29%3A23Z&sr=b&sp=r&sig=VkfxGSyJ7FeZDeyrP5eg1nwFrw5WiMaWZ44byiJeVbU%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144282/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX13SXE/42811806?sv=2020-08-04&st=2026-03-29T22%3A04%3A22Z&se=2026-03-29T22%3A29%3A22Z&sr=b&sp=r&sig=3r1JvnjimdGw6bIdCU3v28PgEf%2BVL2n8uM1aCSphqNo%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144240/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX13SXE/42811806?sv=2020-08-04&st=2026-03-29T22%3A04%3A22Z&se=2026-03-29T22%3A29%3A22Z&sr=b&sp=r&sig=3r1JvnjimdGw6bIdCU3v28PgEf%2BVL2n8uM1aCSphqNo%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146046/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV08ECZ/42811803?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=LKp%2BGx1fZJuecdPvxpleobyFbgQg%2BAeW6RcmgKVyqVk%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144224/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX13SXE/42811806?sv=2020-08-04&st=2026-03-29T22%3A04%3A22Z&se=2026-03-29T22%3A29%3A22Z&sr=b&sp=r&sig=3r1JvnjimdGw6bIdCU3v28PgEf%2BVL2n8uM1aCSphqNo%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146012/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV08ECZ/42811803?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=LKp%2BGx1fZJuecdPvxpleobyFbgQg%2BAeW6RcmgKVyqVk%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391444/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK54OMR/42811990?sv=2020-08-04&st=2026-03-29T22%3A04%3A23Z&se=2026-03-29T22%3A29%3A23Z&sr=b&sp=r&sig=VkfxGSyJ7FeZDeyrP5eg1nwFrw5WiMaWZ44byiJeVbU%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146022/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV08ECZ/42811803?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=LKp%2BGx1fZJuecdPvxpleobyFbgQg%2BAeW6RcmgKVyqVk%3D)
2026-03-29 22:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455836/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SY15YVR/42786483?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=FK9rDus56J%2FV9P57RamAAihaU4KAtLW5HM1X4F9VrHo%3D)
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6118e0d0>
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK54OMR%252F699391584%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391584/600 saved to cache
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e6514c1-40ff-58ca-8a22-0509f974be50
2026-03-29 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144219/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GX13SXE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143543/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143543>
2026-03-29 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146000/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146000>
2026-03-29 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455828/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455828>
2026-03-29 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126569/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126569>
2026-03-29 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145974/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145974>
2026-03-29 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388441/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388441>
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611bcb90>
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX13SXE%252F699144272%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144272/600 saved to cache
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82d2359b-1b38-5883-aaa0-bf564ebc3211
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620cb910>
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX13SXE%252F699144256%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144256/600 saved to cache
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82d2359b-1b38-5883-aaa0-bf564ebc3211
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632e0e50>
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX13SXE%252F699144261%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144261/600 saved to cache
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82d2359b-1b38-5883-aaa0-bf564ebc3211
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a759d0>
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK54OMR%252F699391571%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391571/600 saved to cache
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e6514c1-40ff-58ca-8a22-0509f974be50
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61754990>
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK54OMR%252F699391602%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391602/600 saved to cache
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e6514c1-40ff-58ca-8a22-0509f974be50
2026-03-29 22:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455831/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SY15YVR/42786483?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=FK9rDus56J%2FV9P57RamAAihaU4KAtLW5HM1X4F9VrHo%3D)
2026-03-29 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455813/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455813>
2026-03-29 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388354/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388354>
2026-03-29 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146525/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146525>
2026-03-29 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126491/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126491>
2026-03-29 22:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145966/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV08ECZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac684c9010>
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX13SXE%252F699144282%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144282/600 saved to cache
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82d2359b-1b38-5883-aaa0-bf564ebc3211
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6367b950>
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX13SXE%252F699144240%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144240/600 saved to cache
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82d2359b-1b38-5883-aaa0-bf564ebc3211
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637ad8d0>
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV08ECZ%252F699146046%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146046/600 saved to cache
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b1dd0d2-b075-5313-b500-f3a78c134e6f
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac684da090>
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX13SXE%252F699144224%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144224/600 saved to cache
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82d2359b-1b38-5883-aaa0-bf564ebc3211
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6158c3d0>
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV08ECZ%252F699146012%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146012/600 saved to cache
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b1dd0d2-b075-5313-b500-f3a78c134e6f
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61964610>
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK54OMR%252F699391444%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391444/600 saved to cache
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e6514c1-40ff-58ca-8a22-0509f974be50
2026-03-29 22:04:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e6514c1-40ff-58ca-8a22-0509f974be50, skipping ID generation
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e6514c1-40ff-58ca-8a22-0509f974be50 sending to next pipeline
2026-03-29 22:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2e6514c1-40ff-58ca-8a22-0509f974be50, identifier: HK54%20OMR
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63678590>
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV08ECZ%252F699146022%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146022/600 saved to cache
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b1dd0d2-b075-5313-b500-f3a78c134e6f
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615f3a90>
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSY15YVR%252F699455836%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455836/600 saved to cache
2026-03-29 22:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96224006-57cb-587c-9533-8a4dcc309913
2026-03-29 22:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2e6514c1-40ff-58ca-8a22-0509f974be50 with identifier: HK54%20OMR
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-29 22:04:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2e6514c1-40ff-58ca-8a22-0509f974be50 with identifier: HK54%20OMR
2026-03-29 22:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2e6514c1-40ff-58ca-8a22-0509f974be50 with identifier: HK54%20OMR to the API
2026-03-29 22:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391444/600>
{'auction_title': '',
'c_o_2_emission_value': 161,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_expert_report_file_2a6e1367-28e7-4193-9f67-b4fc7ea3745e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK54%20OMR-GB',
'category': 'Car',
'color': 'gold',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2e6514c1-40ff-58ca-8a22-0509f974be50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK54 OMR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK54%20OMR&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'RENAULT',
'model': 'MODUS',
'odometer': 37350,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197215,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391428/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192200,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391444/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192101,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391471/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182872,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391504/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180679,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391539/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159764,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391555/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164596,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391571/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157850,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391584/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6514c1-40ff-58ca-8a22-0509f974be50/2e6514c1-40ff-58ca-8a22-0509f974be50_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166265,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK54OMR/699391602/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'RENAULT MODUS 1.4 PRIVILEGE Hatchback',
'transmission': 'manual',
'trim': 'PRIVILEGE',
'vin': 'VF1JP0J0532888047',
'year': 2005}
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK54%2520OMR%27 HTTP/1.1" 200 None
2026-03-29 22:04:48 [bca.uk] INFO: Saving data for HK54%20OMR: {'created_time': 1774821888.246789, 'last_price_update_time': 1774821888.2468, 'auction_closing_time': 1774864800.0}
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK54%2520OMR') HTTP/1.1" 204 0
2026-03-29 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126467/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126467>
2026-03-29 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL07HRM/42787034?sv=2020-08-04&st=2026-03-29T22%3A04%3A47Z&se=2026-03-29T22%3A29%3A47Z&sr=b&sp=r&sig=exdoUniRSbIwQ12LkQI9utrlzs26smvmyOvTrgGhZiY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PL07%20HRM-GB>
2026-03-29 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143543/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG14ZWE/42811220?sv=2020-08-04&st=2026-03-29T22%3A04%3A18Z&se=2026-03-29T22%3A29%3A18Z&sr=b&sp=r&sig=cnrBVHx917608ZNQdYLaL9kbd9WqnADMOSSO4ZVtpmw%3D)
2026-03-29 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144219/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX13SXE/42811806?sv=2020-08-04&st=2026-03-29T22%3A04%3A22Z&se=2026-03-29T22%3A29%3A22Z&sr=b&sp=r&sig=3r1JvnjimdGw6bIdCU3v28PgEf%2BVL2n8uM1aCSphqNo%3D)
2026-03-29 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146000/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV08ECZ/42811803?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=LKp%2BGx1fZJuecdPvxpleobyFbgQg%2BAeW6RcmgKVyqVk%3D)
2026-03-29 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388441/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL68UZJ/42811837?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=nph2F%2FW6m12z%2FYFEj3Ycz1Gy7uXC8be5nXf0j5ESQjw%3D)
2026-03-29 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126569/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU68FGN/42811417?sv=2020-08-04&st=2026-03-29T22%3A04%3A13Z&se=2026-03-29T22%3A29%3A13Z&sr=b&sp=r&sig=RCrqulUVcgAVBuj9iX2cS9VTIHmOPa8of1NBVC2WuDI%3D)
2026-03-29 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455828/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SY15YVR/42786483?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=FK9rDus56J%2FV9P57RamAAihaU4KAtLW5HM1X4F9VrHo%3D)
2026-03-29 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6198d110>
2026-03-29 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSY15YVR%252F699455831%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455831/600 saved to cache
2026-03-29 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96224006-57cb-587c-9533-8a4dcc309913
2026-03-29 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6198d590>
2026-03-29 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG14ZWE%252F699143543%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143543/600 saved to cache
2026-03-29 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e202f37-ad62-5b0d-b809-5a916fb0486e
2026-03-29 22:04:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e202f37-ad62-5b0d-b809-5a916fb0486e, skipping ID generation
2026-03-29 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e202f37-ad62-5b0d-b809-5a916fb0486e sending to next pipeline
2026-03-29 22:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7e202f37-ad62-5b0d-b809-5a916fb0486e, identifier: FG14%20ZWE
2026-03-29 22:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62194b50>
2026-03-29 22:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX13SXE%252F699144219%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144219/600 saved to cache
2026-03-29 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82d2359b-1b38-5883-aaa0-bf564ebc3211
2026-03-29 22:04:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82d2359b-1b38-5883-aaa0-bf564ebc3211, skipping ID generation
2026-03-29 22:04:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82d2359b-1b38-5883-aaa0-bf564ebc3211 sending to next pipeline
2026-03-29 22:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 82d2359b-1b38-5883-aaa0-bf564ebc3211, identifier: GX13%20SXE
2026-03-29 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145974/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV08ECZ/42811803?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=LKp%2BGx1fZJuecdPvxpleobyFbgQg%2BAeW6RcmgKVyqVk%3D)
2026-03-29 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145966/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV08ECZ/42811803?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=LKp%2BGx1fZJuecdPvxpleobyFbgQg%2BAeW6RcmgKVyqVk%3D)
2026-03-29 22:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455813/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SY15YVR/42786483?sv=2020-08-04&st=2026-03-29T22%3A04%3A15Z&se=2026-03-29T22%3A29%3A15Z&sr=b&sp=r&sig=FK9rDus56J%2FV9P57RamAAihaU4KAtLW5HM1X4F9VrHo%3D)
2026-03-29 22:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388327/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388327>
2026-03-29 22:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7e202f37-ad62-5b0d-b809-5a916fb0486e with identifier: FG14%20ZWE
2026-03-29 22:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7e202f37-ad62-5b0d-b809-5a916fb0486e with identifier: FG14%20ZWE
2026-03-29 22:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7e202f37-ad62-5b0d-b809-5a916fb0486e with identifier: FG14%20ZWE to the API
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143543/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_expert_report_file_311e466d-1b94-457e-a041-c34ef2fe8761.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG14%20ZWE-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7e202f37-ad62-5b0d-b809-5a916fb0486e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG14 ZWE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FG14%20ZWE&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': '116I',
'odometer': 39085,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47199,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143510/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43753,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143520/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44953,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143532/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46994,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143543/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44855,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143566/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41312,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143581/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87720,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143598/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59414,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143621/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77367,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143643/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e202f37-ad62-5b0d-b809-5a916fb0486e/7e202f37-ad62-5b0d-b809-5a916fb0486e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81871,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG14ZWE/699143662/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'BMW 116I 1.6 SE STEP Hatchback',
'transmission': 'automatic',
'trim': 'SE STEP',
'vin': 'WBA1A12080P576878',
'year': 2014}
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG14%2520ZWE%27 HTTP/1.1" 200 None
2026-03-29 22:04:49 [bca.uk] INFO: Saving data for FG14%20ZWE: {'created_time': 1774821889.093227, 'last_price_update_time': 1774821889.093238, 'auction_closing_time': 1774951200.0}
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FG14%2520ZWE') HTTP/1.1" 204 0
2026-03-29 22:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 82d2359b-1b38-5883-aaa0-bf564ebc3211 with identifier: GX13%20SXE
2026-03-29 22:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 82d2359b-1b38-5883-aaa0-bf564ebc3211 with identifier: GX13%20SXE
2026-03-29 22:04:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 82d2359b-1b38-5883-aaa0-bf564ebc3211 with identifier: GX13%20SXE to the API
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144219/600>
{'auction_title': '',
'c_o_2_emission_value': 116,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_expert_report_file_3ab8d9a5-7bd3-4ff8-89b7-e3fa725beb0e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GX13%20SXE-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '82d2359b-1b38-5883-aaa0-bf564ebc3211',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GX13 SXE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GX13%20SXE&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 36801,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50760,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144219/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47123,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144224/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48439,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144230/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50676,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144233/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47512,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144240/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45043,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144245/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109664,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144256/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79816,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144261/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88928,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144272/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d2359b-1b38-5883-aaa0-bf564ebc3211/82d2359b-1b38-5883-aaa0-bf564ebc3211_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75629,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX13SXE/699144282/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.4 TSI 122 SE DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI 122 SE DSG',
'vin': 'WVWZZZAUZDP042373',
'year': 2013}
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX13%2520SXE%27 HTTP/1.1" 200 None
2026-03-29 22:04:49 [bca.uk] INFO: Saving data for GX13%20SXE: {'created_time': 1774821889.486237, 'last_price_update_time': 1774821889.486248, 'auction_closing_time': 1774951200.0}
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GX13%2520SXE') HTTP/1.1" 204 0
2026-03-29 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146525/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX19EAW/42811440?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=C09nMtphJ%2F5qYIljNXrzNSV5bitAE4G50wbU1PUP8SU%3D)
2026-03-29 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126491/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU68FGN/42811417?sv=2020-08-04&st=2026-03-29T22%3A04%3A13Z&se=2026-03-29T22%3A29%3A13Z&sr=b&sp=r&sig=RCrqulUVcgAVBuj9iX2cS9VTIHmOPa8of1NBVC2WuDI%3D)
2026-03-29 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388354/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL68UZJ/42811837?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=nph2F%2FW6m12z%2FYFEj3Ycz1Gy7uXC8be5nXf0j5ESQjw%3D)
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac633393d0>
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV08ECZ%252F699146000%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146000/600 saved to cache
2026-03-29 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b1dd0d2-b075-5313-b500-f3a78c134e6f
2026-03-29 22:04:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63645b90>
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL68UZJ%252F699388441%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388441/600 saved to cache
2026-03-29 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d329060a-a095-5b9c-880a-4e9dfce039e5
2026-03-29 22:04:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a9e410>
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU68FGN%252F699126569%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126569/600 saved to cache
2026-03-29 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f30cd769-41b2-536f-8ff2-a84f39302250
2026-03-29 22:04:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637ed750>
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSY15YVR%252F699455828%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455828/600 saved to cache
2026-03-29 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96224006-57cb-587c-9533-8a4dcc309913
2026-03-29 22:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126467/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU68FGN/42811417?sv=2020-08-04&st=2026-03-29T22%3A04%3A13Z&se=2026-03-29T22%3A29%3A13Z&sr=b&sp=r&sig=RCrqulUVcgAVBuj9iX2cS9VTIHmOPa8of1NBVC2WuDI%3D)
2026-03-29 22:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146489/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146489>
2026-03-29 22:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NC08ONX/42812093?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=Zw2w%2BWGBqBzN6FuSvk9oA0R0jIOoFWoee6Cilu52DU4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NC08%20ONX-GB>
2026-03-29 22:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT57DYH/42811171?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=ba3XEcywWuim4PxaK5nJb76sAThRmrq4Rgv5ofIXEw0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT57%20DYH-GB>
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614bcbd0>
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV08ECZ%252F699145974%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145974/600 saved to cache
2026-03-29 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b1dd0d2-b075-5313-b500-f3a78c134e6f
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615288d0>
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV08ECZ%252F699145966%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145966/600 saved to cache
2026-03-29 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b1dd0d2-b075-5313-b500-f3a78c134e6f
2026-03-29 22:04:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b1dd0d2-b075-5313-b500-f3a78c134e6f, skipping ID generation
2026-03-29 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b1dd0d2-b075-5313-b500-f3a78c134e6f sending to next pipeline
2026-03-29 22:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1b1dd0d2-b075-5313-b500-f3a78c134e6f, identifier: OV08%20ECZ
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617ec2d0>
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSY15YVR%252F699455813%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455813/600 saved to cache
2026-03-29 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96224006-57cb-587c-9533-8a4dcc309913
2026-03-29 22:04:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96224006-57cb-587c-9533-8a4dcc309913, skipping ID generation
2026-03-29 22:04:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96224006-57cb-587c-9533-8a4dcc309913 sending to next pipeline
2026-03-29 22:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 96224006-57cb-587c-9533-8a4dcc309913, identifier: SY15%20YVR
2026-03-29 22:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1b1dd0d2-b075-5313-b500-f3a78c134e6f with identifier: OV08%20ECZ
2026-03-29 22:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1b1dd0d2-b075-5313-b500-f3a78c134e6f with identifier: OV08%20ECZ
2026-03-29 22:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1b1dd0d2-b075-5313-b500-f3a78c134e6f with identifier: OV08%20ECZ to the API
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145966/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_expert_report_file_404ee40e-23a3-4c5c-9350-efa370b462d4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV08%20ECZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1b1dd0d2-b075-5313-b500-f3a78c134e6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV08 ECZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV08%20ECZ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 38640,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49206,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145966/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47120,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145974/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46095,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145982/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47549,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145988/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48147,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699145994/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47611,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146000/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97144,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146012/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72019,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146022/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84781,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146033/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1dd0d2-b075-5313-b500-f3a78c134e6f/1b1dd0d2-b075-5313-b500-f3a78c134e6f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44814,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV08ECZ/699146046/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.4 D-4D TR MMT Hatchback',
'transmission': 'automatic',
'trim': 'D-4D TR MMT',
'vin': 'VNKKC96390A160191',
'year': 2008}
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV08%2520ECZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:50 [bca.uk] INFO: Saving data for OV08%20ECZ: {'created_time': 1774821890.391007, 'last_price_update_time': 1774821890.391021, 'auction_closing_time': 1774951200.0}
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV08%2520ECZ') HTTP/1.1" 204 0
2026-03-29 22:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 96224006-57cb-587c-9533-8a4dcc309913 with identifier: SY15%20YVR
2026-03-29 22:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 96224006-57cb-587c-9533-8a4dcc309913 with identifier: SY15%20YVR
2026-03-29 22:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 96224006-57cb-587c-9533-8a4dcc309913 with identifier: SY15%20YVR to the API
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455813/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_expert_report_file_d291f0b0-6dc2-4682-9b12-4620dd7f83d8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SY15%20YVR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': '96224006-57cb-587c-9533-8a4dcc309913',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SY15 YVR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SY15%20YVR&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 76743,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53204,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455810/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49876,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455813/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47277,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455816/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48856,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455819/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44151,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455821/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41961,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455824/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91747,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455828/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86482,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455831/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89592,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455836/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96224006-57cb-587c-9533-8a4dcc309913/96224006-57cb-587c-9533-8a4dcc309913_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81351,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY15YVR/699455841/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.2 TSI 105 S Hatchback',
'transmission': 'manual',
'trim': 'TSI 105 S',
'vin': 'WVWZZZAUZFP111596',
'year': 2015}
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY15%2520YVR%27 HTTP/1.1" 200 None
2026-03-29 22:04:50 [bca.uk] INFO: Saving data for SY15%20YVR: {'created_time': 1774821890.776496, 'last_price_update_time': 1774821890.776506, 'auction_closing_time': 1775210400.0}
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SY15%2520YVR') HTTP/1.1" 204 0
2026-03-29 22:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL07HRM/42787034?sv=2020-08-04&st=2026-03-29T22%3A04%3A47Z&se=2026-03-29T22%3A29%3A47Z&sr=b&sp=r&sig=exdoUniRSbIwQ12LkQI9utrlzs26smvmyOvTrgGhZiY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388297/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388297>
2026-03-29 22:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM54XHA/42811172?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=wc9iWas244mOWFhb%2BwCxFVBHyC3mtDYXAJcNgtASgkE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM54%20XHA-GB>
2026-03-29 22:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388270/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388270>
2026-03-29 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6188c890>
2026-03-29 22:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX19EAW%252F699146525%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146525/600 saved to cache
2026-03-29 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6
2026-03-29 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63682ad0>
2026-03-29 22:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU68FGN%252F699126491%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126491/600 saved to cache
2026-03-29 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f30cd769-41b2-536f-8ff2-a84f39302250
2026-03-29 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63646d10>
2026-03-29 22:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL68UZJ%252F699388354%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388354/600 saved to cache
2026-03-29 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d329060a-a095-5b9c-880a-4e9dfce039e5
2026-03-29 22:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427841/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427841>
2026-03-29 22:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388327/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL68UZJ/42811837?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=nph2F%2FW6m12z%2FYFEj3Ycz1Gy7uXC8be5nXf0j5ESQjw%3D)
2026-03-29 22:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427767/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427767>
2026-03-29 22:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388255/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FL68UZJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632cc810>
2026-03-29 22:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU68FGN%252F699126467%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126467/600 saved to cache
2026-03-29 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f30cd769-41b2-536f-8ff2-a84f39302250
2026-03-29 22:04:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f30cd769-41b2-536f-8ff2-a84f39302250, skipping ID generation
2026-03-29 22:04:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f30cd769-41b2-536f-8ff2-a84f39302250 sending to next pipeline
2026-03-29 22:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f30cd769-41b2-536f-8ff2-a84f39302250, identifier: BU68%20FGN
2026-03-29 22:04:51 [bca.uk] INFO: Total items found: 100
2026-03-29 22:04:51 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded
2026-03-29 22:04:51 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:04:51 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69adc810>
2026-03-29 22:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_expert_report_file_dbcc937c-ab19-4780-806b-e2591e673717.pdf HTTP/1.1" 201 0
2026-03-29 22:04:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3f87fc02-985b-5b39-b30d-ff94e761a881
2026-03-29 22:04:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f87fc02-985b-5b39-b30d-ff94e761a881, skipping ID generation
2026-03-29 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 3f87fc02-985b-5b39-b30d-ff94e761a881
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPL07HRM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PL07HRM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f30cd769-41b2-536f-8ff2-a84f39302250 with identifier: BU68%20FGN
2026-03-29 22:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f30cd769-41b2-536f-8ff2-a84f39302250 with identifier: BU68%20FGN
2026-03-29 22:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f30cd769-41b2-536f-8ff2-a84f39302250 with identifier: BU68%20FGN to the API
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126467/600>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_expert_report_file_b5a14909-cd33-44c1-97e8-a381d8f4564e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BU68%20FGN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f30cd769-41b2-536f-8ff2-a84f39302250',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BU68 FGN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BU68%20FGN&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'BMW',
'model': '2 GRAN TOURER',
'odometer': 68071,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39741,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126400/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39630,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126406/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38813,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126413/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39226,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126426/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37449,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126445/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37335,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126467/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89969,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126491/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77922,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126524/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83823,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126551/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30cd769-41b2-536f-8ff2-a84f39302250/f30cd769-41b2-536f-8ff2-a84f39302250_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89456,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU68FGN/699126569/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'BMW 2 GRAN TOURER 1.5 216D LUXURY STEP MPV',
'transmission': 'automatic',
'trim': '216D LUXURY STEP',
'vin': 'WBA6W52010EC88620',
'year': 2018}
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU68%2520FGN%27 HTTP/1.1" 200 None
2026-03-29 22:04:51 [bca.uk] INFO: Saving data for BU68%20FGN: {'created_time': 1774821891.500512, 'last_price_update_time': 1774821891.500524, 'auction_closing_time': 1774951200.0}
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BU68%2520FGN') HTTP/1.1" 204 0
2026-03-29 22:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406304/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406304>
2026-03-29 22:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411767/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411767>
2026-03-29 22:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409195/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409195>
2026-03-29 22:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414881>
2026-03-29 22:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388270/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL68UZJ/42811837?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=nph2F%2FW6m12z%2FYFEj3Ycz1Gy7uXC8be5nXf0j5ESQjw%3D)
2026-03-29 22:04:51 [bca.uk] INFO: Found listing with ID: SB64%20PPZ
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB64%2520PPZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:51 [bca.uk] INFO: Scrape type for SB64%20PPZ: 0
2026-03-29 22:04:51 [bca.uk] INFO: Found listing with ID: GR12%20EYN
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GR12%2520EYN%27 HTTP/1.1" 200 None
2026-03-29 22:04:51 [bca.uk] INFO: Scrape type for GR12%20EYN: 0
2026-03-29 22:04:51 [bca.uk] INFO: Found listing with ID: KC07%20EZX
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KC07%2520EZX%27 HTTP/1.1" 200 None
2026-03-29 22:04:51 [bca.uk] INFO: Scrape type for KC07%20EZX: 0
2026-03-29 22:04:51 [bca.uk] INFO: Found listing with ID: NG57%20MFP
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG57%2520MFP%27 HTTP/1.1" 200 None
2026-03-29 22:04:51 [bca.uk] INFO: Scrape type for NG57%20MFP: 0
2026-03-29 22:04:51 [bca.uk] INFO: Found listing with ID: SH10%20KXB
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH10%2520KXB%27 HTTP/1.1" 200 None
2026-03-29 22:04:51 [bca.uk] INFO: Scrape type for SH10%20KXB: 0
2026-03-29 22:04:51 [bca.uk] INFO: Found listing with ID: SP64%20OPY
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP64%2520OPY%27 HTTP/1.1" 200 None
2026-03-29 22:04:51 [bca.uk] INFO: Scrape type for SP64%20OPY: 0
2026-03-29 22:04:51 [bca.uk] INFO: Found listing with ID: DE22%20VVP
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE22%2520VVP%27 HTTP/1.1" 200 None
2026-03-29 22:04:51 [bca.uk] INFO: Scrape type for DE22%20VVP: 0
2026-03-29 22:04:51 [bca.uk] INFO: Found listing with ID: GV55%20UOJ
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV55%2520UOJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:51 [bca.uk] INFO: Scrape type for GV55%20UOJ: 0
2026-03-29 22:04:51 [bca.uk] INFO: Found listing with ID: KS07%20RBV
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS07%2520RBV%27 HTTP/1.1" 200 None
2026-03-29 22:04:51 [bca.uk] INFO: Scrape type for KS07%20RBV: 0
2026-03-29 22:04:51 [bca.uk] INFO: Found listing with ID: LL58%20VVO
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL58%2520VVO%27 HTTP/1.1" 200 None
2026-03-29 22:04:51 [bca.uk] INFO: Scrape type for LL58%20VVO: 2
2026-03-29 22:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f306cc75-0c8a-524a-b346-f3d7c1dc5cfa with identifier: LL58%20VVO
2026-03-29 22:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f306cc75-0c8a-524a-b346-f3d7c1dc5cfa with scrape type 2
2026-03-29 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f306cc75-0c8a-524a-b346-f3d7c1dc5cfa with scrape type 2
2026-03-29 22:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f306cc75-0c8a-524a-b346-f3d7c1dc5cfa, identifier: LL58%20VVO
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142716%27 HTTP/1.1" 200 None
2026-03-29 22:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142716 not downloaded yet
2026-03-29 22:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146489/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX19EAW/42811440?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=C09nMtphJ%2F5qYIljNXrzNSV5bitAE4G50wbU1PUP8SU%3D)
2026-03-29 22:04:51 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:04:51 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f306cc75-0c8a-524a-b346-f3d7c1dc5cfa with identifier: LL58%20VVO
2026-03-29 22:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f306cc75-0c8a-524a-b346-f3d7c1dc5cfa with identifier: LL58%20VVO
2026-03-29 22:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f306cc75-0c8a-524a-b346-f3d7c1dc5cfa with identifier: LL58%20VVO to the API
2026-03-29 22:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 215,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LL58%20VVO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f306cc75-0c8a-524a-b346-f3d7c1dc5cfa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL58 VVO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LL58%20VVO&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MERCEDES-BENZ',
'model': 'CLS 320',
'odometer': 115709,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLS 320 3.0 CDI TIP Coupe',
'transmission': 'manual',
'trim': 'CDI TIP',
'vin': 'WDD2193222A127892',
'year': 2008}
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL58%2520VVO%27 HTTP/1.1" 200 None
2026-03-29 22:04:52 [bca.uk] INFO: Saving data for LL58%20VVO: {'auction_closing_time': 1774864800.0, 'created_time': 1774620554.841011, 'last_price_update_time': 1774821892.125039}
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LL58%2520VVO') HTTP/1.1" 204 0
2026-03-29 22:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6185d0d0>
2026-03-29 22:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL68UZJ%252F699388327%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388327/600 saved to cache
2026-03-29 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d329060a-a095-5b9c-880a-4e9dfce039e5
2026-03-29 22:04:52 [bca.uk] INFO: Found listing with ID: NJ58%20GBO
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ58%2520GBO%27 HTTP/1.1" 200 None
2026-03-29 22:04:52 [bca.uk] INFO: Scrape type for NJ58%20GBO: 0
2026-03-29 22:04:52 [bca.uk] INFO: Found listing with ID: SV60%20AMX
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV60%2520AMX%27 HTTP/1.1" 200 None
2026-03-29 22:04:52 [bca.uk] INFO: Scrape type for SV60%20AMX: 2
2026-03-29 22:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c84851b-c92d-512b-bb9a-0d77f8501a62 with identifier: SV60%20AMX
2026-03-29 22:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c84851b-c92d-512b-bb9a-0d77f8501a62 with scrape type 2
2026-03-29 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c84851b-c92d-512b-bb9a-0d77f8501a62 with scrape type 2
2026-03-29 22:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4c84851b-c92d-512b-bb9a-0d77f8501a62, identifier: SV60%20AMX
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142726%27 HTTP/1.1" 200 None
2026-03-29 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142726 not downloaded yet
2026-03-29 22:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4c84851b-c92d-512b-bb9a-0d77f8501a62 with identifier: SV60%20AMX
2026-03-29 22:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4c84851b-c92d-512b-bb9a-0d77f8501a62 with identifier: SV60%20AMX
2026-03-29 22:04:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4c84851b-c92d-512b-bb9a-0d77f8501a62 with identifier: SV60%20AMX to the API
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV60%20AMX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4c84851b-c92d-512b-bb9a-0d77f8501a62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV60 AMX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV60%20AMX&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'LAND ROVER',
'model': 'FREELANDER 2',
'odometer': 101826,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'LAND ROVER FREELANDER 2 2.2 SD4 190 XS StationWagon',
'transmission': 'automatic',
'trim': 'SD4 190 XS',
'vin': 'SALFA2AE1BH216529',
'year': 2010}
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV60%2520AMX%27 HTTP/1.1" 200 None
2026-03-29 22:04:52 [bca.uk] INFO: Saving data for SV60%20AMX: {'auction_closing_time': 1774864800.0, 'created_time': 1774620558.219003, 'last_price_update_time': 1774821892.735296}
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV60%2520AMX') HTTP/1.1" 204 0
2026-03-29 22:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619c2490>
2026-03-29 22:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL68UZJ%252F699388270%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388270/600 saved to cache
2026-03-29 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d329060a-a095-5b9c-880a-4e9dfce039e5
2026-03-29 22:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NC08ONX/42812093?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=Zw2w%2BWGBqBzN6FuSvk9oA0R0jIOoFWoee6Cilu52DU4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388255/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL68UZJ/42811837?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=nph2F%2FW6m12z%2FYFEj3Ycz1Gy7uXC8be5nXf0j5ESQjw%3D)
2026-03-29 22:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427767/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE20EVL/42811999?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=QNaGwsE1HTKndyV7dS5jfLI1ozyFJBkYcrsiWmkuv8k%3D)
2026-03-29 22:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406214/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LA70NPE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040090/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YH70YYW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388297/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL68UZJ/42811837?sv=2020-08-04&st=2026-03-29T22%3A04%3A11Z&se=2026-03-29T22%3A29%3A11Z&sr=b&sp=r&sig=nph2F%2FW6m12z%2FYFEj3Ycz1Gy7uXC8be5nXf0j5ESQjw%3D)
2026-03-29 22:04:52 [bca.uk] INFO: Found listing with ID: Y597%20TPO
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y597%2520TPO%27 HTTP/1.1" 200 None
2026-03-29 22:04:52 [bca.uk] INFO: Scrape type for Y597%20TPO: 0
2026-03-29 22:04:52 [bca.uk] INFO: Found listing with ID: BL06%20FCX
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL06%2520FCX%27 HTTP/1.1" 200 None
2026-03-29 22:04:52 [bca.uk] INFO: Scrape type for BL06%20FCX: 2
2026-03-29 22:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4056ca9-913e-5d3b-a0cb-60af4f2cf9b3 with identifier: BL06%20FCX
2026-03-29 22:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4056ca9-913e-5d3b-a0cb-60af4f2cf9b3 with scrape type 2
2026-03-29 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4056ca9-913e-5d3b-a0cb-60af4f2cf9b3 with scrape type 2
2026-03-29 22:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b4056ca9-913e-5d3b-a0cb-60af4f2cf9b3, identifier: BL06%20FCX
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142745%27 HTTP/1.1" 200 None
2026-03-29 22:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142745 not downloaded yet
2026-03-29 22:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT57DYH/42811171?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=ba3XEcywWuim4PxaK5nJb76sAThRmrq4Rgv5ofIXEw0%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b4056ca9-913e-5d3b-a0cb-60af4f2cf9b3 with identifier: BL06%20FCX
2026-03-29 22:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b4056ca9-913e-5d3b-a0cb-60af4f2cf9b3 with identifier: BL06%20FCX
2026-03-29 22:04:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b4056ca9-913e-5d3b-a0cb-60af4f2cf9b3 with identifier: BL06%20FCX to the API
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 181,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BL06%20FCX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b4056ca9-913e-5d3b-a0cb-60af4f2cf9b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BL06 FCX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BL06%20FCX&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'FUSION',
'odometer': 92328,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'FORD FUSION 1.6 + Estate',
'transmission': 'automatic',
'trim': '+',
'vin': 'WF0UXXGAJU6U46251',
'year': 2006}
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL06%2520FCX%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Saving data for BL06%20FCX: {'auction_closing_time': 1774864800.0, 'created_time': 1774620740.169629, 'last_price_update_time': 1774821893.305481}
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BL06%2520FCX') HTTP/1.1" 204 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: FG55%20FRR
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG55%2520FRR%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for FG55%20FRR: 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: LD55%20FYW
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD55%2520FYW%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for LD55%20FYW: 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: FY61%20JNV
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY61%2520JNV%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for FY61%20JNV: 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: HN10%20HGD
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN10%2520HGD%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for HN10%20HGD: 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: LR62%20HPF
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR62%2520HPF%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for LR62%20HPF: 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: LT17%20VNE
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT17%2520VNE%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for LT17%20VNE: 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: MX59%20XPW
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX59%2520XPW%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for MX59%20XPW: 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: OY63%20BJV
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY63%2520BJV%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for OY63%20BJV: 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: SD58%20UUA
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD58%2520UUA%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for SD58%20UUA: 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: AF64%20JYY
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF64%2520JYY%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for AF64%20JYY: 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: BN65%20ULK
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN65%2520ULK%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for BN65%20ULK: 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: DG12%20DPU
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG12%2520DPU%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for DG12%20DPU: 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: EY15%20MPX
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY15%2520MPX%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for EY15%20MPX: 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: MV19%20XLX
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV19%2520XLX%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for MV19%20XLX: 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: MF68%20OCS
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF68%2520OCS%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for MF68%20OCS: 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: SR68%20LNY
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR68%2520LNY%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for SR68%20LNY: 0
2026-03-29 22:04:53 [bca.uk] INFO: Found listing with ID: DN67%20WOR
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN67%2520WOR%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [bca.uk] INFO: Scrape type for DN67%20WOR: 2
2026-03-29 22:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14a17262-0964-5c53-9593-519670dd55c1 with identifier: DN67%20WOR
2026-03-29 22:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14a17262-0964-5c53-9593-519670dd55c1 with scrape type 2
2026-03-29 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14a17262-0964-5c53-9593-519670dd55c1 with scrape type 2
2026-03-29 22:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 14a17262-0964-5c53-9593-519670dd55c1, identifier: DN67%20WOR
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142759%27 HTTP/1.1" 200 None
2026-03-29 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142759 not downloaded yet
2026-03-29 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac684a6690>
2026-03-29 22:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX19EAW%252F699146489%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146489/600 saved to cache
2026-03-29 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6
2026-03-29 22:04:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6, skipping ID generation
2026-03-29 22:04:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6 sending to next pipeline
2026-03-29 22:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6, identifier: RX19%20EAW
2026-03-29 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409195/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PA19DCO/42811984?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=5dad8F2568bHOl2s5RwggeSpVONMrl6yr8ByaoDJDOc%3D)
2026-03-29 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414881/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ72FOT/42812096?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=F1eqEFipUoySPGKOeLKkFyyLLItl9dJbMFy96XQcSRY%3D)
2026-03-29 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406304/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG69FWY/42811982?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=iIU0ZFwxCrfo9iR2T7l%2BEKiHBXHpV%2FjhvFuNPQMcBwU%3D)
2026-03-29 22:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SW14DSO/42797814?sv=2020-08-04&st=2026-03-29T22%3A04%3A52Z&se=2026-03-29T22%3A29%3A52Z&sr=b&sp=r&sig=HWRGmMiZHUzQfBmk5OQ1D7P%2FeZsK7wYaXZ1soCo9ztg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SW14%20DSO-GB>
2026-03-29 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411767/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML23KNX/42812081?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Ysjf2AWU3A%2B%2BhkZ4EdoIgPpKhCyN1a54UPjPwLBr1pc%3D)
2026-03-29 22:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427841/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19VXX/42812304?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=YzGWBhkemG5tXMwAwvYpsWX0bEfwiTWFoG%2FIuzQzr2c%3D)
2026-03-29 22:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 14a17262-0964-5c53-9593-519670dd55c1 with identifier: DN67%20WOR
2026-03-29 22:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 14a17262-0964-5c53-9593-519670dd55c1 with identifier: DN67%20WOR
2026-03-29 22:04:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 14a17262-0964-5c53-9593-519670dd55c1 with identifier: DN67%20WOR to the API
2026-03-29 22:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DN67%20WOR-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '14a17262-0964-5c53-9593-519670dd55c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DN67 WOR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DN67%20WOR&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VOLKSWAGEN',
'model': 'PASSAT',
'odometer': 18970,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN PASSAT 1.4 TSI 150 SE BUSINESS DSG Saloon',
'transmission': 'automatic',
'trim': 'TSI 150 SE BUSINESS DSG',
'vin': 'WVWZZZ3CZJE066871',
'year': 2017}
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN67%2520WOR%27 HTTP/1.1" 200 None
2026-03-29 22:04:54 [bca.uk] INFO: Saving data for DN67%20WOR: {'auction_closing_time': 1774951200.0, 'created_time': 1774389849.710293, 'last_price_update_time': 1774821894.219929}
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DN67%2520WOR') HTTP/1.1" 204 0
2026-03-29 22:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6 with identifier: RX19%20EAW
2026-03-29 22:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6 with identifier: RX19%20EAW
2026-03-29 22:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7b9b7bdc-9796-56d8-8d00-b9fe15be4db6 with identifier: RX19%20EAW to the API
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146489/600>
{'auction_title': '',
'c_o_2_emission_value': 151,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_expert_report_file_9f50d8c2-5e23-4c9e-b6f1-94d0715b0a17.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RX19%20EAW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7b9b7bdc-9796-56d8-8d00-b9fe15be4db6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RX19 EAW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RX19%20EAW&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'KUGA',
'odometer': 86918,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51332,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146447/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47104,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146453/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46791,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146460/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49200,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146466/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47627,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146472/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43782,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146479/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87348,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146489/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76638,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146501/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92657,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146515/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b9b7bdc-9796-56d8-8d00-b9fe15be4db6/7b9b7bdc-9796-56d8-8d00-b9fe15be4db6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82445,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX19EAW/699146525/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 150 2WD TITANIUM ED. StationWagon',
'transmission': 'manual',
'trim': 'TDCI 150 2WD TITANIUM ED.',
'vin': 'WF0AXXWPMAKD53901',
'year': 2019}
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX19%2520EAW%27 HTTP/1.1" 200 None
2026-03-29 22:04:54 [bca.uk] INFO: Saving data for RX19%20EAW: {'created_time': 1774821894.69703, 'last_price_update_time': 1774821894.697041, 'auction_closing_time': 1774951200.0}
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RX19%2520EAW') HTTP/1.1" 204 0
2026-03-29 22:04:54 [bca.uk] INFO: Found listing with ID: KJ55%20VZW
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ55%2520VZW%27 HTTP/1.1" 200 None
2026-03-29 22:04:54 [bca.uk] INFO: Scrape type for KJ55%20VZW: 0
2026-03-29 22:04:54 [bca.uk] INFO: Found listing with ID: KP23%20YGJ
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP23%2520YGJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:54 [bca.uk] INFO: Scrape type for KP23%20YGJ: 0
2026-03-29 22:04:54 [bca.uk] INFO: Found listing with ID: MM18%20XBD
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM18%2520XBD%27 HTTP/1.1" 200 None
2026-03-29 22:04:54 [bca.uk] INFO: Scrape type for MM18%20XBD: 0
2026-03-29 22:04:54 [bca.uk] INFO: Found listing with ID: MK60%20MVP
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK60%2520MVP%27 HTTP/1.1" 200 None
2026-03-29 22:04:54 [bca.uk] INFO: Scrape type for MK60%20MVP: 0
2026-03-29 22:04:54 [bca.uk] INFO: Found listing with ID: W31%20RJE
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27W31%2520RJE%27 HTTP/1.1" 200 None
2026-03-29 22:04:54 [bca.uk] INFO: Scrape type for W31%20RJE: 0
2026-03-29 22:04:54 [bca.uk] INFO: Found listing with ID: AP68%20OOU
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP68%2520OOU%27 HTTP/1.1" 200 None
2026-03-29 22:04:54 [bca.uk] INFO: Scrape type for AP68%20OOU: 0
2026-03-29 22:04:54 [bca.uk] INFO: Found listing with ID: CN65%20YEE
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN65%2520YEE%27 HTTP/1.1" 200 None
2026-03-29 22:04:54 [bca.uk] INFO: Scrape type for CN65%20YEE: 2
2026-03-29 22:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa3df492-4aaf-53ba-bb97-27f5e12d95d6 with identifier: CN65%20YEE
2026-03-29 22:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa3df492-4aaf-53ba-bb97-27f5e12d95d6 with scrape type 2
2026-03-29 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa3df492-4aaf-53ba-bb97-27f5e12d95d6 with scrape type 2
2026-03-29 22:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: aa3df492-4aaf-53ba-bb97-27f5e12d95d6, identifier: CN65%20YEE
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142773%27 HTTP/1.1" 200 None
2026-03-29 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142773 not downloaded yet
2026-03-29 22:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61594050>
2026-03-29 22:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_expert_report_file_03b1045a-a2c1-451e-a50e-1cfbbecfa1fc.pdf HTTP/1.1" 201 0
2026-03-29 22:04:54 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 40b88b0b-760b-5e8d-8f49-074bf256e466
2026-03-29 22:04:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40b88b0b-760b-5e8d-8f49-074bf256e466, skipping ID generation
2026-03-29 22:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 40b88b0b-760b-5e8d-8f49-074bf256e466
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNC08ONX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NC08ONX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6116aa90>
2026-03-29 22:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL68UZJ%252F699388255%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388255/600 saved to cache
2026-03-29 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d329060a-a095-5b9c-880a-4e9dfce039e5
2026-03-29 22:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61523750>
2026-03-29 22:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE20EVL%252F699427767%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427767/600 saved to cache
2026-03-29 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b145ed4d-e096-5329-b7ec-7396067fba60
2026-03-29 22:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63651110>
2026-03-29 22:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL68UZJ%252F699388297%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388297/600 saved to cache
2026-03-29 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d329060a-a095-5b9c-880a-4e9dfce039e5
2026-03-29 22:04:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d329060a-a095-5b9c-880a-4e9dfce039e5, skipping ID generation
2026-03-29 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d329060a-a095-5b9c-880a-4e9dfce039e5 sending to next pipeline
2026-03-29 22:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d329060a-a095-5b9c-880a-4e9dfce039e5, identifier: FL68%20UZJ
2026-03-29 22:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6193fb10>
2026-03-29 22:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_expert_report_file_c24ea412-1e17-432b-903b-aa7d525d4942.pdf HTTP/1.1" 201 0
2026-03-29 22:04:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3ba7d5c4-734f-5e05-8725-12f4a7e78af1
2026-03-29 22:04:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ba7d5c4-734f-5e05-8725-12f4a7e78af1, skipping ID generation
2026-03-29 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 3ba7d5c4-734f-5e05-8725-12f4a7e78af1
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLT57DYH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT57DYH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM54XHA/42811172?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=wc9iWas244mOWFhb%2BwCxFVBHyC3mtDYXAJcNgtASgkE%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142699/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PL07HRM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: aa3df492-4aaf-53ba-bb97-27f5e12d95d6 with identifier: CN65%20YEE
2026-03-29 22:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: aa3df492-4aaf-53ba-bb97-27f5e12d95d6 with identifier: CN65%20YEE
2026-03-29 22:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: aa3df492-4aaf-53ba-bb97-27f5e12d95d6 with identifier: CN65%20YEE to the API
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CN65%20YEE-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'aa3df492-4aaf-53ba-bb97-27f5e12d95d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CN65 YEE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CN65%20YEE&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 78741,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 TD4 180 4WD HSE DYNAMIC Hatchback',
'transmission': 'automatic',
'trim': 'TD4 180 4WD HSE DYNAMIC',
'vin': 'SALVA2AN3GH092296',
'year': 2015}
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN65%2520YEE%27 HTTP/1.1" 200 None
2026-03-29 22:04:55 [bca.uk] INFO: Saving data for CN65%20YEE: {'auction_closing_time': 1774864800.0, 'created_time': 1774620549.704512, 'last_price_update_time': 1774821895.604625}
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CN65%2520YEE') HTTP/1.1" 204 0
2026-03-29 22:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d329060a-a095-5b9c-880a-4e9dfce039e5 with identifier: FL68%20UZJ
2026-03-29 22:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d329060a-a095-5b9c-880a-4e9dfce039e5 with identifier: FL68%20UZJ
2026-03-29 22:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d329060a-a095-5b9c-880a-4e9dfce039e5 with identifier: FL68%20UZJ to the API
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388297/600>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_expert_report_file_dcc3a80f-3430-4c02-8ee0-db0fb2b32c09.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL68%20UZJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd329060a-a095-5b9c-880a-4e9dfce039e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL68 UZJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL68%20UZJ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'TOYOTA',
'model': 'C-HR',
'odometer': 82307,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40853,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388255/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40480,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388270/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42682,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388285/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43416,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388297/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38695,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388308/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36515,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388327/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100732,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388354/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70727,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388388/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95961,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388424/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d329060a-a095-5b9c-880a-4e9dfce039e5/d329060a-a095-5b9c-880a-4e9dfce039e5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70726,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL68UZJ/699388441/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'TOYOTA C-HR 1.2 T 115 ICON Hatchback',
'transmission': 'manual',
'trim': 'T 115 ICON',
'vin': 'NMTKY3BX60R050071',
'year': 2019}
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL68%2520UZJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:55 [bca.uk] INFO: Saving data for FL68%20UZJ: {'created_time': 1774821895.990865, 'last_price_update_time': 1774821895.990878, 'auction_closing_time': 1774951200.0}
2026-03-29 22:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL68%2520UZJ') HTTP/1.1" 204 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: EX68%20FPN
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX68%2520FPN%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for EX68%20FPN: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: FM15%20ZHT
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM15%2520ZHT%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for FM15%20ZHT: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: LF65%20XBO
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF65%2520XBO%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for LF65%20XBO: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: RK65%20WOA
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK65%2520WOA%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for RK65%20WOA: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: LA17%20FSO
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA17%2520FSO%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for LA17%20FSO: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: LC14%20WNW
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC14%2520WNW%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for LC14%20WNW: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: LC66%20FZS
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC66%2520FZS%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for LC66%20FZS: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: LY14%20ERJ
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY14%2520ERJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for LY14%20ERJ: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: BG67%20KMM
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG67%2520KMM%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for BG67%20KMM: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: AV74%20RVC
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV74%2520RVC%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for AV74%20RVC: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: LV20%20HMX
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV20%2520HMX%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for LV20%20HMX: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: SK60%20UGF
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK60%2520UGF%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for SK60%20UGF: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: BG02%20BJK
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG02%2520BJK%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for BG02%20BJK: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: VK07%20HPZ
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK07%2520HPZ%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for VK07%20HPZ: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: KX07%20ZZU
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX07%2520ZZU%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for KX07%20ZZU: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: LK11%20RXW
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK11%2520RXW%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for LK11%20RXW: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: LP65%20LHG
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP65%2520LHG%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for LP65%20LHG: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: LR60%20OPW
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR60%2520OPW%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for LR60%20OPW: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: SV64%20OWW
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV64%2520OWW%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for SV64%20OWW: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: WR08%20KVG
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR08%2520KVG%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for WR08%20KVG: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: YH10%20OGJ
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH10%2520OGJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for YH10%20OGJ: 0
2026-03-29 22:04:56 [bca.uk] INFO: Found listing with ID: EY15%20ZYF
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY15%2520ZYF%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [bca.uk] INFO: Scrape type for EY15%20ZYF: 2
2026-03-29 22:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52a15874-4b34-5f06-8fac-5877877083ea with identifier: EY15%20ZYF
2026-03-29 22:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52a15874-4b34-5f06-8fac-5877877083ea with scrape type 2
2026-03-29 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52a15874-4b34-5f06-8fac-5877877083ea with scrape type 2
2026-03-29 22:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 52a15874-4b34-5f06-8fac-5877877083ea, identifier: EY15%20ZYF
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142790%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142790 not downloaded yet
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395714%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395714 not downloaded yet
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046538%27 HTTP/1.1" 200 None
2026-03-29 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046538 not downloaded yet
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61834090>
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPA19DCO%252F699409195%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409195/600 saved to cache
2026-03-29 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da397772-3003-5876-84de-18e19f2e1e0e
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac622595d0>
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ72FOT%252F699414881%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414881/600 saved to cache
2026-03-29 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6216b110>
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG69FWY%252F699406304%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406304/600 saved to cache
2026-03-29 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23673480-b7c5-5707-903a-2783d4797f75
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61918c90>
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML23KNX%252F699411767%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411767/600 saved to cache
2026-03-29 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c96e7ad0-7cd4-5ea7-b41d-642972a2bf14
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6368fa90>
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19VXX%252F699427841%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427841/600 saved to cache
2026-03-29 22:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 553a9526-308c-5e9f-97f5-1bce769f99d7
2026-03-29 22:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406214/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LA70NPE/42811995?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=1ymICcEKrtpKHFHLQTc1yKaMMeniIFUDVOMDF5neyAs%3D)
2026-03-29 22:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040090/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH70YYW/42571204?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=3YETERDVJsfcYf9zoGQQnS8MvGAFRjTT6qcrLaHjjZg%3D)
2026-03-29 22:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142726/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142726>
2026-03-29 22:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435116/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435116>
2026-03-29 22:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142716/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142716>
2026-03-29 22:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409168/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409168>
2026-03-29 22:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 52a15874-4b34-5f06-8fac-5877877083ea with identifier: EY15%20ZYF
2026-03-29 22:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 52a15874-4b34-5f06-8fac-5877877083ea with identifier: EY15%20ZYF
2026-03-29 22:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 52a15874-4b34-5f06-8fac-5877877083ea with identifier: EY15%20ZYF to the API
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY15%20ZYF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '52a15874-4b34-5f06-8fac-5877877083ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY15 ZYF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EY15%20ZYF&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VOLKSWAGEN',
'model': 'UP!',
'odometer': 28539,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN UP! 1.0 75 HIGH UP ASG Hatchback',
'transmission': 'automatic',
'trim': '75 HIGH UP ASG',
'vin': 'WVWZZZAAZFD101536',
'year': 2015}
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY15%2520ZYF%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Saving data for EY15%20ZYF: {'auction_closing_time': 1774864800.0, 'created_time': 1774610713.621585, 'last_price_update_time': 1774821897.029835}
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EY15%2520ZYF') HTTP/1.1" 204 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: FX67%20PWY
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX67%2520PWY%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for FX67%20PWY: 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: GD18%20EBL
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD18%2520EBL%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for GD18%20EBL: 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: GN60%20DYJ
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN60%2520DYJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for GN60%20DYJ: 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: HN13%20WYH
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN13%2520WYH%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for HN13%20WYH: 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: KR07%20SVF
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR07%2520SVF%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for KR07%20SVF: 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: LA13%20SHJ
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA13%2520SHJ%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for LA13%20SHJ: 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: LA16%20DYU
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA16%2520DYU%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for LA16%20DYU: 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: LN56%20KNR
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN56%2520KNR%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for LN56%20KNR: 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: MF09%20XGA
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF09%2520XGA%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for MF09%20XGA: 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: SR16%20YTB
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR16%2520YTB%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for SR16%20YTB: 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: SY19%20FEV
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY19%2520FEV%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for SY19%20FEV: 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: Y22%20MSN
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y22%2520MSN%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for Y22%20MSN: 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: YD18%20PGR
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD18%2520PGR%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for YD18%20PGR: 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: SK66%20WEW
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK66%2520WEW%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for SK66%20WEW: 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: SW14%20ODA
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW14%2520ODA%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for SW14%20ODA: 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: SX64%20FDA
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SX64%2520FDA%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for SX64%20FDA: 0
2026-03-29 22:04:57 [bca.uk] INFO: Found listing with ID: SB14%20EVY
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB14%2520EVY%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [bca.uk] INFO: Scrape type for SB14%20EVY: 2
2026-03-29 22:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b88684-55da-5ffb-8827-a9bafa70ed54 with identifier: SB14%20EVY
2026-03-29 22:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b88684-55da-5ffb-8827-a9bafa70ed54 with scrape type 2
2026-03-29 22:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10b88684-55da-5ffb-8827-a9bafa70ed54 with scrape type 2
2026-03-29 22:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 10b88684-55da-5ffb-8827-a9bafa70ed54, identifier: SB14%20EVY
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142800%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142800 not downloaded yet
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395715%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395715 not downloaded yet
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046540%27 HTTP/1.1" 200 None
2026-03-29 22:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046540 not downloaded yet
2026-03-29 22:04:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142745/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142745>
2026-03-29 22:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 10b88684-55da-5ffb-8827-a9bafa70ed54 with identifier: SB14%20EVY
2026-03-29 22:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 10b88684-55da-5ffb-8827-a9bafa70ed54 with identifier: SB14%20EVY
2026-03-29 22:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 10b88684-55da-5ffb-8827-a9bafa70ed54 with identifier: SB14%20EVY to the API
2026-03-29 22:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 90,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB14%20EVY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '10b88684-55da-5ffb-8827-a9bafa70ed54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB14 EVY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB14%20EVY&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 67582,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'RENAULT MEGANE 1.5 DCI 110 DYNAMIQUE TOM TOM Coupe',
'transmission': 'manual',
'trim': 'DCI 110 DYNAMIQUE TOM TOM',
'vin': 'VF1DZ140650905827',
'year': 2014}
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB14%2520EVY%27 HTTP/1.1" 200 None
2026-03-29 22:04:58 [bca.uk] INFO: Saving data for SB14%20EVY: {'auction_closing_time': 1774864800.0, 'created_time': 1774303480.598566, 'last_price_update_time': 1774821898.203571}
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB14%2520EVY') HTTP/1.1" 204 0
2026-03-29 22:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61500950>
2026-03-29 22:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_expert_report_file_9c4fb082-2b73-4884-b0de-ec26789bd21c.pdf HTTP/1.1" 201 0
2026-03-29 22:04:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8b0931c6-e1ee-59a1-940a-2866b34dd8e0
2026-03-29 22:04:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b0931c6-e1ee-59a1-940a-2866b34dd8e0, skipping ID generation
2026-03-29 22:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 8b0931c6-e1ee-59a1-940a-2866b34dd8e0
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLM54XHA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM54XHA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411499/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411499>
2026-03-29 22:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430132/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430132>
2026-03-29 22:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142759/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142759>
2026-03-29 22:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430191/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430191>
2026-03-29 22:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575336/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575336>
2026-03-29 22:04:58 [bca.uk] INFO: Found listing with ID: SC64%20XUW
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC64%2520XUW%27 HTTP/1.1" 200 None
2026-03-29 22:04:58 [bca.uk] INFO: Scrape type for SC64%20XUW: 0
2026-03-29 22:04:58 [bca.uk] INFO: Found listing with ID: GK64%20CWW
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK64%2520CWW%27 HTTP/1.1" 200 None
2026-03-29 22:04:58 [bca.uk] INFO: Scrape type for GK64%20CWW: 0
2026-03-29 22:04:58 [bca.uk] INFO: Found listing with ID: DK07%20EDF
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK07%2520EDF%27 HTTP/1.1" 200 None
2026-03-29 22:04:58 [bca.uk] INFO: Scrape type for DK07%20EDF: 0
2026-03-29 22:04:58 [bca.uk] INFO: Found listing with ID: FR61%20OFO
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR61%2520OFO%27 HTTP/1.1" 200 None
2026-03-29 22:04:58 [bca.uk] INFO: Scrape type for FR61%20OFO: 0
2026-03-29 22:04:58 [bca.uk] INFO: Found listing with ID: SX10%20KDU
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SX10%2520KDU%27 HTTP/1.1" 200 None
2026-03-29 22:04:58 [bca.uk] INFO: Scrape type for SX10%20KDU: 0
2026-03-29 22:04:58 [bca.uk] INFO: Found listing with ID: RA68%20WZE
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA68%2520WZE%27 HTTP/1.1" 200 None
2026-03-29 22:04:58 [bca.uk] INFO: Scrape type for RA68%20WZE: 0
2026-03-29 22:04:58 [bca.uk] INFO: Found listing with ID: WJ68%20ONK
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ68%2520ONK%27 HTTP/1.1" 200 None
2026-03-29 22:04:58 [bca.uk] INFO: Scrape type for WJ68%20ONK: 2
2026-03-29 22:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0 with identifier: WJ68%20ONK
2026-03-29 22:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0 with scrape type 2
2026-03-29 22:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0 with scrape type 2
2026-03-29 22:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0, identifier: WJ68%20ONK
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142809%27 HTTP/1.1" 200 None
2026-03-29 22:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142809 not downloaded yet
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395717%27 HTTP/1.1" 200 None
2026-03-29 22:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395717 not downloaded yet
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046544%27 HTTP/1.1" 200 None
2026-03-29 22:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046544 not downloaded yet
2026-03-29 22:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0 with identifier: WJ68%20ONK
2026-03-29 22:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0 with identifier: WJ68%20ONK
2026-03-29 22:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 549aa2dc-22fb-53ad-ac56-4323c4ee2fe0 with identifier: WJ68%20ONK to the API
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 170,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ68%20ONK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '549aa2dc-22fb-53ad-ac56-4323c4ee2fe0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ68 ONK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ68%20ONK&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 73783,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 SE TECH StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 SE TECH',
'vin': 'SALCA2AN7KH779880',
'year': 2018}
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ68%2520ONK%27 HTTP/1.1" 200 None
2026-03-29 22:04:59 [bca.uk] INFO: Saving data for WJ68%20ONK: {'auction_closing_time': 1774864800.0, 'created_time': 1774735466.092798, 'last_price_update_time': 1774821899.020121}
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ68%2520ONK') HTTP/1.1" 204 0
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046536%27 HTTP/1.1" 200 None
2026-03-29 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046536 not downloaded yet
2026-03-29 22:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142699/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL07HRM/42787034?sv=2020-08-04&st=2026-03-29T22%3A04%3A47Z&se=2026-03-29T22%3A29%3A47Z&sr=b&sp=r&sig=exdoUniRSbIwQ12LkQI9utrlzs26smvmyOvTrgGhZiY%3D)
2026-03-29 22:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046533/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT57DYH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:04:59 [bca.uk] INFO: Found listing with ID: CA18%20OAB
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA18%2520OAB%27 HTTP/1.1" 200 None
2026-03-29 22:04:59 [bca.uk] INFO: Scrape type for CA18%20OAB: 2
2026-03-29 22:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e227b44-6aca-5ca0-8cdd-cf823254938b with identifier: CA18%20OAB
2026-03-29 22:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e227b44-6aca-5ca0-8cdd-cf823254938b with scrape type 2
2026-03-29 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e227b44-6aca-5ca0-8cdd-cf823254938b with scrape type 2
2026-03-29 22:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6e227b44-6aca-5ca0-8cdd-cf823254938b, identifier: CA18%20OAB
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395718%27 HTTP/1.1" 200 None
2026-03-29 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395718 not downloaded yet
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046547%27 HTTP/1.1" 200 None
2026-03-29 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046547 not downloaded yet
2026-03-29 22:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a93b10>
2026-03-29 22:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLA70NPE%252F699406214%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406214/600 saved to cache
2026-03-29 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4838ed0-a1bc-555f-ae17-73d79e29d1ac
2026-03-29 22:04:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4838ed0-a1bc-555f-ae17-73d79e29d1ac, skipping ID generation
2026-03-29 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4838ed0-a1bc-555f-ae17-73d79e29d1ac sending to next pipeline
2026-03-29 22:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b4838ed0-a1bc-555f-ae17-73d79e29d1ac, identifier: LA70%20NPE
2026-03-29 22:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c78ed0>
2026-03-29 22:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH70YYW%252F699040090%252F600') HTTP/1.1" 204 0
2026-03-29 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040090/600 saved to cache
2026-03-29 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01b57636-ffd9-585f-9b00-e6ae7dbcc329
2026-03-29 22:04:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01b57636-ffd9-585f-9b00-e6ae7dbcc329, skipping ID generation
2026-03-29 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01b57636-ffd9-585f-9b00-e6ae7dbcc329 sending to next pipeline
2026-03-29 22:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 01b57636-ffd9-585f-9b00-e6ae7dbcc329, identifier: YH70%20YYW
2026-03-29 22:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SW14DSO/42797814?sv=2020-08-04&st=2026-03-29T22%3A04%3A52Z&se=2026-03-29T22%3A29%3A52Z&sr=b&sp=r&sig=HWRGmMiZHUzQfBmk5OQ1D7P%2FeZsK7wYaXZ1soCo9ztg%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435116/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS68PYY/42812178?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=ilxdzGsr4IgRZDvqZmWhurm4pGkLnzxS3s4veY%2BdCjs%3D)
2026-03-29 22:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409168/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE18CHX/42812000?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=oyBRp8qHoowbCW9kieY0zUV46IZNjY3FwR8NKuxfaxo%3D)
2026-03-29 22:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395712/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NC08ONX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6e227b44-6aca-5ca0-8cdd-cf823254938b with identifier: CA18%20OAB
2026-03-29 22:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6e227b44-6aca-5ca0-8cdd-cf823254938b with identifier: CA18%20OAB
2026-03-29 22:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6e227b44-6aca-5ca0-8cdd-cf823254938b with identifier: CA18%20OAB to the API
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CA18%20OAB-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.7L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6e227b44-6aca-5ca0-8cdd-cf823254938b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CA18 OAB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CA18%20OAB&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 44398,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'HYUNDAI TUCSON 1.7 CRDI B/D 2WD GO SE DCT StationWagon',
'transmission': 'automatic',
'trim': 'CRDI B/D 2WD GO SE DCT',
'vin': 'TMAJ3815VJJ631305',
'year': 2018}
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA18%2520OAB%27 HTTP/1.1" 200 None
2026-03-29 22:04:59 [bca.uk] INFO: Saving data for CA18%20OAB: {'auction_closing_time': 1774951200.0, 'created_time': 1774046306.037443, 'last_price_update_time': 1774821899.773875}
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CA18%2520OAB') HTTP/1.1" 204 0
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046539%27 HTTP/1.1" 200 None
2026-03-29 22:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046539 not downloaded yet
2026-03-29 22:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b4838ed0-a1bc-555f-ae17-73d79e29d1ac with identifier: LA70%20NPE
2026-03-29 22:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b4838ed0-a1bc-555f-ae17-73d79e29d1ac with identifier: LA70%20NPE
2026-03-29 22:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b4838ed0-a1bc-555f-ae17-73d79e29d1ac with identifier: LA70%20NPE to the API
2026-03-29 22:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406214/600>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_expert_report_file_c240516f-c174-45de-99fc-6961dbacba76.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LA70%20NPE-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b4838ed0-a1bc-555f-ae17-73d79e29d1ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LA70 NPE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LA70%20NPE&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'KIA',
'model': 'PICANTO X-LINE',
'odometer': 18029,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38313,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406214/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37929,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406242/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37563,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406258/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38395,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406274/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37357,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406287/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36661,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406305/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79784,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406328/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406349/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78072,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406374/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4838ed0-a1bc-555f-ae17-73d79e29d1ac/b4838ed0-a1bc-555f-ae17-73d79e29d1ac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82557,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA70NPE/699406390/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'KIA PICANTO X-LINE 1.0 Hatchback',
'transmission': 'automatic',
'trim': '',
'vin': 'KNAB3518YMT762888',
'year': 2021}
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA70%2520NPE%27 HTTP/1.1" 200 None
2026-03-29 22:05:00 [bca.uk] INFO: Saving data for LA70%20NPE: {'created_time': 1774821900.192135, 'last_price_update_time': 1774821900.192147, 'auction_closing_time': 1774951200.0}
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LA70%2520NPE') HTTP/1.1" 204 0
2026-03-29 22:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 01b57636-ffd9-585f-9b00-e6ae7dbcc329 with identifier: YH70%20YYW
2026-03-29 22:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 01b57636-ffd9-585f-9b00-e6ae7dbcc329 with identifier: YH70%20YYW
2026-03-29 22:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 01b57636-ffd9-585f-9b00-e6ae7dbcc329 with identifier: YH70%20YYW to the API
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040090/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_expert_report_file_48cd3153-9e98-44f1-9703-1b33e7220ebd.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH70%20YYW-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Electric',
'id': '01b57636-ffd9-585f-9b00-e6ae7dbcc329',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH70 YYW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH70%20YYW&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'TESLA',
'model': 'MODEL X',
'odometer': 90486,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41953,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040090/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38875,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040098/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39533,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040111/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40269,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040129/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34133,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040160/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33741,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040182/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94157,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040206/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73806,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040234/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83878,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040265/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01b57636-ffd9-585f-9b00-e6ae7dbcc329/01b57636-ffd9-585f-9b00-e6ae7dbcc329_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52267,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH70YYW/699040295/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'TESLA MODEL X 100KWH D/M PERF.LUDICROUS StationWagon',
'transmission': 'automatic',
'trim': '100KWH D/M PERF.LUDICROUS',
'vin': '5YJXDCE43LF292281',
'year': 2020}
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH70%2520YYW%27 HTTP/1.1" 200 None
2026-03-29 22:05:00 [bca.uk] INFO: Saving data for YH70%20YYW: {'created_time': 1774821900.561749, 'last_price_update_time': 1774821900.561763, 'auction_closing_time': 1775037600.0}
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH70%2520YYW') HTTP/1.1" 204 0
2026-03-29 22:05:00 [bca.uk] INFO: Found listing with ID: LL18%20NDU
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL18%2520NDU%27 HTTP/1.1" 200 None
2026-03-29 22:05:00 [bca.uk] INFO: Scrape type for LL18%20NDU: 0
2026-03-29 22:05:00 [bca.uk] INFO: Found listing with ID: AK68%20GNZ
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK68%2520GNZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:00 [bca.uk] INFO: Scrape type for AK68%20GNZ: 2
2026-03-29 22:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b697d92-c0aa-5541-98d2-fd8a94f25ae8 with identifier: AK68%20GNZ
2026-03-29 22:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b697d92-c0aa-5541-98d2-fd8a94f25ae8 with scrape type 2
2026-03-29 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b697d92-c0aa-5541-98d2-fd8a94f25ae8 with scrape type 2
2026-03-29 22:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3b697d92-c0aa-5541-98d2-fd8a94f25ae8, identifier: AK68%20GNZ
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395720%27 HTTP/1.1" 200 None
2026-03-29 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395720 not downloaded yet
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046554%27 HTTP/1.1" 200 None
2026-03-29 22:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046554 not downloaded yet
2026-03-29 22:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142716/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL07HRM/42787034?sv=2020-08-04&st=2026-03-29T22%3A04%3A47Z&se=2026-03-29T22%3A29%3A47Z&sr=b&sp=r&sig=exdoUniRSbIwQ12LkQI9utrlzs26smvmyOvTrgGhZiY%3D)
2026-03-29 22:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142726/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL07HRM/42787034?sv=2020-08-04&st=2026-03-29T22%3A04%3A47Z&se=2026-03-29T22%3A29%3A47Z&sr=b&sp=r&sig=exdoUniRSbIwQ12LkQI9utrlzs26smvmyOvTrgGhZiY%3D)
2026-03-29 22:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142773/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142773>
2026-03-29 22:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3b697d92-c0aa-5541-98d2-fd8a94f25ae8 with identifier: AK68%20GNZ
2026-03-29 22:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3b697d92-c0aa-5541-98d2-fd8a94f25ae8 with identifier: AK68%20GNZ
2026-03-29 22:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3b697d92-c0aa-5541-98d2-fd8a94f25ae8 with identifier: AK68%20GNZ to the API
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 122,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK68%20GNZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3b697d92-c0aa-5541-98d2-fd8a94f25ae8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AK68 GNZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AK68%20GNZ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLKSWAGEN',
'model': 'PASSAT',
'odometer': 47895,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN PASSAT 1.5 TSI EVO 150 GT DSG Saloon',
'transmission': 'automatic',
'trim': 'TSI EVO 150 GT DSG',
'vin': 'WVWZZZ3CZKE023984',
'year': 2018}
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK68%2520GNZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:01 [bca.uk] INFO: Saving data for AK68%20GNZ: {'auction_closing_time': 1774951200.0, 'created_time': 1774275530.558751, 'last_price_update_time': 1774821901.129562}
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AK68%2520GNZ') HTTP/1.1" 204 0
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046542%27 HTTP/1.1" 200 None
2026-03-29 22:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046542 not downloaded yet
2026-03-29 22:05:01 [bca.uk] INFO: Found listing with ID: ML68%20NHB
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML68%2520NHB%27 HTTP/1.1" 200 None
2026-03-29 22:05:01 [bca.uk] INFO: Scrape type for ML68%20NHB: 0
2026-03-29 22:05:01 [bca.uk] INFO: Found listing with ID: YD15%20TJX
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD15%2520TJX%27 HTTP/1.1" 200 None
2026-03-29 22:05:01 [bca.uk] INFO: Scrape type for YD15%20TJX: 2
2026-03-29 22:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c9cf61a-b9c7-573a-afe9-fa532531de16 with identifier: YD15%20TJX
2026-03-29 22:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c9cf61a-b9c7-573a-afe9-fa532531de16 with scrape type 2
2026-03-29 22:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c9cf61a-b9c7-573a-afe9-fa532531de16 with scrape type 2
2026-03-29 22:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0c9cf61a-b9c7-573a-afe9-fa532531de16, identifier: YD15%20TJX
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395730%27 HTTP/1.1" 200 None
2026-03-29 22:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395730 not downloaded yet
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046557%27 HTTP/1.1" 200 None
2026-03-29 22:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046557 not downloaded yet
2026-03-29 22:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142745/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL07HRM/42787034?sv=2020-08-04&st=2026-03-29T22%3A04%3A47Z&se=2026-03-29T22%3A29%3A47Z&sr=b&sp=r&sig=exdoUniRSbIwQ12LkQI9utrlzs26smvmyOvTrgGhZiY%3D)
2026-03-29 22:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575336/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/P17LPT/42573216?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Cei94j6xTuVsYVAtMEIEaOIhWn8jpASCTY7XqjpVl64%3D)
2026-03-29 22:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430191/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19VSX/42812111?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=qlSeQUbf83xHqWfD9mYZ2SCAALVwdddlxYHgmUNU2tY%3D)
2026-03-29 22:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430132/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA16ETX/42812131?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=67cSoD7yDAcPlVUXb6MtFxB8b%2F%2B%2FHPzK%2FRcqJHz%2FIwo%3D)
2026-03-29 22:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0c9cf61a-b9c7-573a-afe9-fa532531de16 with identifier: YD15%20TJX
2026-03-29 22:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0c9cf61a-b9c7-573a-afe9-fa532531de16 with identifier: YD15%20TJX
2026-03-29 22:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0c9cf61a-b9c7-573a-afe9-fa532531de16 with identifier: YD15%20TJX to the API
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD15%20TJX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0c9cf61a-b9c7-573a-afe9-fa532531de16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD15 TJX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD15%20TJX&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 40827,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.2 DIG-T 113 ACENTA Hatchback',
'transmission': 'manual',
'trim': 'DIG-T 113 ACENTA',
'vin': 'SJNFEAF15U7093669',
'year': 2015}
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD15%2520TJX%27 HTTP/1.1" 200 None
2026-03-29 22:05:01 [bca.uk] INFO: Saving data for YD15%20TJX: {'auction_closing_time': 1774951200.0, 'created_time': 1774275539.187337, 'last_price_update_time': 1774821901.759867}
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD15%2520TJX') HTTP/1.1" 204 0
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046545%27 HTTP/1.1" 200 None
2026-03-29 22:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046545 not downloaded yet
2026-03-29 22:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621301d0>
2026-03-29 22:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL07HRM%252F699142699%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142699/600 saved to cache
2026-03-29 22:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f87fc02-985b-5b39-b30d-ff94e761a881
2026-03-29 22:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6352efd0>
2026-03-29 22:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_expert_report_file_9a5fac33-2361-4344-9a08-10c4dc1ecfc7.pdf HTTP/1.1" 201 0
2026-03-29 22:05:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ca52f08c-d65c-5ece-bef3-1f4a7047ab80
2026-03-29 22:05:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca52f08c-d65c-5ece-bef3-1f4a7047ab80, skipping ID generation
2026-03-29 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca52f08c-d65c-5ece-bef3-1f4a7047ab80
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSW14DSO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SW14DSO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637f8d50>
2026-03-29 22:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS68PYY%252F699435116%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435116/600 saved to cache
2026-03-29 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73
2026-03-29 22:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618ae650>
2026-03-29 22:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE18CHX%252F699409168%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409168/600 saved to cache
2026-03-29 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad
2026-03-29 22:05:02 [bca.uk] INFO: Total items found: 100
2026-03-29 22:05:02 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded
2026-03-29 22:05:02 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:05:02 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411499/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE19AAK/42812078?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=MkdK1ykhsLQ%2B%2F2n1Irxn7evFumHYKKFZXmkQdpd8KgM%3D)
2026-03-29 22:05:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046544/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046544>
2026-03-29 22:05:02 [bca.uk] INFO: Found listing with ID: BJ65%20SPV
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ65%2520SPV%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [bca.uk] INFO: Scrape type for BJ65%20SPV: 0
2026-03-29 22:05:02 [bca.uk] INFO: Found listing with ID: CV64%20LKL
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV64%2520LKL%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [bca.uk] INFO: Scrape type for CV64%20LKL: 0
2026-03-29 22:05:02 [bca.uk] INFO: Found listing with ID: MD15%20DZY
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD15%2520DZY%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [bca.uk] INFO: Scrape type for MD15%20DZY: 0
2026-03-29 22:05:02 [bca.uk] INFO: Found listing with ID: PG17%20JHL
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PG17%2520JHL%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [bca.uk] INFO: Scrape type for PG17%20JHL: 2
2026-03-29 22:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 453df6c1-3540-52b6-bf7c-5476e5031684 with identifier: PG17%20JHL
2026-03-29 22:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 453df6c1-3540-52b6-bf7c-5476e5031684 with scrape type 2
2026-03-29 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 453df6c1-3540-52b6-bf7c-5476e5031684 with scrape type 2
2026-03-29 22:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 453df6c1-3540-52b6-bf7c-5476e5031684, identifier: PG17%20JHL
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395742%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395742 not downloaded yet
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046565%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046565 not downloaded yet
2026-03-29 22:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142759/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL07HRM/42787034?sv=2020-08-04&st=2026-03-29T22%3A04%3A47Z&se=2026-03-29T22%3A29%3A47Z&sr=b&sp=r&sig=exdoUniRSbIwQ12LkQI9utrlzs26smvmyOvTrgGhZiY%3D)
2026-03-29 22:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 453df6c1-3540-52b6-bf7c-5476e5031684 with identifier: PG17%20JHL
2026-03-29 22:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 453df6c1-3540-52b6-bf7c-5476e5031684 with identifier: PG17%20JHL
2026-03-29 22:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 453df6c1-3540-52b6-bf7c-5476e5031684 with identifier: PG17%20JHL to the API
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 203,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PG17%20JHL-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '453df6c1-3540-52b6-bf7c-5476e5031684',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PG17 JHL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PG17%20JHL&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'JAGUAR',
'model': 'F-TYPE',
'odometer': 30211,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'JAGUAR F-TYPE 3.0 V6 S/C 400 SPORT Roadster',
'transmission': 'automatic',
'trim': 'V6 S/C 400 SPORT',
'vin': 'SAJDB5AVXJCK47322',
'year': 2017}
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PG17%2520JHL%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [bca.uk] INFO: Saving data for PG17%20JHL: {'auction_closing_time': 1774951200.0, 'created_time': 1774610531.824387, 'last_price_update_time': 1774821902.74682}
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PG17%2520JHL') HTTP/1.1" 204 0
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046563%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046563 not downloaded yet
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699198352%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198352 not downloaded yet
2026-03-29 22:05:02 [bca.uk] INFO: Found listing with ID: FN66%20XKP
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN66%2520XKP%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [bca.uk] INFO: Scrape type for FN66%20XKP: 0
2026-03-29 22:05:02 [bca.uk] INFO: Found listing with ID: GK64%20GZJ
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK64%2520GZJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [bca.uk] INFO: Scrape type for GK64%20GZJ: 0
2026-03-29 22:05:02 [bca.uk] INFO: Found listing with ID: JL07%20FAY
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JL07%2520FAY%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [bca.uk] INFO: Scrape type for JL07%20FAY: 0
2026-03-29 22:05:02 [bca.uk] INFO: Found listing with ID: LF64%20MJE
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF64%2520MJE%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [bca.uk] INFO: Scrape type for LF64%20MJE: 0
2026-03-29 22:05:02 [bca.uk] INFO: Found listing with ID: LV14%20OLB
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV14%2520OLB%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [bca.uk] INFO: Scrape type for LV14%20OLB: 0
2026-03-29 22:05:02 [bca.uk] INFO: Found listing with ID: SY64%20TWV
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY64%2520TWV%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [bca.uk] INFO: Scrape type for SY64%20TWV: 0
2026-03-29 22:05:02 [bca.uk] INFO: Found listing with ID: VO15%20ZYX
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO15%2520ZYX%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [bca.uk] INFO: Scrape type for VO15%20ZYX: 0
2026-03-29 22:05:02 [bca.uk] INFO: Found listing with ID: YG64%20FFB
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG64%2520FFB%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [bca.uk] INFO: Scrape type for YG64%20FFB: 0
2026-03-29 22:05:02 [bca.uk] INFO: Found listing with ID: BN16%20NVM
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN16%2520NVM%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [bca.uk] INFO: Scrape type for BN16%20NVM: 0
2026-03-29 22:05:02 [bca.uk] INFO: Found listing with ID: AU16%20ZSX
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU16%2520ZSX%27 HTTP/1.1" 200 None
2026-03-29 22:05:02 [bca.uk] INFO: Scrape type for AU16%20ZSX: 2
2026-03-29 22:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bccc674-fc66-57e1-8f1b-262bda9e1c92 with identifier: AU16%20ZSX
2026-03-29 22:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bccc674-fc66-57e1-8f1b-262bda9e1c92 with scrape type 2
2026-03-29 22:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bccc674-fc66-57e1-8f1b-262bda9e1c92 with scrape type 2
2026-03-29 22:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6bccc674-fc66-57e1-8f1b-262bda9e1c92, identifier: AU16%20ZSX
2026-03-29 22:05:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395718/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395718>
2026-03-29 22:05:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046547/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046547>
2026-03-29 22:05:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046536/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046536>
2026-03-29 22:05:03 [bca.uk] INFO: Found listing with ID: WR62%20TWZ
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR62%2520TWZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:03 [bca.uk] INFO: Scrape type for WR62%20TWZ: 0
2026-03-29 22:05:03 [bca.uk] INFO: Found listing with ID: DG15%20FDY
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG15%2520FDY%27 HTTP/1.1" 200 None
2026-03-29 22:05:03 [bca.uk] INFO: Scrape type for DG15%20FDY: 0
2026-03-29 22:05:03 [bca.uk] INFO: Found listing with ID: GL16%20OVF
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL16%2520OVF%27 HTTP/1.1" 200 None
2026-03-29 22:05:03 [bca.uk] INFO: Scrape type for GL16%20OVF: 0
2026-03-29 22:05:03 [bca.uk] INFO: Found listing with ID: LC19%20OZU
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC19%2520OZU%27 HTTP/1.1" 200 None
2026-03-29 22:05:03 [bca.uk] INFO: Scrape type for LC19%20OZU: 0
2026-03-29 22:05:03 [bca.uk] INFO: Found listing with ID: SA13%20RLX
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA13%2520RLX%27 HTTP/1.1" 200 None
2026-03-29 22:05:03 [bca.uk] INFO: Scrape type for SA13%20RLX: 0
2026-03-29 22:05:03 [bca.uk] INFO: Found listing with ID: CA65%20XLF
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA65%2520XLF%27 HTTP/1.1" 200 None
2026-03-29 22:05:03 [bca.uk] INFO: Scrape type for CA65%20XLF: 0
2026-03-29 22:05:03 [bca.uk] INFO: Found listing with ID: FG64%20CDE
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG64%2520CDE%27 HTTP/1.1" 200 None
2026-03-29 22:05:03 [bca.uk] INFO: Scrape type for FG64%20CDE: 2
2026-03-29 22:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32b32c61-3fb3-575f-b3cf-5d14cab25e17 with identifier: FG64%20CDE
2026-03-29 22:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32b32c61-3fb3-575f-b3cf-5d14cab25e17 with scrape type 2
2026-03-29 22:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32b32c61-3fb3-575f-b3cf-5d14cab25e17 with scrape type 2
2026-03-29 22:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 32b32c61-3fb3-575f-b3cf-5d14cab25e17, identifier: FG64%20CDE
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395773%27 HTTP/1.1" 200 None
2026-03-29 22:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395773 not downloaded yet
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046568%27 HTTP/1.1" 200 None
2026-03-29 22:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046568 not downloaded yet
2026-03-29 22:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6bccc674-fc66-57e1-8f1b-262bda9e1c92 with identifier: AU16%20ZSX
2026-03-29 22:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6bccc674-fc66-57e1-8f1b-262bda9e1c92 with identifier: AU16%20ZSX
2026-03-29 22:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6bccc674-fc66-57e1-8f1b-262bda9e1c92 with identifier: AU16%20ZSX to the API
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AU16%20ZSX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6bccc674-fc66-57e1-8f1b-262bda9e1c92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AU16 ZSX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AU16%20ZSX&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'KIA',
'model': 'SORENTO',
'odometer': 125155,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'KIA SORENTO 2.2 CRDI KX-4 StationWagon',
'transmission': 'automatic',
'trim': 'CRDI KX-4',
'vin': 'KNAPH81BSG5180630',
'year': 2016}
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU16%2520ZSX%27 HTTP/1.1" 200 None
2026-03-29 22:05:03 [bca.uk] INFO: Saving data for AU16%20ZSX: {'auction_closing_time': 1774864800.0, 'created_time': 1774391131.436632, 'last_price_update_time': 1774821903.753326}
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AU16%2520ZSX') HTTP/1.1" 204 0
2026-03-29 22:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61689050>
2026-03-29 22:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL07HRM%252F699142716%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142716/600 saved to cache
2026-03-29 22:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f87fc02-985b-5b39-b30d-ff94e761a881
2026-03-29 22:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619ccc10>
2026-03-29 22:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL07HRM%252F699142726%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142726/600 saved to cache
2026-03-29 22:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f87fc02-985b-5b39-b30d-ff94e761a881
2026-03-29 22:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614e0210>
2026-03-29 22:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL07HRM%252F699142745%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142745/600 saved to cache
2026-03-29 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f87fc02-985b-5b39-b30d-ff94e761a881
2026-03-29 22:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61520610>
2026-03-29 22:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FP17LPT%252F686575336%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575336/600 saved to cache
2026-03-29 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9
2026-03-29 22:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610adad0>
2026-03-29 22:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19VSX%252F699430191%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430191/600 saved to cache
2026-03-29 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 732664ff-2041-53f2-83f7-e4a6aeaa1df2
2026-03-29 22:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619c2b50>
2026-03-29 22:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA16ETX%252F699430132%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430132/600 saved to cache
2026-03-29 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6398c60-fe63-5a45-a148-79cf4bf62bcf
2026-03-29 22:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046533/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT57DYH/42811171?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=ba3XEcywWuim4PxaK5nJb76sAThRmrq4Rgv5ofIXEw0%3D)
2026-03-29 22:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395717/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395717>
2026-03-29 22:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 32b32c61-3fb3-575f-b3cf-5d14cab25e17 with identifier: FG64%20CDE
2026-03-29 22:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 32b32c61-3fb3-575f-b3cf-5d14cab25e17 with identifier: FG64%20CDE
2026-03-29 22:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 32b32c61-3fb3-575f-b3cf-5d14cab25e17 with identifier: FG64%20CDE to the API
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG64%20CDE-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '32b32c61-3fb3-575f-b3cf-5d14cab25e17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG64 CDE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FG64%20CDE&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'PEUGEOT',
'model': '108',
'odometer': 64489,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PEUGEOT 108 1.2 VTI ALLURE Hatchback',
'transmission': 'manual',
'trim': 'VTI ALLURE',
'vin': 'VF3PAHMTBER257895',
'year': 2014}
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG64%2520CDE%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Saving data for FG64%20CDE: {'auction_closing_time': 1774864800.0, 'created_time': 1774391142.222122, 'last_price_update_time': 1774821904.575322}
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FG64%2520CDE') HTTP/1.1" 204 0
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046567%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046567 not downloaded yet
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699198358%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198358 not downloaded yet
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: CK65%20JGO
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK65%2520JGO%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for CK65%20JGO: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: KY10%20YTW
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY10%2520YTW%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for KY10%20YTW: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: SD13%20AEN
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD13%2520AEN%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for SD13%20AEN: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: WL12%20HKH
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WL12%2520HKH%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for WL12%20HKH: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: WX07%20ZGA
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX07%2520ZGA%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for WX07%20ZGA: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: CT60%20YWN
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT60%2520YWN%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for CT60%20YWN: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: DL13%20TZH
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL13%2520TZH%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for DL13%20TZH: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: HF56%20HGK
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF56%2520HGK%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for HF56%20HGK: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: VU61%20UEK
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU61%2520UEK%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for VU61%20UEK: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: WM11%20LMJ
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM11%2520LMJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for WM11%20LMJ: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: WN10%20HFA
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN10%2520HFA%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for WN10%20HFA: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: WN15%20KDV
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN15%2520KDV%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for WN15%20KDV: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: WV62%20XNB
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV62%2520XNB%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for WV62%20XNB: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: YC14%20DPV
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC14%2520DPV%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for YC14%20DPV: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: YF11%20UMU
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF11%2520UMU%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for YF11%20UMU: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: YF13%20GUD
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF13%2520GUD%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for YF13%20GUD: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: YH59%20NHG
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH59%2520NHG%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for YH59%20NHG: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: P19%20KMM
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P19%2520KMM%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for P19%20KMM: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: PE11%20ZTV
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE11%2520ZTV%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for PE11%20ZTV: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: PN12%20JDK
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN12%2520JDK%27 HTTP/1.1" 200 None
2026-03-29 22:05:04 [bca.uk] INFO: Scrape type for PN12%20JDK: 0
2026-03-29 22:05:04 [bca.uk] INFO: Found listing with ID: SB61%20BDF
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB61%2520BDF%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for SB61%20BDF: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: SC63%20JNN
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC63%2520JNN%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for SC63%20JNN: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: VU68%20WEW
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU68%2520WEW%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for VU68%20WEW: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: WJ59%20ZFL
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ59%2520ZFL%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for WJ59%20ZFL: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: GA58%20DAA
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GA58%2520DAA%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for GA58%20DAA: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: GD02%20MGV
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD02%2520MGV%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for GD02%20MGV: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: KR63%20AAV
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR63%2520AAV%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for KR63%20AAV: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: KW10%20TZV
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW10%2520TZV%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for KW10%20TZV: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: LS62%20OSD
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS62%2520OSD%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for LS62%20OSD: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: ND11%20RSO
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND11%2520RSO%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for ND11%20RSO: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: NJ60%20UON
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ60%2520UON%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for NJ60%20UON: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: NU62%20CBO
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU62%2520CBO%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for NU62%20CBO: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: NV13%20SUX
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV13%2520SUX%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for NV13%20SUX: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: OY17%20HPV
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520HPV%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for OY17%20HPV: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: OY59%20KHT
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY59%2520KHT%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for OY59%20KHT: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: BJ12%20FBV
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ12%2520FBV%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for BJ12%20FBV: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: BK65%20VPY
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK65%2520VPY%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for BK65%20VPY: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: CN14%20MDO
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN14%2520MDO%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for CN14%20MDO: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: CU15%20NXK
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU15%2520NXK%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for CU15%20NXK: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: E4%20GOA
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27E4%2520GOA%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for E4%20GOA: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: EF12%20MJX
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF12%2520MJX%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for EF12%20MJX: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: EJ60%20YKZ
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ60%2520YKZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for EJ60%20YKZ: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: EX64%20WZC
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX64%2520WZC%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for EX64%20WZC: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: FE60%20MFV
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE60%2520MFV%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for FE60%20MFV: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: FV61%20WSU
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV61%2520WSU%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for FV61%20WSU: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: AP65%20MYK
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP65%2520MYK%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for AP65%20MYK: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: KW18%20YBL
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW18%2520YBL%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for KW18%20YBL: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: FN61%20BWH
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN61%2520BWH%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for FN61%20BWH: 0
2026-03-29 22:05:05 [bca.uk] INFO: Found listing with ID: BJ07%20HHO
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ07%2520HHO%27 HTTP/1.1" 200 None
2026-03-29 22:05:05 [bca.uk] INFO: Scrape type for BJ07%20HHO: 2
2026-03-29 22:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9401660-cb22-5b18-aca2-caf29023fb68 with identifier: BJ07%20HHO
2026-03-29 22:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9401660-cb22-5b18-aca2-caf29023fb68 with scrape type 2
2026-03-29 22:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9401660-cb22-5b18-aca2-caf29023fb68 with scrape type 2
2026-03-29 22:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e9401660-cb22-5b18-aca2-caf29023fb68, identifier: BJ07%20HHO
2026-03-29 22:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e9401660-cb22-5b18-aca2-caf29023fb68 with identifier: BJ07%20HHO
2026-03-29 22:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e9401660-cb22-5b18-aca2-caf29023fb68 with identifier: BJ07%20HHO
2026-03-29 22:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e9401660-cb22-5b18-aca2-caf29023fb68 with identifier: BJ07%20HHO to the API
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ07%20HHO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e9401660-cb22-5b18-aca2-caf29023fb68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ07 HHO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ07%20HHO&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 67799,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.8 I-VTEC EX I-SHIFT Hatchback',
'transmission': 'automatic',
'trim': 'I-VTEC EX I-SHIFT',
'vin': 'SHHFK28607U032262',
'year': 2007}
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ07%2520HHO%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Saving data for BJ07%20HHO: {'auction_closing_time': 1774864800.0, 'created_time': 1774620519.484117, 'last_price_update_time': 1774821906.102967}
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ07%2520HHO') HTTP/1.1" 204 0
2026-03-29 22:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395712/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NC08ONX/42812093?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=Zw2w%2BWGBqBzN6FuSvk9oA0R0jIOoFWoee6Cilu52DU4%3D)
2026-03-29 22:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142773/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL07HRM/42787034?sv=2020-08-04&st=2026-03-29T22%3A04%3A47Z&se=2026-03-29T22%3A29%3A47Z&sr=b&sp=r&sig=exdoUniRSbIwQ12LkQI9utrlzs26smvmyOvTrgGhZiY%3D)
2026-03-29 22:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046554/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046554>
2026-03-29 22:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142809/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142809>
2026-03-29 22:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046542/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046542>
2026-03-29 22:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046539/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046539>
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046571%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046571 not downloaded yet
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699198366%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198366 not downloaded yet
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: SH13%20PNF
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH13%2520PNF%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for SH13%20PNF: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: WF63%20UPT
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF63%2520UPT%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for WF63%20UPT: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: WJ62%20BLV
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ62%2520BLV%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for WJ62%20BLV: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: WJ63%20NXK
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ63%2520NXK%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for WJ63%20NXK: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: WK54%20WFB
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK54%2520WFB%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for WK54%20WFB: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: WK58%20SYT
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK58%2520SYT%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for WK58%20SYT: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: WV09%20BNK
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV09%2520BNK%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for WV09%20BNK: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: YE09%20XVV
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE09%2520XVV%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for YE09%20XVV: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: FH12%20SXS
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH12%2520SXS%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for FH12%20SXS: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: HG13%20LZF
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG13%2520LZF%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for HG13%20LZF: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: HK57%20YCH
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK57%2520YCH%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for HK57%20YCH: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: HV64%20ZMX
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV64%2520ZMX%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for HV64%20ZMX: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: LR14%20NKS
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR14%2520NKS%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for LR14%20NKS: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: LT61%20FNW
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT61%2520FNW%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for LT61%20FNW: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: LX15%20SYU
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX15%2520SYU%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for LX15%20SYU: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: MF58%20FJO
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF58%2520FJO%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for MF58%20FJO: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: NJ11%20XCC
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ11%2520XCC%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for NJ11%20XCC: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: NX59%20VNB
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX59%2520VNB%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for NX59%20VNB: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: OFZ%205008
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OFZ%25205008%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for OFZ%205008: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: OW53%20UMO
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW53%2520UMO%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for OW53%20UMO: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: RJ11%20YBG
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ11%2520YBG%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for RJ11%20YBG: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: RV11%20NYX
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV11%2520NYX%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for RV11%20NYX: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: CV56%20YXN
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV56%2520YXN%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for CV56%20YXN: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: DG11%20EGJ
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG11%2520EGJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for DG11%20EGJ: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: FE09%20EOA
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE09%2520EOA%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for FE09%20EOA: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: FG12%20CXF
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG12%2520CXF%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for FG12%20CXF: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: WV68%20XXZ
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV68%2520XXZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for WV68%20XXZ: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: BD64%20HBE
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD64%2520HBE%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for BD64%20HBE: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: HK64%20KPR
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK64%2520KPR%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for HK64%20KPR: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: MA16%20WKP
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA16%2520WKP%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for MA16%20WKP: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: WF61%20JZG
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF61%2520JZG%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for WF61%20JZG: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: VK67%20KFZ
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK67%2520KFZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for VK67%20KFZ: 0
2026-03-29 22:05:06 [bca.uk] INFO: Found listing with ID: VX67%20UYY
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX67%2520UYY%27 HTTP/1.1" 200 None
2026-03-29 22:05:06 [bca.uk] INFO: Scrape type for VX67%20UYY: 2
2026-03-29 22:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31d0c868-c5fb-59c4-8900-412bcf1a5dc2 with identifier: VX67%20UYY
2026-03-29 22:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31d0c868-c5fb-59c4-8900-412bcf1a5dc2 with scrape type 2
2026-03-29 22:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31d0c868-c5fb-59c4-8900-412bcf1a5dc2 with scrape type 2
2026-03-29 22:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 31d0c868-c5fb-59c4-8900-412bcf1a5dc2, identifier: VX67%20UYY
2026-03-29 22:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618f5610>
2026-03-29 22:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE19AAK%252F699411499%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411499/600 saved to cache
2026-03-29 22:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff522792-d041-5ecb-b231-8bf72c190c1e
2026-03-29 22:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632ba690>
2026-03-29 22:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL07HRM%252F699142759%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142759/600 saved to cache
2026-03-29 22:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f87fc02-985b-5b39-b30d-ff94e761a881
2026-03-29 22:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395720/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395720>
2026-03-29 22:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046534/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM54XHA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 31d0c868-c5fb-59c4-8900-412bcf1a5dc2 with identifier: VX67%20UYY
2026-03-29 22:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 31d0c868-c5fb-59c4-8900-412bcf1a5dc2 with identifier: VX67%20UYY
2026-03-29 22:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 31d0c868-c5fb-59c4-8900-412bcf1a5dc2 with identifier: VX67%20UYY to the API
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VX67%20UYY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '31d0c868-c5fb-59c4-8900-412bcf1a5dc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VX67 UYY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VX67%20UYY&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 82414,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 TD4 180 4WD HSE DYNAMIC Convertible',
'transmission': 'automatic',
'trim': 'TD4 180 4WD HSE DYNAMIC',
'vin': 'SALVA5ANXHH264164',
'year': 2017}
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX67%2520UYY%27 HTTP/1.1" 200 None
2026-03-29 22:05:07 [bca.uk] INFO: Saving data for VX67%20UYY: {'auction_closing_time': 1774864800.0, 'created_time': 1774620531.061392, 'last_price_update_time': 1774821907.290904}
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VX67%2520UYY') HTTP/1.1" 204 0
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046576%27 HTTP/1.1" 200 None
2026-03-29 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046576 not downloaded yet
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699198372%27 HTTP/1.1" 200 None
2026-03-29 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198372 not downloaded yet
2026-03-29 22:05:07 [bca.uk] INFO: Found listing with ID: BW15%20UPM
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW15%2520UPM%27 HTTP/1.1" 200 None
2026-03-29 22:05:07 [bca.uk] INFO: Scrape type for BW15%20UPM: 0
2026-03-29 22:05:07 [bca.uk] INFO: Found listing with ID: DY64%20FEV
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY64%2520FEV%27 HTTP/1.1" 200 None
2026-03-29 22:05:07 [bca.uk] INFO: Scrape type for DY64%20FEV: 0
2026-03-29 22:05:07 [bca.uk] INFO: Found listing with ID: NV15%20TXJ
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV15%2520TXJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:07 [bca.uk] INFO: Scrape type for NV15%20TXJ: 0
2026-03-29 22:05:07 [bca.uk] INFO: Found listing with ID: RA16%20FGU
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA16%2520FGU%27 HTTP/1.1" 200 None
2026-03-29 22:05:07 [bca.uk] INFO: Scrape type for RA16%20FGU: 0
2026-03-29 22:05:07 [bca.uk] INFO: Found listing with ID: AK58%20WFA
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK58%2520WFA%27 HTTP/1.1" 200 None
2026-03-29 22:05:07 [bca.uk] INFO: Scrape type for AK58%20WFA: 0
2026-03-29 22:05:07 [bca.uk] INFO: Found listing with ID: RO06%20OCF
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO06%2520OCF%27 HTTP/1.1" 200 None
2026-03-29 22:05:07 [bca.uk] INFO: Scrape type for RO06%20OCF: 0
2026-03-29 22:05:07 [bca.uk] INFO: Found listing with ID: RX13%20YNL
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX13%2520YNL%27 HTTP/1.1" 200 None
2026-03-29 22:05:07 [bca.uk] INFO: Scrape type for RX13%20YNL: 0
2026-03-29 22:05:07 [bca.uk] INFO: Found listing with ID: SO10%20SJD
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO10%2520SJD%27 HTTP/1.1" 200 None
2026-03-29 22:05:07 [bca.uk] INFO: Scrape type for SO10%20SJD: 0
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61022650>
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT57DYH%252F699046533%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046533/600 saved to cache
2026-03-29 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ba7d5c4-734f-5e05-8725-12f4a7e78af1
2026-03-29 22:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046565/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046565>
2026-03-29 22:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046557/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046557>
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618f87d0>
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNC08ONX%252F699395712%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395712/600 saved to cache
2026-03-29 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40b88b0b-760b-5e8d-8f49-074bf256e466
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621a3a10>
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL07HRM%252F699142773%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142773/600 saved to cache
2026-03-29 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f87fc02-985b-5b39-b30d-ff94e761a881
2026-03-29 22:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198352/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198352>
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699198380%27 HTTP/1.1" 200 None
2026-03-29 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198380 not downloaded yet
2026-03-29 22:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046547/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT57DYH/42811171?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=ba3XEcywWuim4PxaK5nJb76sAThRmrq4Rgv5ofIXEw0%3D)
2026-03-29 22:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395718/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NC08ONX/42812093?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=Zw2w%2BWGBqBzN6FuSvk9oA0R0jIOoFWoee6Cilu52DU4%3D)
2026-03-29 22:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046536/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM54XHA/42811172?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=wc9iWas244mOWFhb%2BwCxFVBHyC3mtDYXAJcNgtASgkE%3D)
2026-03-29 22:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046544/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT57DYH/42811171?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=ba3XEcywWuim4PxaK5nJb76sAThRmrq4Rgv5ofIXEw0%3D)
2026-03-29 22:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395717/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NC08ONX/42812093?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=Zw2w%2BWGBqBzN6FuSvk9oA0R0jIOoFWoee6Cilu52DU4%3D)
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699198393%27 HTTP/1.1" 200 None
2026-03-29 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198393 not downloaded yet
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699198405%27 HTTP/1.1" 200 None
2026-03-29 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198405 not downloaded yet
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699198421%27 HTTP/1.1" 200 None
2026-03-29 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198421 not downloaded yet
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699198433%27 HTTP/1.1" 200 None
2026-03-29 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198433 not downloaded yet
2026-03-29 22:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198358/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198358>
2026-03-29 22:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046567/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046567>
2026-03-29 22:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046542/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM54XHA/42811172?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=wc9iWas244mOWFhb%2BwCxFVBHyC3mtDYXAJcNgtASgkE%3D)
2026-03-29 22:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046539/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM54XHA/42811172?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=wc9iWas244mOWFhb%2BwCxFVBHyC3mtDYXAJcNgtASgkE%3D)
2026-03-29 22:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046554/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT57DYH/42811171?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=ba3XEcywWuim4PxaK5nJb76sAThRmrq4Rgv5ofIXEw0%3D)
2026-03-29 22:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142809/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL07HRM/42787034?sv=2020-08-04&st=2026-03-29T22%3A04%3A47Z&se=2026-03-29T22%3A29%3A47Z&sr=b&sp=r&sig=exdoUniRSbIwQ12LkQI9utrlzs26smvmyOvTrgGhZiY%3D)
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61167450>
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT57DYH%252F699046547%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046547/600 saved to cache
2026-03-29 22:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ba7d5c4-734f-5e05-8725-12f4a7e78af1
2026-03-29 22:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395720/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NC08ONX/42812093?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=Zw2w%2BWGBqBzN6FuSvk9oA0R0jIOoFWoee6Cilu52DU4%3D)
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6119ae90>
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNC08ONX%252F699395718%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395718/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40b88b0b-760b-5e8d-8f49-074bf256e466
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619f38d0>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM54XHA%252F699046536%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046536/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b0931c6-e1ee-59a1-940a-2866b34dd8e0
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61666c90>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT57DYH%252F699046544%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046544/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ba7d5c4-734f-5e05-8725-12f4a7e78af1
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac697ef790>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNC08ONX%252F699395717%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395717/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40b88b0b-760b-5e8d-8f49-074bf256e466
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046534/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM54XHA/42811172?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=wc9iWas244mOWFhb%2BwCxFVBHyC3mtDYXAJcNgtASgkE%3D)
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198372/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198372>
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046576/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046576>
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198366/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198366>
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198352/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SW14DSO/42797814?sv=2020-08-04&st=2026-03-29T22%3A04%3A52Z&se=2026-03-29T22%3A29%3A52Z&sr=b&sp=r&sig=HWRGmMiZHUzQfBmk5OQ1D7P%2FeZsK7wYaXZ1soCo9ztg%3D)
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198380/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198380>
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046557/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT57DYH/42811171?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=ba3XEcywWuim4PxaK5nJb76sAThRmrq4Rgv5ofIXEw0%3D)
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62153050>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM54XHA%252F699046542%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046542/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b0931c6-e1ee-59a1-940a-2866b34dd8e0
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616668d0>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM54XHA%252F699046539%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046539/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b0931c6-e1ee-59a1-940a-2866b34dd8e0
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610220d0>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT57DYH%252F699046554%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046554/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ba7d5c4-734f-5e05-8725-12f4a7e78af1
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618793d0>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL07HRM%252F699142809%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142809/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f87fc02-985b-5b39-b30d-ff94e761a881
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac697a5950>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNC08ONX%252F699395720%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395720/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40b88b0b-760b-5e8d-8f49-074bf256e466
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046565/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT57DYH/42811171?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=ba3XEcywWuim4PxaK5nJb76sAThRmrq4Rgv5ofIXEw0%3D)
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046571/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046571>
2026-03-29 22:05:08 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:05:08 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:05:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69b81550>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM54XHA%252F699046534%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046534/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b0931c6-e1ee-59a1-940a-2866b34dd8e0
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6109e810>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSW14DSO%252F699198352%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198352/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca52f08c-d65c-5ece-bef3-1f4a7047ab80
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6372d750>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT57DYH%252F699046557%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046557/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ba7d5c4-734f-5e05-8725-12f4a7e78af1
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198358/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SW14DSO/42797814?sv=2020-08-04&st=2026-03-29T22%3A04%3A52Z&se=2026-03-29T22%3A29%3A52Z&sr=b&sp=r&sig=HWRGmMiZHUzQfBmk5OQ1D7P%2FeZsK7wYaXZ1soCo9ztg%3D)
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198433/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198433>
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198421/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198421>
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198393/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198393>
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198405/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699198405>
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046568/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046568>
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395773/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395773>
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046567/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM54XHA/42811172?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=wc9iWas244mOWFhb%2BwCxFVBHyC3mtDYXAJcNgtASgkE%3D)
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac697cbc50>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT57DYH%252F699046565%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046565/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ba7d5c4-734f-5e05-8725-12f4a7e78af1
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046563/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046563>
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395742/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395742>
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198366/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SW14DSO/42797814?sv=2020-08-04&st=2026-03-29T22%3A04%3A52Z&se=2026-03-29T22%3A29%3A52Z&sr=b&sp=r&sig=HWRGmMiZHUzQfBmk5OQ1D7P%2FeZsK7wYaXZ1soCo9ztg%3D)
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046571/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM54XHA/42811172?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=wc9iWas244mOWFhb%2BwCxFVBHyC3mtDYXAJcNgtASgkE%3D)
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198372/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SW14DSO/42797814?sv=2020-08-04&st=2026-03-29T22%3A04%3A52Z&se=2026-03-29T22%3A29%3A52Z&sr=b&sp=r&sig=HWRGmMiZHUzQfBmk5OQ1D7P%2FeZsK7wYaXZ1soCo9ztg%3D)
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198380/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SW14DSO/42797814?sv=2020-08-04&st=2026-03-29T22%3A04%3A52Z&se=2026-03-29T22%3A29%3A52Z&sr=b&sp=r&sig=HWRGmMiZHUzQfBmk5OQ1D7P%2FeZsK7wYaXZ1soCo9ztg%3D)
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046576/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM54XHA/42811172?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=wc9iWas244mOWFhb%2BwCxFVBHyC3mtDYXAJcNgtASgkE%3D)
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61056350>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSW14DSO%252F699198358%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198358/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca52f08c-d65c-5ece-bef3-1f4a7047ab80
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198405/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SW14DSO/42797814?sv=2020-08-04&st=2026-03-29T22%3A04%3A52Z&se=2026-03-29T22%3A29%3A52Z&sr=b&sp=r&sig=HWRGmMiZHUzQfBmk5OQ1D7P%2FeZsK7wYaXZ1soCo9ztg%3D)
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198421/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SW14DSO/42797814?sv=2020-08-04&st=2026-03-29T22%3A04%3A52Z&se=2026-03-29T22%3A29%3A52Z&sr=b&sp=r&sig=HWRGmMiZHUzQfBmk5OQ1D7P%2FeZsK7wYaXZ1soCo9ztg%3D)
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395773/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NC08ONX/42812093?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=Zw2w%2BWGBqBzN6FuSvk9oA0R0jIOoFWoee6Cilu52DU4%3D)
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61addf50>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM54XHA%252F699046567%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046567/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b0931c6-e1ee-59a1-940a-2866b34dd8e0
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198343/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SW14DSO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046545/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046545>
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046568/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT57DYH/42811171?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=ba3XEcywWuim4PxaK5nJb76sAThRmrq4Rgv5ofIXEw0%3D)
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611c97d0>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSW14DSO%252F699198366%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198366/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca52f08c-d65c-5ece-bef3-1f4a7047ab80
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6117f150>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM54XHA%252F699046571%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046571/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b0931c6-e1ee-59a1-940a-2866b34dd8e0
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395730/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395730>
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395715/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395715>
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142800/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142800>
2026-03-29 22:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046540>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618031d0>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSW14DSO%252F699198372%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198372/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca52f08c-d65c-5ece-bef3-1f4a7047ab80
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198433/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SW14DSO/42797814?sv=2020-08-04&st=2026-03-29T22%3A04%3A52Z&se=2026-03-29T22%3A29%3A52Z&sr=b&sp=r&sig=HWRGmMiZHUzQfBmk5OQ1D7P%2FeZsK7wYaXZ1soCo9ztg%3D)
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046563/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM54XHA/42811172?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=wc9iWas244mOWFhb%2BwCxFVBHyC3mtDYXAJcNgtASgkE%3D)
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198393/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SW14DSO/42797814?sv=2020-08-04&st=2026-03-29T22%3A04%3A52Z&se=2026-03-29T22%3A29%3A52Z&sr=b&sp=r&sig=HWRGmMiZHUzQfBmk5OQ1D7P%2FeZsK7wYaXZ1soCo9ztg%3D)
2026-03-29 22:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395742/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NC08ONX/42812093?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=Zw2w%2BWGBqBzN6FuSvk9oA0R0jIOoFWoee6Cilu52DU4%3D)
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6105bed0>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSW14DSO%252F699198380%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198380/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca52f08c-d65c-5ece-bef3-1f4a7047ab80
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61544090>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM54XHA%252F699046576%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046576/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b0931c6-e1ee-59a1-940a-2866b34dd8e0
2026-03-29 22:05:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61803110>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSW14DSO%252F699198405%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198405/600 saved to cache
2026-03-29 22:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ca52f08c-d65c-5ece-bef3-1f4a7047ab80
2026-03-29 22:05:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63544310>
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSW14DSO%252F699198421%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198421/600 saved to cache
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ca52f08c-d65c-5ece-bef3-1f4a7047ab80
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620946d0>
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNC08ONX%252F699395773%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395773/600 saved to cache
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40b88b0b-760b-5e8d-8f49-074bf256e466
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c865d0>
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT57DYH%252F699046568%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046568/600 saved to cache
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ba7d5c4-734f-5e05-8725-12f4a7e78af1
2026-03-29 22:05:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61185f50>
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSW14DSO%252F699198433%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198433/600 saved to cache
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ca52f08c-d65c-5ece-bef3-1f4a7047ab80
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61879490>
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM54XHA%252F699046563%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046563/600 saved to cache
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b0931c6-e1ee-59a1-940a-2866b34dd8e0
2026-03-29 22:05:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611e2450>
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSW14DSO%252F699198393%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198393/600 saved to cache
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca52f08c-d65c-5ece-bef3-1f4a7047ab80
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6184f910>
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNC08ONX%252F699395742%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395742/600 saved to cache
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40b88b0b-760b-5e8d-8f49-074bf256e466
2026-03-29 22:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198343/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SW14DSO/42797814?sv=2020-08-04&st=2026-03-29T22%3A04%3A52Z&se=2026-03-29T22%3A29%3A52Z&sr=b&sp=r&sig=HWRGmMiZHUzQfBmk5OQ1D7P%2FeZsK7wYaXZ1soCo9ztg%3D)
2026-03-29 22:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142790/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142790>
2026-03-29 22:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427752/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427752>
2026-03-29 22:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395714/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395714>
2026-03-29 22:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046538/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046538>
2026-03-29 22:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427830/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427830>
2026-03-29 22:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046545/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM54XHA/42811172?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=wc9iWas244mOWFhb%2BwCxFVBHyC3mtDYXAJcNgtASgkE%3D)
2026-03-29 22:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046540/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT57DYH/42811171?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=ba3XEcywWuim4PxaK5nJb76sAThRmrq4Rgv5ofIXEw0%3D)
2026-03-29 22:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411759/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411759>
2026-03-29 22:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414866/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414866>
2026-03-29 22:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406290/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406290>
2026-03-29 22:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409181/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409181>
2026-03-29 22:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427830/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19VXX/42812304?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=YzGWBhkemG5tXMwAwvYpsWX0bEfwiTWFoG%2FIuzQzr2c%3D)
2026-03-29 22:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395730/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NC08ONX/42812093?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=Zw2w%2BWGBqBzN6FuSvk9oA0R0jIOoFWoee6Cilu52DU4%3D)
2026-03-29 22:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142800/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL07HRM/42787034?sv=2020-08-04&st=2026-03-29T22%3A04%3A47Z&se=2026-03-29T22%3A29%3A47Z&sr=b&sp=r&sig=exdoUniRSbIwQ12LkQI9utrlzs26smvmyOvTrgGhZiY%3D)
2026-03-29 22:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395715/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NC08ONX/42812093?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=Zw2w%2BWGBqBzN6FuSvk9oA0R0jIOoFWoee6Cilu52DU4%3D)
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6162ab90>
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSW14DSO%252F699198343%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198343/600 saved to cache
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca52f08c-d65c-5ece-bef3-1f4a7047ab80
2026-03-29 22:05:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca52f08c-d65c-5ece-bef3-1f4a7047ab80, skipping ID generation
2026-03-29 22:05:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca52f08c-d65c-5ece-bef3-1f4a7047ab80 sending to next pipeline
2026-03-29 22:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ca52f08c-d65c-5ece-bef3-1f4a7047ab80, identifier: SW14%20DSO
2026-03-29 22:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ca52f08c-d65c-5ece-bef3-1f4a7047ab80 with identifier: SW14%20DSO
2026-03-29 22:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ca52f08c-d65c-5ece-bef3-1f4a7047ab80 with identifier: SW14%20DSO
2026-03-29 22:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ca52f08c-d65c-5ece-bef3-1f4a7047ab80 with identifier: SW14%20DSO to the API
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198343/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_expert_report_file_9a5fac33-2361-4344-9a08-10c4dc1ecfc7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SW14%20DSO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ca52f08c-d65c-5ece-bef3-1f4a7047ab80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SW14 DSO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SW14%20DSO&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 102772,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46331,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198343/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45807,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198352/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42637,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198358/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42983,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198366/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39944,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198372/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38931,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198380/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86573,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198393/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72868,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198405/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85309,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198421/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52f08c-d65c-5ece-bef3-1f4a7047ab80/ca52f08c-d65c-5ece-bef3-1f4a7047ab80_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77051,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SW14DSO/699198433/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.5 DCI 110 ACENTA PREMIUM Hatchback',
'transmission': 'manual',
'trim': 'DCI 110 ACENTA PREMIUM',
'vin': 'SJNFAAJ11U1093589',
'year': 2014}
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW14%2520DSO%27 HTTP/1.1" 200 None
2026-03-29 22:05:10 [bca.uk] INFO: Saving data for SW14%20DSO: {'created_time': 1774821910.097122, 'last_price_update_time': 1774821910.097134, 'auction_closing_time': 1775210400.0}
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SW14%2520DSO') HTTP/1.1" 204 0
2026-03-29 22:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427752/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE20EVL/42811999?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=QNaGwsE1HTKndyV7dS5jfLI1ozyFJBkYcrsiWmkuv8k%3D)
2026-03-29 22:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414866/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ72FOT/42812096?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=F1eqEFipUoySPGKOeLKkFyyLLItl9dJbMFy96XQcSRY%3D)
2026-03-29 22:05:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435112/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HS68PYY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:05:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE14PLV/42810074?sv=2020-08-04&st=2026-03-29T22%3A05%3A09Z&se=2026-03-29T22%3A30%3A09Z&sr=b&sp=r&sig=541MdBEqN2lGTdrVQerWTQ4Lv%2BWExd94C%2FkstcmEUVg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE14%20PLV-GB>
2026-03-29 22:05:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409149/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YE18CHX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142790/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL07HRM/42787034?sv=2020-08-04&st=2026-03-29T22%3A04%3A47Z&se=2026-03-29T22%3A29%3A47Z&sr=b&sp=r&sig=exdoUniRSbIwQ12LkQI9utrlzs26smvmyOvTrgGhZiY%3D)
2026-03-29 22:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395714/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NC08ONX/42812093?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=Zw2w%2BWGBqBzN6FuSvk9oA0R0jIOoFWoee6Cilu52DU4%3D)
2026-03-29 22:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046538/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT57DYH/42811171?sv=2020-08-04&st=2026-03-29T22%3A04%3A49Z&se=2026-03-29T22%3A29%3A49Z&sr=b&sp=r&sig=ba3XEcywWuim4PxaK5nJb76sAThRmrq4Rgv5ofIXEw0%3D)
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636a5110>
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM54XHA%252F699046545%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046545/600 saved to cache
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b0931c6-e1ee-59a1-940a-2866b34dd8e0
2026-03-29 22:05:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b0931c6-e1ee-59a1-940a-2866b34dd8e0, skipping ID generation
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b0931c6-e1ee-59a1-940a-2866b34dd8e0 sending to next pipeline
2026-03-29 22:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8b0931c6-e1ee-59a1-940a-2866b34dd8e0, identifier: LM54%20XHA
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610f4890>
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT57DYH%252F699046540%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046540/600 saved to cache
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ba7d5c4-734f-5e05-8725-12f4a7e78af1
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63617490>
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19VXX%252F699427830%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427830/600 saved to cache
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 553a9526-308c-5e9f-97f5-1bce769f99d7
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61764790>
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNC08ONX%252F699395730%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395730/600 saved to cache
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40b88b0b-760b-5e8d-8f49-074bf256e466
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6a865dd0>
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL07HRM%252F699142800%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142800/600 saved to cache
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f87fc02-985b-5b39-b30d-ff94e761a881
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b34d0>
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNC08ONX%252F699395715%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395715/600 saved to cache
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40b88b0b-760b-5e8d-8f49-074bf256e466
2026-03-29 22:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8b0931c6-e1ee-59a1-940a-2866b34dd8e0 with identifier: LM54%20XHA
2026-03-29 22:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8b0931c6-e1ee-59a1-940a-2866b34dd8e0 with identifier: LM54%20XHA
2026-03-29 22:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8b0931c6-e1ee-59a1-940a-2866b34dd8e0 with identifier: LM54%20XHA to the API
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046545/600>
{'auction_title': '',
'c_o_2_emission_value': 180,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_expert_report_file_9c4fb082-2b73-4884-b0de-ec26789bd21c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM54%20XHA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8b0931c6-e1ee-59a1-940a-2866b34dd8e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM54 XHA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM54%20XHA&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 124657,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191782,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046534/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187709,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046536/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193076,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046539/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190057,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046542/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168312,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046545/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128188,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046563/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148634,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046567/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 162804,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046571/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b0931c6-e1ee-59a1-940a-2866b34dd8e0/8b0931c6-e1ee-59a1-940a-2866b34dd8e0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152574,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM54XHA/699046576/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.4 TWIST Hatchback',
'transmission': 'automatic',
'trim': 'TWIST',
'vin': 'WVWZZZ9NZ5Y075526',
'year': 2005}
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM54%2520XHA%27 HTTP/1.1" 200 None
2026-03-29 22:05:10 [bca.uk] INFO: Saving data for LM54%20XHA: {'created_time': 1774821910.854262, 'last_price_update_time': 1774821910.854277, 'auction_closing_time': 1774864800.0}
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM54%2520XHA') HTTP/1.1" 204 0
2026-03-29 22:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409181/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PA19DCO/42811984?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=5dad8F2568bHOl2s5RwggeSpVONMrl6yr8ByaoDJDOc%3D)
2026-03-29 22:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406290/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG69FWY/42811982?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=iIU0ZFwxCrfo9iR2T7l%2BEKiHBXHpV%2FjhvFuNPQMcBwU%3D)
2026-03-29 22:05:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430166/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430166>
2026-03-29 22:05:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411475/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DE19AAK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411759/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML23KNX/42812081?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Ysjf2AWU3A%2B%2BhkZ4EdoIgPpKhCyN1a54UPjPwLBr1pc%3D)
2026-03-29 22:05:10 [scrapy.extensions.logstats] INFO: Crawled 134 pages (at 13 pages/min), scraped 275 items (at 71 items/min)
2026-03-29 22:05:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-29 22:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409149/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YE18CHX/42812000?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=oyBRp8qHoowbCW9kieY0zUV46IZNjY3FwR8NKuxfaxo%3D)
2026-03-29 22:05:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430117/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430117>
2026-03-29 22:05:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575330/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=686575330>
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636f6c50>
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE20EVL%252F699427752%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427752/600 saved to cache
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b145ed4d-e096-5329-b7ec-7396067fba60
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6374c150>
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ72FOT%252F699414866%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414866/600 saved to cache
2026-03-29 22:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61519150>
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL07HRM%252F699142790%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142790/600 saved to cache
2026-03-29 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f87fc02-985b-5b39-b30d-ff94e761a881
2026-03-29 22:05:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f87fc02-985b-5b39-b30d-ff94e761a881, skipping ID generation
2026-03-29 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f87fc02-985b-5b39-b30d-ff94e761a881 sending to next pipeline
2026-03-29 22:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3f87fc02-985b-5b39-b30d-ff94e761a881, identifier: PL07%20HRM
2026-03-29 22:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6160b610>
2026-03-29 22:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNC08ONX%252F699395714%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395714/600 saved to cache
2026-03-29 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40b88b0b-760b-5e8d-8f49-074bf256e466
2026-03-29 22:05:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40b88b0b-760b-5e8d-8f49-074bf256e466, skipping ID generation
2026-03-29 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40b88b0b-760b-5e8d-8f49-074bf256e466 sending to next pipeline
2026-03-29 22:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 40b88b0b-760b-5e8d-8f49-074bf256e466, identifier: NC08%20ONX
2026-03-29 22:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61161b90>
2026-03-29 22:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT57DYH%252F699046538%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046538/600 saved to cache
2026-03-29 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ba7d5c4-734f-5e05-8725-12f4a7e78af1
2026-03-29 22:05:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ba7d5c4-734f-5e05-8725-12f4a7e78af1, skipping ID generation
2026-03-29 22:05:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ba7d5c4-734f-5e05-8725-12f4a7e78af1 sending to next pipeline
2026-03-29 22:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3ba7d5c4-734f-5e05-8725-12f4a7e78af1, identifier: LT57%20DYH
2026-03-29 22:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3f87fc02-985b-5b39-b30d-ff94e761a881 with identifier: PL07%20HRM
2026-03-29 22:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3f87fc02-985b-5b39-b30d-ff94e761a881 with identifier: PL07%20HRM
2026-03-29 22:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3f87fc02-985b-5b39-b30d-ff94e761a881 with identifier: PL07%20HRM to the API
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142790/600>
{'auction_title': '',
'c_o_2_emission_value': 148,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_expert_report_file_dbcc937c-ab19-4780-806b-e2591e673717.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PL07%20HRM-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3f87fc02-985b-5b39-b30d-ff94e761a881',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PL07 HRM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PL07%20HRM&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'SUZUKI',
'model': 'SWIFT',
'odometer': 145345,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179810,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142699/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192897,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142716/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180853,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142726/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176861,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142745/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164791,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142759/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145704,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142773/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165041,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142790/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144310,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142800/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f87fc02-985b-5b39-b30d-ff94e761a881/3f87fc02-985b-5b39-b30d-ff94e761a881_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141479,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL07HRM/699142809/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'SUZUKI SWIFT 1.3 GL Hatchback',
'transmission': 'manual',
'trim': 'GL',
'vin': 'TSMMZC11S00374264',
'year': 2007}
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL07%2520HRM%27 HTTP/1.1" 200 None
2026-03-29 22:05:11 [bca.uk] INFO: Saving data for PL07%20HRM: {'created_time': 1774821911.91093, 'last_price_update_time': 1774821911.910943, 'auction_closing_time': 1774864800.0}
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PL07%2520HRM') HTTP/1.1" 204 0
2026-03-29 22:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 40b88b0b-760b-5e8d-8f49-074bf256e466 with identifier: NC08%20ONX
2026-03-29 22:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 40b88b0b-760b-5e8d-8f49-074bf256e466 with identifier: NC08%20ONX
2026-03-29 22:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 40b88b0b-760b-5e8d-8f49-074bf256e466 with identifier: NC08%20ONX to the API
2026-03-29 22:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395714/600>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_expert_report_file_03b1045a-a2c1-451e-a50e-1cfbbecfa1fc.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NC08%20ONX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '40b88b0b-760b-5e8d-8f49-074bf256e466',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NC08 ONX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NC08%20ONX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 123225,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198050,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395712/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201740,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395714/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177464,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395715/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182597,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395717/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168677,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395718/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123568,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395720/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152771,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395730/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147825,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395742/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40b88b0b-760b-5e8d-8f49-074bf256e466/40b88b0b-760b-5e8d-8f49-074bf256e466_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148354,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NC08ONX/699395773/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.4 ACENTA Hatchback',
'transmission': 'manual',
'trim': 'ACENTA',
'vin': 'SJNFAAE11U1271480',
'year': 2008}
2026-03-29 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC08%2520ONX%27 HTTP/1.1" 200 None
2026-03-29 22:05:12 [bca.uk] INFO: Saving data for NC08%20ONX: {'created_time': 1774821912.360413, 'last_price_update_time': 1774821912.360425, 'auction_closing_time': 1774864800.0}
2026-03-29 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NC08%2520ONX') HTTP/1.1" 204 0
2026-03-29 22:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3ba7d5c4-734f-5e05-8725-12f4a7e78af1 with identifier: LT57%20DYH
2026-03-29 22:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3ba7d5c4-734f-5e05-8725-12f4a7e78af1 with identifier: LT57%20DYH
2026-03-29 22:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3ba7d5c4-734f-5e05-8725-12f4a7e78af1 with identifier: LT57%20DYH to the API
2026-03-29 22:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046538/600>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_expert_report_file_c24ea412-1e17-432b-903b-aa7d525d4942.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT57%20DYH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3ba7d5c4-734f-5e05-8725-12f4a7e78af1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT57 DYH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT57%20DYH&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MINI',
'model': 'COOPER',
'odometer': 146273,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196298,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046533/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200494,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046538/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203809,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046540/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198379,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046544/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187586,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046547/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135933,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046554/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167009,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046557/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164792,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046565/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba7d5c4-734f-5e05-8725-12f4a7e78af1/3ba7d5c4-734f-5e05-8725-12f4a7e78af1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164066,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT57DYH/699046568/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.6 D Hatchback',
'transmission': 'manual',
'trim': 'D',
'vin': 'WMWMG32030TV20491',
'year': 2007}
2026-03-29 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT57%2520DYH%27 HTTP/1.1" 200 None
2026-03-29 22:05:12 [bca.uk] INFO: Saving data for LT57%20DYH: {'created_time': 1774821912.900201, 'last_price_update_time': 1774821912.900216, 'auction_closing_time': 1774864800.0}
2026-03-29 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT57%2520DYH') HTTP/1.1" 204 0
2026-03-29 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435112/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HS68PYY/42812178?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=ilxdzGsr4IgRZDvqZmWhurm4pGkLnzxS3s4veY%2BdCjs%3D)
2026-03-29 22:05:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411747/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411747>
2026-03-29 22:05:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427739/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427739>
2026-03-29 22:05:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427780/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427780>
2026-03-29 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411475/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE19AAK/42812078?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=MkdK1ykhsLQ%2B%2F2n1Irxn7evFumHYKKFZXmkQdpd8KgM%3D)
2026-03-29 22:05:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414858/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414858>
2026-03-29 22:05:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406275/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406275>
2026-03-29 22:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618e16d0>
2026-03-29 22:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPA19DCO%252F699409181%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409181/600 saved to cache
2026-03-29 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da397772-3003-5876-84de-18e19f2e1e0e
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62244f50>
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG69FWY%252F699406290%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406290/600 saved to cache
2026-03-29 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23673480-b7c5-5707-903a-2783d4797f75
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611986d0>
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML23KNX%252F699411759%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411759/600 saved to cache
2026-03-29 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c96e7ad0-7cd4-5ea7-b41d-642972a2bf14
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62247e10>
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYE18CHX%252F699409149%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409149/600 saved to cache
2026-03-29 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad
2026-03-29 22:05:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad, skipping ID generation
2026-03-29 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad sending to next pipeline
2026-03-29 22:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad, identifier: YE18%20CHX
2026-03-29 22:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad with identifier: YE18%20CHX
2026-03-29 22:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad with identifier: YE18%20CHX
2026-03-29 22:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad with identifier: YE18%20CHX to the API
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409149/600>
{'auction_title': '',
'c_o_2_emission_value': 101,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_expert_report_file_7ab81432-6abc-4856-a0ca-6bcca9f8c629.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YE18%20CHX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YE18 CHX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YE18%20CHX&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 34591,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39811,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409149/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39198,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409168/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37946,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409184/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39567,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409206/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36559,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409219/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34658,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409230/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93779,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409251/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67051,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409267/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83129,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409284/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad/be57c0c3-cb1b-504b-82b5-7c52a7a5e5ad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83387,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YE18CHX/699409299/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 TSI 95 SE Hatchback',
'transmission': 'manual',
'trim': 'TSI 95 SE',
'vin': 'WVWZZZAWZJU015415',
'year': 2018}
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE18%2520CHX%27 HTTP/1.1" 200 None
2026-03-29 22:05:13 [bca.uk] INFO: Saving data for YE18%20CHX: {'created_time': 1774821913.723003, 'last_price_update_time': 1774821913.723015, 'auction_closing_time': 1774951200.0}
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YE18%2520CHX') HTTP/1.1" 204 0
2026-03-29 22:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE14PLV/42810074?sv=2020-08-04&st=2026-03-29T22%3A05%3A09Z&se=2026-03-29T22%3A30%3A09Z&sr=b&sp=r&sig=541MdBEqN2lGTdrVQerWTQ4Lv%2BWExd94C%2FkstcmEUVg%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430166/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19VSX/42812111?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=qlSeQUbf83xHqWfD9mYZ2SCAALVwdddlxYHgmUNU2tY%3D)
2026-03-29 22:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575330/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/P17LPT/42573216?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Cei94j6xTuVsYVAtMEIEaOIhWn8jpASCTY7XqjpVl64%3D)
2026-03-29 22:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430117/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA16ETX/42812131?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=67cSoD7yDAcPlVUXb6MtFxB8b%2F%2B%2FHPzK%2FRcqJHz%2FIwo%3D)
2026-03-29 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409166/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409166>
2026-03-29 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ62YDS/42810080?sv=2020-08-04&st=2026-03-29T22%3A05%3A13Z&se=2026-03-29T22%3A30%3A13Z&sr=b&sp=r&sig=3uF2r926LhFkKPoPLSCohRVnNGX4IbgEWDcBb0D1E%2B8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NJ62%20YDS-GB>
2026-03-29 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430088/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MA16ETX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575322/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=P17LPT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636f59d0>
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHS68PYY%252F699435112%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435112/600 saved to cache
2026-03-29 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73
2026-03-29 22:05:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73, skipping ID generation
2026-03-29 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73 sending to next pipeline
2026-03-29 22:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73, identifier: HS68%20PYY
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61184490>
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE19AAK%252F699411475%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411475/600 saved to cache
2026-03-29 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff522792-d041-5ecb-b231-8bf72c190c1e
2026-03-29 22:05:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff522792-d041-5ecb-b231-8bf72c190c1e, skipping ID generation
2026-03-29 22:05:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff522792-d041-5ecb-b231-8bf72c190c1e sending to next pipeline
2026-03-29 22:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ff522792-d041-5ecb-b231-8bf72c190c1e, identifier: DE19%20AAK
2026-03-29 22:05:14 [bca.uk] INFO: Total items found: 100
2026-03-29 22:05:14 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded
2026-03-29 22:05:14 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:05:14 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73 with identifier: HS68%20PYY
2026-03-29 22:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73 with identifier: HS68%20PYY
2026-03-29 22:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73 with identifier: HS68%20PYY to the API
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435112/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_expert_report_file_d526eea7-163c-4146-9527-257bf8b6476a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HS68%20PYY-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HS68 PYY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HS68%20PYY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 46403,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43845,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435112/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41847,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435116/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42382,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435123/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44507,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435131/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41018,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435139/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38899,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435146/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101701,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435156/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77619,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435165/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91497,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435173/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73/a9e0ac94-5526-5e45-a2dc-3c3d79f3fc73_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81066,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HS68PYY/699435181/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'RENAULT CAPTUR 1.5 DCI 90 GT LINE Hatchback',
'transmission': 'manual',
'trim': 'DCI 90 GT LINE',
'vin': 'VF1R8700162118014',
'year': 2019}
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HS68%2520PYY%27 HTTP/1.1" 200 None
2026-03-29 22:05:14 [bca.uk] INFO: Saving data for HS68%20PYY: {'created_time': 1774821914.415825, 'last_price_update_time': 1774821914.415835, 'auction_closing_time': 1774951200.0}
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HS68%2520PYY') HTTP/1.1" 204 0
2026-03-29 22:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ff522792-d041-5ecb-b231-8bf72c190c1e with identifier: DE19%20AAK
2026-03-29 22:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ff522792-d041-5ecb-b231-8bf72c190c1e with identifier: DE19%20AAK
2026-03-29 22:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ff522792-d041-5ecb-b231-8bf72c190c1e with identifier: DE19%20AAK to the API
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411475/600>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_expert_report_file_a4ceb7d9-6172-4bed-b67a-cd0e0a1ead5d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE19%20AAK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ff522792-d041-5ecb-b231-8bf72c190c1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DE19 AAK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DE19%20AAK&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'MOKKA X',
'odometer': 45234,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41470,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411475/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40463,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411499/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40351,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411520/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41136,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411531/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38532,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411557/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37272,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411573/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93101,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411597/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61050,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411617/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86696,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411643/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff522792-d041-5ecb-b231-8bf72c190c1e/ff522792-d041-5ecb-b231-8bf72c190c1e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67242,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE19AAK/699411666/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL MOKKA X 1.4 T 140 ECOTEC ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'T 140 ECOTEC ACTIVE',
'vin': 'W0VJC7E86KB828487',
'year': 2019}
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE19%2520AAK%27 HTTP/1.1" 200 None
2026-03-29 22:05:14 [bca.uk] INFO: Saving data for DE19%20AAK: {'created_time': 1774821914.799561, 'last_price_update_time': 1774821914.799571, 'auction_closing_time': 1774951200.0}
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DE19%2520AAK') HTTP/1.1" 204 0
2026-03-29 22:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427780/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19VXX/42812304?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=YzGWBhkemG5tXMwAwvYpsWX0bEfwiTWFoG%2FIuzQzr2c%3D)
2026-03-29 22:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406275/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG69FWY/42811982?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=iIU0ZFwxCrfo9iR2T7l%2BEKiHBXHpV%2FjhvFuNPQMcBwU%3D)
2026-03-29 22:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427739/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE20EVL/42811999?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=QNaGwsE1HTKndyV7dS5jfLI1ozyFJBkYcrsiWmkuv8k%3D)
2026-03-29 22:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414858/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ72FOT/42812096?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=F1eqEFipUoySPGKOeLKkFyyLLItl9dJbMFy96XQcSRY%3D)
2026-03-29 22:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411747/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML23KNX/42812081?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Ysjf2AWU3A%2B%2BhkZ4EdoIgPpKhCyN1a54UPjPwLBr1pc%3D)
2026-03-29 22:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411734/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411734>
2026-03-29 22:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427724/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427724>
2026-03-29 22:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427759/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427759>
2026-03-29 22:05:14 [bca.uk] INFO: Found listing with ID: LL12%20WDZ
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL12%2520WDZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:14 [bca.uk] INFO: Scrape type for LL12%20WDZ: 0
2026-03-29 22:05:14 [bca.uk] INFO: Found listing with ID: PE68%20XAZ
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE68%2520XAZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:14 [bca.uk] INFO: Scrape type for PE68%20XAZ: 0
2026-03-29 22:05:14 [bca.uk] INFO: Found listing with ID: YG18%20UUV
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG18%2520UUV%27 HTTP/1.1" 200 None
2026-03-29 22:05:14 [bca.uk] INFO: Scrape type for YG18%20UUV: 0
2026-03-29 22:05:14 [bca.uk] INFO: Found listing with ID: LT63%20TWG
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT63%2520TWG%27 HTTP/1.1" 200 None
2026-03-29 22:05:14 [bca.uk] INFO: Scrape type for LT63%20TWG: 2
2026-03-29 22:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c5e6c38-d66f-5306-991d-10cf32a7ba50 with identifier: LT63%20TWG
2026-03-29 22:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c5e6c38-d66f-5306-991d-10cf32a7ba50 with scrape type 2
2026-03-29 22:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c5e6c38-d66f-5306-991d-10cf32a7ba50 with scrape type 2
2026-03-29 22:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4c5e6c38-d66f-5306-991d-10cf32a7ba50, identifier: LT63%20TWG
2026-03-29 22:05:15 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:05:15 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4c5e6c38-d66f-5306-991d-10cf32a7ba50 with identifier: LT63%20TWG
2026-03-29 22:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4c5e6c38-d66f-5306-991d-10cf32a7ba50 with identifier: LT63%20TWG
2026-03-29 22:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4c5e6c38-d66f-5306-991d-10cf32a7ba50 with identifier: LT63%20TWG to the API
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT63%20TWG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4c5e6c38-d66f-5306-991d-10cf32a7ba50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT63 TWG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT63%20TWG&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VOLVO',
'model': 'XC60',
'odometer': 35667,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'VOLVO XC60 2.0 T5 240 SE P/SHIFT Estate',
'transmission': 'automatic',
'trim': 'T5 240 SE P/SHIFT',
'vin': 'YV1DZ47HBD2443473',
'year': 2024}
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT63%2520TWG%27 HTTP/1.1" 200 None
2026-03-29 22:05:15 [bca.uk] INFO: Saving data for LT63%20TWG: {'auction_closing_time': 1774951200.0, 'created_time': 1774091321.675959, 'last_price_update_time': 1774821915.383324}
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT63%2520TWG') HTTP/1.1" 204 0
2026-03-29 22:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63651ed0>
2026-03-29 22:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_expert_report_file_af75aaa1-2789-494e-b6f7-9ab888b31635.pdf HTTP/1.1" 201 0
2026-03-29 22:05:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a1944c0b-6133-542d-8b41-67a9ddd47893
2026-03-29 22:05:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1944c0b-6133-542d-8b41-67a9ddd47893, skipping ID generation
2026-03-29 22:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1944c0b-6133-542d-8b41-67a9ddd47893
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAE14PLV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AE14PLV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62179e90>
2026-03-29 22:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19VSX%252F699430166%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430166/600 saved to cache
2026-03-29 22:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 732664ff-2041-53f2-83f7-e4a6aeaa1df2
2026-03-29 22:05:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 732664ff-2041-53f2-83f7-e4a6aeaa1df2, skipping ID generation
2026-03-29 22:05:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 732664ff-2041-53f2-83f7-e4a6aeaa1df2 sending to next pipeline
2026-03-29 22:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 732664ff-2041-53f2-83f7-e4a6aeaa1df2, identifier: DC19%20VSX
2026-03-29 22:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61667610>
2026-03-29 22:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FP17LPT%252F686575330%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575330/600 saved to cache
2026-03-29 22:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9
2026-03-29 22:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac697bd810>
2026-03-29 22:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA16ETX%252F699430117%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430117/600 saved to cache
2026-03-29 22:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6398c60-fe63-5a45-a148-79cf4bf62bcf
2026-03-29 22:05:15 [bca.uk] INFO: Found listing with ID: YE64%20WBN
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE64%2520WBN%27 HTTP/1.1" 200 None
2026-03-29 22:05:15 [bca.uk] INFO: Scrape type for YE64%20WBN: 0
2026-03-29 22:05:15 [bca.uk] INFO: Found listing with ID: YH15%20YYU
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH15%2520YYU%27 HTTP/1.1" 200 None
2026-03-29 22:05:15 [bca.uk] INFO: Scrape type for YH15%20YYU: 2
2026-03-29 22:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f3895b4-945b-5e78-af08-4d8d60bb6040 with identifier: YH15%20YYU
2026-03-29 22:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f3895b4-945b-5e78-af08-4d8d60bb6040 with scrape type 2
2026-03-29 22:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f3895b4-945b-5e78-af08-4d8d60bb6040 with scrape type 2
2026-03-29 22:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5f3895b4-945b-5e78-af08-4d8d60bb6040, identifier: YH15%20YYU
2026-03-29 22:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 732664ff-2041-53f2-83f7-e4a6aeaa1df2 with identifier: DC19%20VSX
2026-03-29 22:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 732664ff-2041-53f2-83f7-e4a6aeaa1df2 with identifier: DC19%20VSX
2026-03-29 22:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 732664ff-2041-53f2-83f7-e4a6aeaa1df2 with identifier: DC19%20VSX to the API
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430166/600>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_expert_report_file_be24767a-1357-4e70-8480-91ed11832b34.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DC19%20VSX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '732664ff-2041-53f2-83f7-e4a6aeaa1df2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DC19 VSX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DC19%20VSX&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'LEXUS',
'model': 'RX 450H',
'odometer': 23237,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44984,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430146/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41885,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430166/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43160,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430191/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44567,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430204/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39037,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430221/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35811,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430239/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106082,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430264/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430292/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95111,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430314/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732664ff-2041-53f2-83f7-e4a6aeaa1df2/732664ff-2041-53f2-83f7-e4a6aeaa1df2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19VSX/699430334/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'LEXUS RX 450H 3.5 StationWagon',
'transmission': 'automatic',
'trim': '',
'vin': 'JTJBGMCA802049481',
'year': 2019}
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC19%2520VSX%27 HTTP/1.1" 200 None
2026-03-29 22:05:16 [bca.uk] INFO: Saving data for DC19%20VSX: {'created_time': 1774821916.345767, 'last_price_update_time': 1774821916.345779, 'auction_closing_time': 1774951200.0}
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DC19%2520VSX') HTTP/1.1" 204 0
2026-03-29 22:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5f3895b4-945b-5e78-af08-4d8d60bb6040 with identifier: YH15%20YYU
2026-03-29 22:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5f3895b4-945b-5e78-af08-4d8d60bb6040 with identifier: YH15%20YYU
2026-03-29 22:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5f3895b4-945b-5e78-af08-4d8d60bb6040 with identifier: YH15%20YYU to the API
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH15%20YYU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5f3895b4-945b-5e78-af08-4d8d60bb6040',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH15 YYU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH15%20YYU&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FIAT',
'model': 'PANDA',
'odometer': 25255,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FIAT PANDA 1.2 POP Hatchback',
'transmission': 'manual',
'trim': 'POP',
'vin': 'ZFA31200003456116',
'year': 2015}
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH15%2520YYU%27 HTTP/1.1" 200 None
2026-03-29 22:05:16 [bca.uk] INFO: Saving data for YH15%20YYU: {'auction_closing_time': 1774951200.0, 'created_time': 1774610538.120952, 'last_price_update_time': 1774821916.691403}
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH15%2520YYU') HTTP/1.1" 204 0
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455892%27 HTTP/1.1" 200 None
2026-03-29 22:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455892 not downloaded yet
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6369d090>
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19VXX%252F699427780%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427780/600 saved to cache
2026-03-29 22:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 553a9526-308c-5e9f-97f5-1bce769f99d7
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6225aa50>
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG69FWY%252F699406275%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406275/600 saved to cache
2026-03-29 22:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23673480-b7c5-5707-903a-2783d4797f75
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6192ca50>
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE20EVL%252F699427739%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427739/600 saved to cache
2026-03-29 22:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b145ed4d-e096-5329-b7ec-7396067fba60
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac60ffe3d0>
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ72FOT%252F699414858%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414858/600 saved to cache
2026-03-29 22:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6192e410>
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML23KNX%252F699411747%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411747/600 saved to cache
2026-03-29 22:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c96e7ad0-7cd4-5ea7-b41d-642972a2bf14
2026-03-29 22:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430088/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA16ETX/42812131?sv=2020-08-04&st=2026-03-29T22%3A00%3A57Z&se=2026-03-29T22%3A25%3A57Z&sr=b&sp=r&sig=67cSoD7yDAcPlVUXb6MtFxB8b%2F%2B%2FHPzK%2FRcqJHz%2FIwo%3D)
2026-03-29 22:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575322/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/P17LPT/42573216?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Cei94j6xTuVsYVAtMEIEaOIhWn8jpASCTY7XqjpVl64%3D)
2026-03-29 22:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409166/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PA19DCO/42811984?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=5dad8F2568bHOl2s5RwggeSpVONMrl6yr8ByaoDJDOc%3D)
2026-03-29 22:05:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414854/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414854>
2026-03-29 22:05:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN62HLC/42810081?sv=2020-08-04&st=2026-03-29T22%3A05%3A15Z&se=2026-03-29T22%3A30%3A15Z&sr=b&sp=r&sig=7S8WdQ3gHe92IypMlrTOVxGXU1Uqv27G6oYLRI%2FeI0k%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LN62%20HLC-GB>
2026-03-29 22:05:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406251/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406251>
2026-03-29 22:05:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409147/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409147>
2026-03-29 22:05:16 [bca.uk] INFO: Found listing with ID: YE16%20BNZ
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE16%2520BNZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:16 [bca.uk] INFO: Scrape type for YE16%20BNZ: 0
2026-03-29 22:05:16 [bca.uk] INFO: Found listing with ID: AO67%20AHU
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO67%2520AHU%27 HTTP/1.1" 200 None
2026-03-29 22:05:16 [bca.uk] INFO: Scrape type for AO67%20AHU: 0
2026-03-29 22:05:16 [bca.uk] INFO: Found listing with ID: AX15%20GHV
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX15%2520GHV%27 HTTP/1.1" 200 None
2026-03-29 22:05:16 [bca.uk] INFO: Scrape type for AX15%20GHV: 2
2026-03-29 22:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 605bb574-f032-5f24-9f53-91befb051fec with identifier: AX15%20GHV
2026-03-29 22:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 605bb574-f032-5f24-9f53-91befb051fec with scrape type 2
2026-03-29 22:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 605bb574-f032-5f24-9f53-91befb051fec with scrape type 2
2026-03-29 22:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 605bb574-f032-5f24-9f53-91befb051fec, identifier: AX15%20GHV
2026-03-29 22:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 605bb574-f032-5f24-9f53-91befb051fec with identifier: AX15%20GHV
2026-03-29 22:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 605bb574-f032-5f24-9f53-91befb051fec with identifier: AX15%20GHV
2026-03-29 22:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 605bb574-f032-5f24-9f53-91befb051fec with identifier: AX15%20GHV to the API
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 97,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AX15%20GHV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '605bb574-f032-5f24-9f53-91befb051fec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AX15 GHV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AX15%20GHV&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'SMART',
'model': 'FORFOUR',
'odometer': 69453,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'SMART FORFOUR 1.0 71 PASSION Hatchback',
'transmission': 'manual',
'trim': '71 PASSION',
'vin': 'WME4530422Y017504',
'year': 2015}
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX15%2520GHV%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Saving data for AX15%20GHV: {'auction_closing_time': 1774864800.0, 'created_time': 1774706818.411565, 'last_price_update_time': 1774821917.40921}
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AX15%2520GHV') HTTP/1.1" 204 0
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455895%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455895 not downloaded yet
2026-03-29 22:05:17 [bca.uk] INFO: Found listing with ID: BL14%20HCA
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL14%2520HCA%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Scrape type for BL14%20HCA: 0
2026-03-29 22:05:17 [bca.uk] INFO: Found listing with ID: SE14%20HLX
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE14%2520HLX%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Scrape type for SE14%20HLX: 0
2026-03-29 22:05:17 [bca.uk] INFO: Found listing with ID: SW15%20DBY
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW15%2520DBY%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Scrape type for SW15%20DBY: 0
2026-03-29 22:05:17 [bca.uk] INFO: Found listing with ID: V888%20KPD
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V888%2520KPD%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Scrape type for V888%20KPD: 0
2026-03-29 22:05:17 [bca.uk] INFO: Found listing with ID: YA65%20UKW
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA65%2520UKW%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Scrape type for YA65%20UKW: 0
2026-03-29 22:05:17 [bca.uk] INFO: Found listing with ID: YS64%20XOK
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS64%2520XOK%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Scrape type for YS64%20XOK: 0
2026-03-29 22:05:17 [bca.uk] INFO: Found listing with ID: KD06%20PWY
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KD06%2520PWY%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Scrape type for KD06%20PWY: 0
2026-03-29 22:05:17 [bca.uk] INFO: Found listing with ID: YT60%20ORY
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT60%2520ORY%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Scrape type for YT60%20ORY: 0
2026-03-29 22:05:17 [bca.uk] INFO: Found listing with ID: AO60%20TNJ
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO60%2520TNJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Scrape type for AO60%20TNJ: 0
2026-03-29 22:05:17 [bca.uk] INFO: Found listing with ID: CE12%20XPW
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE12%2520XPW%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Scrape type for CE12%20XPW: 0
2026-03-29 22:05:17 [bca.uk] INFO: Found listing with ID: GF62%20UBR
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF62%2520UBR%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Scrape type for GF62%20UBR: 0
2026-03-29 22:05:17 [bca.uk] INFO: Found listing with ID: GY58%20YRU
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY58%2520YRU%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Scrape type for GY58%20YRU: 0
2026-03-29 22:05:17 [bca.uk] INFO: Found listing with ID: MT61%20NXP
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT61%2520NXP%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Scrape type for MT61%20NXP: 0
2026-03-29 22:05:17 [bca.uk] INFO: Found listing with ID: PK58%20XAE
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK58%2520XAE%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Scrape type for PK58%20XAE: 0
2026-03-29 22:05:17 [bca.uk] INFO: Found listing with ID: SK60%20OFB
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK60%2520OFB%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Scrape type for SK60%20OFB: 0
2026-03-29 22:05:17 [bca.uk] INFO: Found listing with ID: YB63%20ZKP
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB63%2520ZKP%27 HTTP/1.1" 200 None
2026-03-29 22:05:17 [bca.uk] INFO: Scrape type for YB63%20ZKP: 2
2026-03-29 22:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 243a05a7-7cda-5444-ab1c-5fdc014fa410 with identifier: YB63%20ZKP
2026-03-29 22:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 243a05a7-7cda-5444-ab1c-5fdc014fa410 with scrape type 2
2026-03-29 22:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 243a05a7-7cda-5444-ab1c-5fdc014fa410 with scrape type 2
2026-03-29 22:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 243a05a7-7cda-5444-ab1c-5fdc014fa410, identifier: YB63%20ZKP
2026-03-29 22:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427724/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RE20EVL/42811999?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=QNaGwsE1HTKndyV7dS5jfLI1ozyFJBkYcrsiWmkuv8k%3D)
2026-03-29 22:05:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414850/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414850>
2026-03-29 22:05:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406232/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406232>
2026-03-29 22:05:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411725/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ML23KNX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:05:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT14HGA/42812005?sv=2020-08-04&st=2026-03-29T22%3A05%3A17Z&se=2026-03-29T22%3A30%3A17Z&sr=b&sp=r&sig=waPrjmAums3L%2FvFzJ%2Fhg5dv7M7RjxxPDejipYOMZYCI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT14%20HGA-GB>
2026-03-29 22:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411734/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML23KNX/42812081?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Ysjf2AWU3A%2B%2BhkZ4EdoIgPpKhCyN1a54UPjPwLBr1pc%3D)
2026-03-29 22:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427759/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM19VXX/42812304?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=YzGWBhkemG5tXMwAwvYpsWX0bEfwiTWFoG%2FIuzQzr2c%3D)
2026-03-29 22:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 243a05a7-7cda-5444-ab1c-5fdc014fa410 with identifier: YB63%20ZKP
2026-03-29 22:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 243a05a7-7cda-5444-ab1c-5fdc014fa410 with identifier: YB63%20ZKP
2026-03-29 22:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 243a05a7-7cda-5444-ab1c-5fdc014fa410 with identifier: YB63%20ZKP to the API
2026-03-29 22:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 100,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YB63%20ZKP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '243a05a7-7cda-5444-ab1c-5fdc014fa410',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YB63 ZKP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YB63%20ZKP&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'KIA',
'model': 'CEED',
'odometer': 97483,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'KIA CEED 1.6 CRDI 126 E/D 3 Hatchback',
'transmission': 'manual',
'trim': 'CRDI 126 E/D 3',
'vin': 'U5YHN516LEL119806',
'year': 2014}
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB63%2520ZKP%27 HTTP/1.1" 200 None
2026-03-29 22:05:18 [bca.uk] INFO: Saving data for YB63%20ZKP: {'auction_closing_time': 1774864800.0, 'created_time': 1774706778.097048, 'last_price_update_time': 1774821918.197123}
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YB63%2520ZKP') HTTP/1.1" 204 0
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455896%27 HTTP/1.1" 200 None
2026-03-29 22:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455896 not downloaded yet
2026-03-29 22:05:18 [bca.uk] INFO: Found listing with ID: BF08%20KPJ
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF08%2520KPJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:18 [bca.uk] INFO: Scrape type for BF08%20KPJ: 0
2026-03-29 22:05:18 [bca.uk] INFO: Found listing with ID: DE05%20BXV
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE05%2520BXV%27 HTTP/1.1" 200 None
2026-03-29 22:05:18 [bca.uk] INFO: Scrape type for DE05%20BXV: 0
2026-03-29 22:05:18 [bca.uk] INFO: Found listing with ID: GJ58%20HSC
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ58%2520HSC%27 HTTP/1.1" 200 None
2026-03-29 22:05:18 [bca.uk] INFO: Scrape type for GJ58%20HSC: 0
2026-03-29 22:05:18 [bca.uk] INFO: Found listing with ID: GN08%20YVR
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN08%2520YVR%27 HTTP/1.1" 200 None
2026-03-29 22:05:18 [bca.uk] INFO: Scrape type for GN08%20YVR: 0
2026-03-29 22:05:18 [bca.uk] INFO: Found listing with ID: OY63%20EWL
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY63%2520EWL%27 HTTP/1.1" 200 None
2026-03-29 22:05:18 [bca.uk] INFO: Scrape type for OY63%20EWL: 0
2026-03-29 22:05:18 [bca.uk] INFO: Found listing with ID: VO59%20ZFX
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO59%2520ZFX%27 HTTP/1.1" 200 None
2026-03-29 22:05:18 [bca.uk] INFO: Scrape type for VO59%20ZFX: 0
2026-03-29 22:05:18 [bca.uk] INFO: Found listing with ID: CE56%20FYG
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE56%2520FYG%27 HTTP/1.1" 200 None
2026-03-29 22:05:18 [bca.uk] INFO: Scrape type for CE56%20FYG: 0
2026-03-29 22:05:18 [bca.uk] INFO: Found listing with ID: FV62%20YZH
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV62%2520YZH%27 HTTP/1.1" 200 None
2026-03-29 22:05:18 [bca.uk] INFO: Scrape type for FV62%20YZH: 0
2026-03-29 22:05:18 [bca.uk] INFO: Found listing with ID: NC06%20ENK
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC06%2520ENK%27 HTTP/1.1" 200 None
2026-03-29 22:05:18 [bca.uk] INFO: Scrape type for NC06%20ENK: 0
2026-03-29 22:05:18 [bca.uk] INFO: Found listing with ID: RY03%20RYA
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY03%2520RYA%27 HTTP/1.1" 200 None
2026-03-29 22:05:18 [bca.uk] INFO: Scrape type for RY03%20RYA: 0
2026-03-29 22:05:18 [bca.uk] INFO: Found listing with ID: YK60%20MHY
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK60%2520MHY%27 HTTP/1.1" 200 None
2026-03-29 22:05:18 [bca.uk] INFO: Scrape type for YK60%20MHY: 2
2026-03-29 22:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 108bcc7d-bfdd-5104-aa35-f2b42cf4fbc7 with identifier: YK60%20MHY
2026-03-29 22:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 108bcc7d-bfdd-5104-aa35-f2b42cf4fbc7 with scrape type 2
2026-03-29 22:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 108bcc7d-bfdd-5104-aa35-f2b42cf4fbc7 with scrape type 2
2026-03-29 22:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 108bcc7d-bfdd-5104-aa35-f2b42cf4fbc7, identifier: YK60%20MHY
2026-03-29 22:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 108bcc7d-bfdd-5104-aa35-f2b42cf4fbc7 with identifier: YK60%20MHY
2026-03-29 22:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 108bcc7d-bfdd-5104-aa35-f2b42cf4fbc7 with identifier: YK60%20MHY
2026-03-29 22:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 108bcc7d-bfdd-5104-aa35-f2b42cf4fbc7 with identifier: YK60%20MHY to the API
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK60%20MHY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '108bcc7d-bfdd-5104-aa35-f2b42cf4fbc7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK60 MHY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK60%20MHY&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': '118D',
'odometer': 118672,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'BMW 118D 2.0 M SPORT Hatchback',
'transmission': 'manual',
'trim': 'M SPORT',
'vin': 'WBAUB32070VG00818',
'year': 2010}
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK60%2520MHY%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Saving data for YK60%20MHY: {'auction_closing_time': 1774864800.0, 'created_time': 1774620444.801986, 'last_price_update_time': 1774821919.01994}
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK60%2520MHY') HTTP/1.1" 204 0
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455899%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455899 not downloaded yet
2026-03-29 22:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617ae690>
2026-03-29 22:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA16ETX%252F699430088%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430088/600 saved to cache
2026-03-29 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6398c60-fe63-5a45-a148-79cf4bf62bcf
2026-03-29 22:05:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6398c60-fe63-5a45-a148-79cf4bf62bcf, skipping ID generation
2026-03-29 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6398c60-fe63-5a45-a148-79cf4bf62bcf sending to next pipeline
2026-03-29 22:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d6398c60-fe63-5a45-a148-79cf4bf62bcf, identifier: MA16%20ETX
2026-03-29 22:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61502c10>
2026-03-29 22:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FP17LPT%252F686575322%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575322/600 saved to cache
2026-03-29 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9
2026-03-29 22:05:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9, skipping ID generation
2026-03-29 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9 sending to next pipeline
2026-03-29 22:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9, identifier: P17%20LPT
2026-03-29 22:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636e5e50>
2026-03-29 22:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPA19DCO%252F699409166%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409166/600 saved to cache
2026-03-29 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da397772-3003-5876-84de-18e19f2e1e0e
2026-03-29 22:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409147/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PA19DCO/42811984?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=5dad8F2568bHOl2s5RwggeSpVONMrl6yr8ByaoDJDOc%3D)
2026-03-29 22:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406251/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG69FWY/42811982?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=iIU0ZFwxCrfo9iR2T7l%2BEKiHBXHpV%2FjhvFuNPQMcBwU%3D)
2026-03-29 22:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414854/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ72FOT/42812096?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=F1eqEFipUoySPGKOeLKkFyyLLItl9dJbMFy96XQcSRY%3D)
2026-03-29 22:05:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409130/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409130>
2026-03-29 22:05:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455889/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AE14PLV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:05:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT66YMF/42812098?sv=2020-08-04&st=2026-03-29T22%3A05%3A18Z&se=2026-03-29T22%3A30%3A18Z&sr=b&sp=r&sig=vvtbY7lfWyfzUXxJcw4PY0HqZZ37wGJm65zbIBo7KHs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YT66%20YMF-GB>
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: KN13%20ZMX
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN13%2520ZMX%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for KN13%20ZMX: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: KR63%20YFY
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR63%2520YFY%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for KR63%20YFY: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: KS61%20VEM
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS61%2520VEM%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for KS61%20VEM: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: LO12%20SYJ
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO12%2520SYJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for LO12%20SYJ: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: LT11%20CZG
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT11%2520CZG%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for LT11%20CZG: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: LT15%20ODK
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT15%2520ODK%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for LT15%20ODK: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: NL61%20SUX
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL61%2520SUX%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for NL61%20SUX: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: OY57%20WCL
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY57%2520WCL%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for OY57%20WCL: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: RE62%20UHU
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE62%2520UHU%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for RE62%20UHU: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: AO63%20VKT
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO63%2520VKT%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for AO63%20VKT: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: DK65%20MLU
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK65%2520MLU%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for DK65%20MLU: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: EK61%20WNP
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK61%2520WNP%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for EK61%20WNP: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: EO14%20MLL
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO14%2520MLL%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for EO14%20MLL: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: FN13%20VTE
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN13%2520VTE%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for FN13%20VTE: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: GF12%20ZVG
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF12%2520ZVG%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for GF12%20ZVG: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: GJ14%20KEK
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ14%2520KEK%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for GJ14%20KEK: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: GL12%20SGX
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL12%2520SGX%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for GL12%20SGX: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: GV11%20WJM
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV11%2520WJM%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for GV11%20WJM: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: GY59%20BWK
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY59%2520BWK%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for GY59%20BWK: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: HG12%20NLX
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG12%2520NLX%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for HG12%20NLX: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: HK57%20KTP
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK57%2520KTP%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for HK57%20KTP: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: HK65%20ZWD
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK65%2520ZWD%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for HK65%20ZWD: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: AJ62%20RFN
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ62%2520RFN%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for AJ62%20RFN: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: YG24%20RGT
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG24%2520RGT%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for YG24%20RGT: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: LD75%20AOL
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD75%2520AOL%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for LD75%20AOL: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: BP17%20UCL
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP17%2520UCL%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for BP17%20UCL: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: DV15%20DSO
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV15%2520DSO%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for DV15%20DSO: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: KV66%20KTA
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV66%2520KTA%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for KV66%20KTA: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: YB64%20PVZ
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB64%2520PVZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for YB64%20PVZ: 0
2026-03-29 22:05:19 [bca.uk] INFO: Found listing with ID: YH65%20MFP
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH65%2520MFP%27 HTTP/1.1" 200 None
2026-03-29 22:05:19 [bca.uk] INFO: Scrape type for YH65%20MFP: 2
2026-03-29 22:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e97839e-4922-5d7c-8472-91f9e3bdb4f8 with identifier: YH65%20MFP
2026-03-29 22:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e97839e-4922-5d7c-8472-91f9e3bdb4f8 with scrape type 2
2026-03-29 22:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e97839e-4922-5d7c-8472-91f9e3bdb4f8 with scrape type 2
2026-03-29 22:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1e97839e-4922-5d7c-8472-91f9e3bdb4f8, identifier: YH65%20MFP
2026-03-29 22:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d6398c60-fe63-5a45-a148-79cf4bf62bcf with identifier: MA16%20ETX
2026-03-29 22:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d6398c60-fe63-5a45-a148-79cf4bf62bcf with identifier: MA16%20ETX
2026-03-29 22:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d6398c60-fe63-5a45-a148-79cf4bf62bcf with identifier: MA16%20ETX to the API
2026-03-29 22:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430088/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_expert_report_file_1176e29c-014c-447e-a85a-86de31f466f6.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA16%20ETX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd6398c60-fe63-5a45-a148-79cf4bf62bcf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA16 ETX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MA16%20ETX&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FIAT',
'model': '500',
'odometer': 36302,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39441,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430088/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37240,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430117/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37922,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430132/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39690,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430144/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35650,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430155/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33595,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430174/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88309,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430208/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65668,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430241/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87022,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430267/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6398c60-fe63-5a45-a148-79cf4bf62bcf/d6398c60-fe63-5a45-a148-79cf4bf62bcf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69103,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA16ETX/699430289/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 POP Hatchback',
'transmission': 'manual',
'trim': 'POP',
'vin': 'ZFA3120000J581088',
'year': 2016}
2026-03-29 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA16%2520ETX%27 HTTP/1.1" 200 None
2026-03-29 22:05:20 [bca.uk] INFO: Saving data for MA16%20ETX: {'created_time': 1774821920.433132, 'last_price_update_time': 1774821920.433147, 'auction_closing_time': 1774951200.0}
2026-03-29 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MA16%2520ETX') HTTP/1.1" 204 0
2026-03-29 22:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9 with identifier: P17%20LPT
2026-03-29 22:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9 with identifier: P17%20LPT
2026-03-29 22:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 47a8c5c5-5bab-5c26-b003-e1739f2ff0e9 with identifier: P17%20LPT to the API
2026-03-29 22:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575322/600>
{'auction_title': '',
'c_o_2_emission_value': 199,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_expert_report_file_8852f554-97c9-481c-bf79-f9587ebdfb9a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=P17%20LPT-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '47a8c5c5-5bab-5c26-b003-e1739f2ff0e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'P17 LPT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=P17%20LPT&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'VOLVO',
'model': 'XC60',
'odometer': 219446,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54845,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575322/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53732,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575330/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50324,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575336/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49045,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575349/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47370,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575354/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46706,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575365/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93773,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575375/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74193,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575390/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91751,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575406/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47a8c5c5-5bab-5c26-b003-e1739f2ff0e9/47a8c5c5-5bab-5c26-b003-e1739f2ff0e9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69418,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/P17LPT/686575421/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VOLVO XC60 2.4 D5 205 R DESIGN SE G/T Estate',
'transmission': 'manual',
'trim': 'D5 205 R DESIGN SE G/T',
'vin': 'YV1DZ7046A2109198',
'year': 2010}
2026-03-29 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P17%2520LPT%27 HTTP/1.1" 200 None
2026-03-29 22:05:20 [bca.uk] INFO: Saving data for P17%20LPT: {'created_time': 1774821920.918098, 'last_price_update_time': 1774821920.918113, 'auction_closing_time': 1775037600.0}
2026-03-29 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='P17%2520LPT') HTTP/1.1" 204 0
2026-03-29 22:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1e97839e-4922-5d7c-8472-91f9e3bdb4f8 with identifier: YH65%20MFP
2026-03-29 22:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1e97839e-4922-5d7c-8472-91f9e3bdb4f8 with identifier: YH65%20MFP
2026-03-29 22:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1e97839e-4922-5d7c-8472-91f9e3bdb4f8 with identifier: YH65%20MFP to the API
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 106,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH65%20MFP-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1e97839e-4922-5d7c-8472-91f9e3bdb4f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH65 MFP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH65%20MFP&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': '420D',
'odometer': 90664,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'BMW 420D 2.0 190 SE STEP Coupe',
'transmission': 'automatic',
'trim': '190 SE STEP',
'vin': 'WBA4P72080K561017',
'year': 2015}
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH65%2520MFP%27 HTTP/1.1" 200 None
2026-03-29 22:05:21 [bca.uk] INFO: Saving data for YH65%20MFP: {'auction_closing_time': 1774864800.0, 'created_time': 1774620419.772268, 'last_price_update_time': 1774821921.293064}
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH65%2520MFP') HTTP/1.1" 204 0
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455900%27 HTTP/1.1" 200 None
2026-03-29 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455900 not downloaded yet
2026-03-29 22:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b46d0>
2026-03-29 22:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRE20EVL%252F699427724%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427724/600 saved to cache
2026-03-29 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b145ed4d-e096-5329-b7ec-7396067fba60
2026-03-29 22:05:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b145ed4d-e096-5329-b7ec-7396067fba60, skipping ID generation
2026-03-29 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b145ed4d-e096-5329-b7ec-7396067fba60 sending to next pipeline
2026-03-29 22:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b145ed4d-e096-5329-b7ec-7396067fba60, identifier: RE20%20EVL
2026-03-29 22:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62152fd0>
2026-03-29 22:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML23KNX%252F699411734%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411734/600 saved to cache
2026-03-29 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c96e7ad0-7cd4-5ea7-b41d-642972a2bf14
2026-03-29 22:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636e4690>
2026-03-29 22:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM19VXX%252F699427759%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427759/600 saved to cache
2026-03-29 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 553a9526-308c-5e9f-97f5-1bce769f99d7
2026-03-29 22:05:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 553a9526-308c-5e9f-97f5-1bce769f99d7, skipping ID generation
2026-03-29 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 553a9526-308c-5e9f-97f5-1bce769f99d7 sending to next pipeline
2026-03-29 22:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 553a9526-308c-5e9f-97f5-1bce769f99d7, identifier: YM19%20VXX
2026-03-29 22:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN62HLC/42810081?sv=2020-08-04&st=2026-03-29T22%3A05%3A15Z&se=2026-03-29T22%3A30%3A15Z&sr=b&sp=r&sig=7S8WdQ3gHe92IypMlrTOVxGXU1Uqv27G6oYLRI%2FeI0k%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:05:21 [bca.uk] INFO: Found listing with ID: HT10%20PCY
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT10%2520PCY%27 HTTP/1.1" 200 None
2026-03-29 22:05:21 [bca.uk] INFO: Scrape type for HT10%20PCY: 0
2026-03-29 22:05:21 [bca.uk] INFO: Found listing with ID: RA66%20OVT
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA66%2520OVT%27 HTTP/1.1" 200 None
2026-03-29 22:05:21 [bca.uk] INFO: Scrape type for RA66%20OVT: 0
2026-03-29 22:05:21 [bca.uk] INFO: Found listing with ID: FN64%20MFZ
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN64%2520MFZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:21 [bca.uk] INFO: Scrape type for FN64%20MFZ: 0
2026-03-29 22:05:21 [bca.uk] INFO: Found listing with ID: KN15%20KNH
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN15%2520KNH%27 HTTP/1.1" 200 None
2026-03-29 22:05:21 [bca.uk] INFO: Scrape type for KN15%20KNH: 0
2026-03-29 22:05:21 [bca.uk] INFO: Found listing with ID: SA68%20XMR
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA68%2520XMR%27 HTTP/1.1" 200 None
2026-03-29 22:05:21 [bca.uk] INFO: Scrape type for SA68%20XMR: 0
2026-03-29 22:05:21 [bca.uk] INFO: Found listing with ID: MV68%20YPF
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV68%2520YPF%27 HTTP/1.1" 200 None
2026-03-29 22:05:21 [bca.uk] INFO: Scrape type for MV68%20YPF: 0
2026-03-29 22:05:21 [bca.uk] INFO: Found listing with ID: FV64%20AUX
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV64%2520AUX%27 HTTP/1.1" 200 None
2026-03-29 22:05:21 [bca.uk] INFO: Scrape type for FV64%20AUX: 0
2026-03-29 22:05:21 [bca.uk] INFO: Found listing with ID: GY64%20VCN
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY64%2520VCN%27 HTTP/1.1" 200 None
2026-03-29 22:05:21 [bca.uk] INFO: Scrape type for GY64%20VCN: 0
2026-03-29 22:05:21 [bca.uk] INFO: Found listing with ID: FXZ%209529
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FXZ%25209529%27 HTTP/1.1" 200 None
2026-03-29 22:05:21 [bca.uk] INFO: Scrape type for FXZ%209529: 0
2026-03-29 22:05:21 [bca.uk] INFO: Found listing with ID: YH09%20UFX
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH09%2520UFX%27 HTTP/1.1" 200 None
2026-03-29 22:05:21 [bca.uk] INFO: Scrape type for YH09%20UFX: 0
2026-03-29 22:05:21 [bca.uk] INFO: Found listing with ID: YK02%20UWL
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK02%2520UWL%27 HTTP/1.1" 200 None
2026-03-29 22:05:21 [bca.uk] INFO: Scrape type for YK02%20UWL: 0
2026-03-29 22:05:21 [bca.uk] INFO: Found listing with ID: N300%20GRA
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27N300%2520GRA%27 HTTP/1.1" 200 None
2026-03-29 22:05:21 [bca.uk] INFO: Scrape type for N300%20GRA: 0
2026-03-29 22:05:21 [bca.uk] INFO: Found listing with ID: YE13%20NRJ
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE13%2520NRJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:21 [bca.uk] INFO: Scrape type for YE13%20NRJ: 2
2026-03-29 22:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fad820b3-6244-5bcc-941a-5f37176bfa6e with identifier: YE13%20NRJ
2026-03-29 22:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fad820b3-6244-5bcc-941a-5f37176bfa6e with scrape type 2
2026-03-29 22:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fad820b3-6244-5bcc-941a-5f37176bfa6e with scrape type 2
2026-03-29 22:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fad820b3-6244-5bcc-941a-5f37176bfa6e, identifier: YE13%20NRJ
2026-03-29 22:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b145ed4d-e096-5329-b7ec-7396067fba60 with identifier: RE20%20EVL
2026-03-29 22:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b145ed4d-e096-5329-b7ec-7396067fba60 with identifier: RE20%20EVL
2026-03-29 22:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b145ed4d-e096-5329-b7ec-7396067fba60 with identifier: RE20%20EVL to the API
2026-03-29 22:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427724/600>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_expert_report_file_02b98ad6-d8ae-4021-b0bd-c690373febcb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RE20%20EVL-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b145ed4d-e096-5329-b7ec-7396067fba60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RE20 EVL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RE20%20EVL&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'AUDI',
'model': 'A4 AVANT',
'odometer': 77269,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39597,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427715/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36857,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427724/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37525,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427739/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39139,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427752/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35790,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427767/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32798,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427776/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82452,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427805/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75585,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427824/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85012,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427838/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b145ed4d-e096-5329-b7ec-7396067fba60/b145ed4d-e096-5329-b7ec-7396067fba60_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83967,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RE20EVL/699427855/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'AUDI A4 AVANT 2.0 35 TDI BLACK ED.S-T Estate',
'transmission': 'automatic',
'trim': '35 TDI BLACK ED.S-T',
'vin': 'WAUZZZF41LA075118',
'year': 2020}
2026-03-29 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE20%2520EVL%27 HTTP/1.1" 200 None
2026-03-29 22:05:22 [bca.uk] INFO: Saving data for RE20%20EVL: {'created_time': 1774821922.357822, 'last_price_update_time': 1774821922.357834, 'auction_closing_time': 1774951200.0}
2026-03-29 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RE20%2520EVL') HTTP/1.1" 204 0
2026-03-29 22:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 553a9526-308c-5e9f-97f5-1bce769f99d7 with identifier: YM19%20VXX
2026-03-29 22:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 553a9526-308c-5e9f-97f5-1bce769f99d7 with identifier: YM19%20VXX
2026-03-29 22:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 553a9526-308c-5e9f-97f5-1bce769f99d7 with identifier: YM19%20VXX to the API
2026-03-29 22:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427759/600>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_expert_report_file_bcb86ac9-86d8-40f1-9d91-14d0a0b350de.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM19%20VXX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '553a9526-308c-5e9f-97f5-1bce769f99d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YM19 VXX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YM19%20VXX&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FIAT',
'model': '500X',
'odometer': 40891,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43540,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427749/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41611,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427759/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41256,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427780/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43070,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427830/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40733,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427841/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38106,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427853/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88017,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427864/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78657,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427884/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95689,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427899/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a9526-308c-5e9f-97f5-1bce769f99d7/553a9526-308c-5e9f-97f5-1bce769f99d7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84104,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM19VXX/699427908/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FIAT 500X 1.0 M/AIR CITY CROSS Hatchback',
'transmission': 'manual',
'trim': 'M/AIR CITY CROSS',
'vin': 'ZFA3340000P771751',
'year': 2019}
2026-03-29 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM19%2520VXX%27 HTTP/1.1" 200 None
2026-03-29 22:05:22 [bca.uk] INFO: Saving data for YM19%20VXX: {'created_time': 1774821922.877016, 'last_price_update_time': 1774821922.877033, 'auction_closing_time': 1774951200.0}
2026-03-29 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YM19%2520VXX') HTTP/1.1" 204 0
2026-03-29 22:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fad820b3-6244-5bcc-941a-5f37176bfa6e with identifier: YE13%20NRJ
2026-03-29 22:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fad820b3-6244-5bcc-941a-5f37176bfa6e with identifier: YE13%20NRJ
2026-03-29 22:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fad820b3-6244-5bcc-941a-5f37176bfa6e with identifier: YE13%20NRJ to the API
2026-03-29 22:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 162,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YE13%20NRJ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'fad820b3-6244-5bcc-941a-5f37176bfa6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YE13 NRJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YE13%20NRJ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'KUGA',
'odometer': 109943,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 163 4WD TITANIUM X P/S StationWagon',
'transmission': 'automatic',
'trim': 'TDCI 163 4WD TITANIUM X P/S',
'vin': 'WF0AXXWPMADB53535',
'year': 2013}
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE13%2520NRJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:23 [bca.uk] INFO: Saving data for YE13%20NRJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774620430.177903, 'last_price_update_time': 1774821923.254175}
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YE13%2520NRJ') HTTP/1.1" 204 0
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455903%27 HTTP/1.1" 200 None
2026-03-29 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455903 not downloaded yet
2026-03-29 22:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411725/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML23KNX/42812081?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=Ysjf2AWU3A%2B%2BhkZ4EdoIgPpKhCyN1a54UPjPwLBr1pc%3D)
2026-03-29 22:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406232/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG69FWY/42811982?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=iIU0ZFwxCrfo9iR2T7l%2BEKiHBXHpV%2FjhvFuNPQMcBwU%3D)
2026-03-29 22:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414850/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ72FOT/42812096?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=F1eqEFipUoySPGKOeLKkFyyLLItl9dJbMFy96XQcSRY%3D)
2026-03-29 22:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT14HGA/42812005?sv=2020-08-04&st=2026-03-29T22%3A05%3A17Z&se=2026-03-29T22%3A30%3A17Z&sr=b&sp=r&sig=waPrjmAums3L%2FvFzJ%2Fhg5dv7M7RjxxPDejipYOMZYCI%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:05:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455895/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455895>
2026-03-29 22:05:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455892/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455892>
2026-03-29 22:05:23 [bca.uk] INFO: Found listing with ID: OY11%20MFP
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY11%2520MFP%27 HTTP/1.1" 200 None
2026-03-29 22:05:23 [bca.uk] INFO: Scrape type for OY11%20MFP: 0
2026-03-29 22:05:23 [bca.uk] INFO: Found listing with ID: PE59%20GHB
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE59%2520GHB%27 HTTP/1.1" 200 None
2026-03-29 22:05:23 [bca.uk] INFO: Scrape type for PE59%20GHB: 0
2026-03-29 22:05:23 [bca.uk] INFO: Found listing with ID: PJ60%20OUY
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ60%2520OUY%27 HTTP/1.1" 200 None
2026-03-29 22:05:23 [bca.uk] INFO: Scrape type for PJ60%20OUY: 2
2026-03-29 22:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f618f4b-5e99-508f-98d8-647fd7a1f772 with identifier: PJ60%20OUY
2026-03-29 22:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f618f4b-5e99-508f-98d8-647fd7a1f772 with scrape type 2
2026-03-29 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f618f4b-5e99-508f-98d8-647fd7a1f772 with scrape type 2
2026-03-29 22:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1f618f4b-5e99-508f-98d8-647fd7a1f772, identifier: PJ60%20OUY
2026-03-29 22:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63604c90>
2026-03-29 22:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPA19DCO%252F699409147%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409147/600 saved to cache
2026-03-29 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da397772-3003-5876-84de-18e19f2e1e0e
2026-03-29 22:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6197c190>
2026-03-29 22:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG69FWY%252F699406251%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406251/600 saved to cache
2026-03-29 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23673480-b7c5-5707-903a-2783d4797f75
2026-03-29 22:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6207a490>
2026-03-29 22:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ72FOT%252F699414854%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414854/600 saved to cache
2026-03-29 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a
2026-03-29 22:05:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409119/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PA19DCO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1f618f4b-5e99-508f-98d8-647fd7a1f772 with identifier: PJ60%20OUY
2026-03-29 22:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1f618f4b-5e99-508f-98d8-647fd7a1f772 with identifier: PJ60%20OUY
2026-03-29 22:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1f618f4b-5e99-508f-98d8-647fd7a1f772 with identifier: PJ60%20OUY to the API
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 327,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ60%20OUY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1f618f4b-5e99-508f-98d8-647fd7a1f772',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ60 OUY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ60%20OUY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MINI',
'model': 'FIRST',
'odometer': 101076,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'MINI FIRST 1.6 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWSR12080TZ98122',
'year': 2010}
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ60%2520OUY%27 HTTP/1.1" 200 None
2026-03-29 22:05:23 [bca.uk] INFO: Saving data for PJ60%20OUY: {'auction_closing_time': 1774864800.0, 'created_time': 1774610875.568281, 'last_price_update_time': 1774821923.891763}
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ60%2520OUY') HTTP/1.1" 204 0
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455907%27 HTTP/1.1" 200 None
2026-03-29 22:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455907 not downloaded yet
2026-03-29 22:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:05:23 [bca.uk] INFO: Found listing with ID: PX16%20OFH
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX16%2520OFH%27 HTTP/1.1" 200 None
2026-03-29 22:05:23 [bca.uk] INFO: Scrape type for PX16%20OFH: 0
2026-03-29 22:05:23 [bca.uk] INFO: Found listing with ID: SW59%20GZN
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW59%2520GZN%27 HTTP/1.1" 200 None
2026-03-29 22:05:23 [bca.uk] INFO: Scrape type for SW59%20GZN: 0
2026-03-29 22:05:23 [bca.uk] INFO: Found listing with ID: VE14%20HHP
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE14%2520HHP%27 HTTP/1.1" 200 None
2026-03-29 22:05:23 [bca.uk] INFO: Scrape type for VE14%20HHP: 0
2026-03-29 22:05:23 [bca.uk] INFO: Found listing with ID: WU66%20PXJ
2026-03-29 22:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU66%2520PXJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [bca.uk] INFO: Scrape type for WU66%20PXJ: 0
2026-03-29 22:05:24 [bca.uk] INFO: Found listing with ID: YH11%20CYZ
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH11%2520CYZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [bca.uk] INFO: Scrape type for YH11%20CYZ: 0
2026-03-29 22:05:24 [bca.uk] INFO: Found listing with ID: YR63%20JXD
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR63%2520JXD%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [bca.uk] INFO: Scrape type for YR63%20JXD: 0
2026-03-29 22:05:24 [bca.uk] INFO: Found listing with ID: CV65%20RRY
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV65%2520RRY%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [bca.uk] INFO: Scrape type for CV65%20RRY: 0
2026-03-29 22:05:24 [bca.uk] INFO: Found listing with ID: DG14%20PDV
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG14%2520PDV%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [bca.uk] INFO: Scrape type for DG14%20PDV: 0
2026-03-29 22:05:24 [bca.uk] INFO: Found listing with ID: DU13%20AUM
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU13%2520AUM%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [bca.uk] INFO: Scrape type for DU13%20AUM: 0
2026-03-29 22:05:24 [bca.uk] INFO: Found listing with ID: EO62%20BFE
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO62%2520BFE%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [bca.uk] INFO: Scrape type for EO62%20BFE: 0
2026-03-29 22:05:24 [bca.uk] INFO: Found listing with ID: FL10%20FKN
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL10%2520FKN%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [bca.uk] INFO: Scrape type for FL10%20FKN: 0
2026-03-29 22:05:24 [bca.uk] INFO: Found listing with ID: MA60%20UTM
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA60%2520UTM%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [bca.uk] INFO: Scrape type for MA60%20UTM: 0
2026-03-29 22:05:24 [bca.uk] INFO: Found listing with ID: MA61%20RWZ
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA61%2520RWZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [bca.uk] INFO: Scrape type for MA61%20RWZ: 0
2026-03-29 22:05:24 [bca.uk] INFO: Found listing with ID: MF12%20NUV
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF12%2520NUV%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [bca.uk] INFO: Scrape type for MF12%20NUV: 0
2026-03-29 22:05:24 [bca.uk] INFO: Found listing with ID: ML08%20UCY
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML08%2520UCY%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [bca.uk] INFO: Scrape type for ML08%20UCY: 0
2026-03-29 22:05:24 [bca.uk] INFO: Found listing with ID: MT12%20ZNR
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT12%2520ZNR%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [bca.uk] INFO: Scrape type for MT12%20ZNR: 0
2026-03-29 22:05:24 [bca.uk] INFO: Found listing with ID: MT60%20JXW
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT60%2520JXW%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [bca.uk] INFO: Scrape type for MT60%20JXW: 0
2026-03-29 22:05:24 [bca.uk] INFO: Found listing with ID: MW61%20AJO
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW61%2520AJO%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [bca.uk] INFO: Scrape type for MW61%20AJO: 0
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611d2290>
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_expert_report_file_682dfc28-ff84-41e6-a6a9-1231a097f0b5.pdf HTTP/1.1" 201 0
2026-03-29 22:05:24 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 38dd9604-9daa-5b5e-902e-c598576d19d6
2026-03-29 22:05:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38dd9604-9daa-5b5e-902e-c598576d19d6, skipping ID generation
2026-03-29 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38dd9604-9daa-5b5e-902e-c598576d19d6
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLN62HLC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LN62HLC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ62YDS/42810080?sv=2020-08-04&st=2026-03-29T22%3A05%3A13Z&se=2026-03-29T22%3A30%3A13Z&sr=b&sp=r&sig=3uF2r926LhFkKPoPLSCohRVnNGX4IbgEWDcBb0D1E%2B8%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455889/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE14PLV/42810074?sv=2020-08-04&st=2026-03-29T22%3A05%3A09Z&se=2026-03-29T22%3A30%3A09Z&sr=b&sp=r&sig=541MdBEqN2lGTdrVQerWTQ4Lv%2BWExd94C%2FkstcmEUVg%3D)
2026-03-29 22:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409130/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PA19DCO/42811984?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=5dad8F2568bHOl2s5RwggeSpVONMrl6yr8ByaoDJDOc%3D)
2026-03-29 22:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455896/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455896>
2026-03-29 22:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455899/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455899>
2026-03-29 22:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH67HFC/42809726?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=aLVrPpUXrfB1VZ7O0yZYRHCjncC2Uv1YIx3J5LA4O1w%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH67%20HFC-GB>
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455911%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455911 not downloaded yet
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61160b90>
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML23KNX%252F699411725%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411725/600 saved to cache
2026-03-29 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c96e7ad0-7cd4-5ea7-b41d-642972a2bf14
2026-03-29 22:05:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c96e7ad0-7cd4-5ea7-b41d-642972a2bf14, skipping ID generation
2026-03-29 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c96e7ad0-7cd4-5ea7-b41d-642972a2bf14 sending to next pipeline
2026-03-29 22:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c96e7ad0-7cd4-5ea7-b41d-642972a2bf14, identifier: ML23%20KNX
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6217bad0>
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG69FWY%252F699406232%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406232/600 saved to cache
2026-03-29 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23673480-b7c5-5707-903a-2783d4797f75
2026-03-29 22:05:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23673480-b7c5-5707-903a-2783d4797f75, skipping ID generation
2026-03-29 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23673480-b7c5-5707-903a-2783d4797f75 sending to next pipeline
2026-03-29 22:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 23673480-b7c5-5707-903a-2783d4797f75, identifier: SG69%20FWY
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6173e3d0>
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ72FOT%252F699414850%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414850/600 saved to cache
2026-03-29 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a
2026-03-29 22:05:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a, skipping ID generation
2026-03-29 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a sending to next pipeline
2026-03-29 22:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a, identifier: PJ72%20FOT
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610546d0>
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_expert_report_file_df0334cc-b623-4b04-80e6-ee0b5839dcb3.pdf HTTP/1.1" 201 0
2026-03-29 22:05:24 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2
2026-03-29 22:05:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2, skipping ID generation
2026-03-29 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLT14HGA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT14HGA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV68URC/42811821?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=UqKQThY1MQH5ObDZI1ey2MVklXRiFzm7WSFSP9Yo17U%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MV68%20URC-GB>
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456010%27 HTTP/1.1" 200 None
2026-03-29 22:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456010 not downloaded yet
2026-03-29 22:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c96e7ad0-7cd4-5ea7-b41d-642972a2bf14 with identifier: ML23%20KNX
2026-03-29 22:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c96e7ad0-7cd4-5ea7-b41d-642972a2bf14 with identifier: ML23%20KNX
2026-03-29 22:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c96e7ad0-7cd4-5ea7-b41d-642972a2bf14 with identifier: ML23%20KNX to the API
2026-03-29 22:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411725/600>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_expert_report_file_269f69bf-3cf6-458d-aa49-322b7f69869d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML23%20KNX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c96e7ad0-7cd4-5ea7-b41d-642972a2bf14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML23 KNX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML23%20KNX&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'KIA',
'model': 'STONIC',
'odometer': 41355,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38383,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411725/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38157,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411734/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37771,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411747/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37754,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411759/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34847,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411767/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35888,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411777/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68861,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411791/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66502,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411810/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79554,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411824/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96e7ad0-7cd4-5ea7-b41d-642972a2bf14/c96e7ad0-7cd4-5ea7-b41d-642972a2bf14_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79634,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML23KNX/699411837/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'KIA STONIC 1.0 T GDI 100 2 Hatchback',
'transmission': 'manual',
'trim': 'T GDI 100 2',
'vin': 'KNAD6817LN6755501',
'year': 2023}
2026-03-29 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML23%2520KNX%27 HTTP/1.1" 200 None
2026-03-29 22:05:25 [bca.uk] INFO: Saving data for ML23%20KNX: {'created_time': 1774821925.311203, 'last_price_update_time': 1774821925.311214, 'auction_closing_time': 1774951200.0}
2026-03-29 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML23%2520KNX') HTTP/1.1" 204 0
2026-03-29 22:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 23673480-b7c5-5707-903a-2783d4797f75 with identifier: SG69%20FWY
2026-03-29 22:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 23673480-b7c5-5707-903a-2783d4797f75 with identifier: SG69%20FWY
2026-03-29 22:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 23673480-b7c5-5707-903a-2783d4797f75 with identifier: SG69%20FWY to the API
2026-03-29 22:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406232/600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_expert_report_file_b9b6678b-accd-4588-8b5f-1cb4b8884b54.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SG69%20FWY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '23673480-b7c5-5707-903a-2783d4797f75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SG69 FWY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SG69%20FWY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'AUDI',
'model': 'A5 CABRIOLET',
'odometer': 41218,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42653,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406206/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39817,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406232/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39255,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406251/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39725,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406275/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35087,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406290/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406304/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86371,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406323/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79424,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406346/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91976,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406369/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23673480-b7c5-5707-903a-2783d4797f75/23673480-b7c5-5707-903a-2783d4797f75_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85545,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG69FWY/699406392/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'AUDI A5 CABRIOLET 2.0 40 TFSI S LINE S-T Convertible',
'transmission': 'automatic',
'trim': '40 TFSI S LINE S-T',
'vin': 'WAUZZZF52KN009838',
'year': 2019}
2026-03-29 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG69%2520FWY%27 HTTP/1.1" 200 None
2026-03-29 22:05:25 [bca.uk] INFO: Saving data for SG69%20FWY: {'created_time': 1774821925.799389, 'last_price_update_time': 1774821925.799401, 'auction_closing_time': 1774951200.0}
2026-03-29 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SG69%2520FWY') HTTP/1.1" 204 0
2026-03-29 22:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a with identifier: PJ72%20FOT
2026-03-29 22:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a with identifier: PJ72%20FOT
2026-03-29 22:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6d67367d-f9a8-5d67-9a3a-d0c399a30f6a with identifier: PJ72%20FOT to the API
2026-03-29 22:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414850/600>
{'auction_title': '',
'c_o_2_emission_value': 225,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_expert_report_file_96c95768-3369-41a9-92ed-3228db37f55c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ72%20FOT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.9L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6d67367d-f9a8-5d67-9a3a-d0c399a30f6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ72 FOT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ72%20FOT&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'AUDI',
'model': 'RS4 AVANT',
'odometer': 15805,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40132,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414843/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37975,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414850/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40975,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414854/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414858/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33547,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414866/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31810,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414881/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92437,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414941/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92631,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699414996/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105935,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699415028/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d67367d-f9a8-5d67-9a3a-d0c399a30f6a/6d67367d-f9a8-5d67-9a3a-d0c399a30f6a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85933,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ72FOT/699415062/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'AUDI RS4 AVANT 2.9 TFSI QUATTRO CARBON BLACK TIP Estate',
'transmission': 'manual',
'trim': 'TFSI QUATTRO CARBON BLACK TIP',
'vin': 'WUAZZZF46PA900369',
'year': 2022}
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ72%2520FOT%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Saving data for PJ72%20FOT: {'created_time': 1774821926.151986, 'last_price_update_time': 1774821926.151998, 'auction_closing_time': 1774951200.0}
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ72%2520FOT') HTTP/1.1" 204 0
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699455914%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455914 not downloaded yet
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699399587%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399587 not downloaded yet
2026-03-29 22:05:26 [bca.uk] INFO: Total items found: 100
2026-03-29 22:05:26 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded
2026-03-29 22:05:26 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:05:26 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455895/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE14PLV/42810074?sv=2020-08-04&st=2026-03-29T22%3A05%3A09Z&se=2026-03-29T22%3A30%3A09Z&sr=b&sp=r&sig=541MdBEqN2lGTdrVQerWTQ4Lv%2BWExd94C%2FkstcmEUVg%3D)
2026-03-29 22:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455892/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE14PLV/42810074?sv=2020-08-04&st=2026-03-29T22%3A05%3A09Z&se=2026-03-29T22%3A30%3A09Z&sr=b&sp=r&sig=541MdBEqN2lGTdrVQerWTQ4Lv%2BWExd94C%2FkstcmEUVg%3D)
2026-03-29 22:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455900/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455900>
2026-03-29 22:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV59NFX/42798282?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Vj26nnLk4nUkuQUUMphnLssRjpy6Za6fEO4Q%2BW%2BcKKU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FV59%20NFX-GB>
2026-03-29 22:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP65JXL/42808111?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=NuWfvCjhCnPVyKXKJ4JcyeNaRmV90x6ROfl09hllUPs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BP65%20JXL-GB>
2026-03-29 22:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP15SYH/42806364?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Rd4qYDMjPlPfw1eY2qRBNLd1xHPVQnmq6D8gIEro12k%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CP15%20SYH-GB>
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456013%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456013 not downloaded yet
2026-03-29 22:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT66YMF/42812098?sv=2020-08-04&st=2026-03-29T22%3A05%3A18Z&se=2026-03-29T22%3A30%3A18Z&sr=b&sp=r&sig=vvtbY7lfWyfzUXxJcw4PY0HqZZ37wGJm65zbIBo7KHs%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699399588%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399588 not downloaded yet
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: MW63%20EZT
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW63%2520EZT%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for MW63%20EZT: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: AJ11%20NFR
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ11%2520NFR%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for AJ11%20NFR: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: BJ59%20HKC
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ59%2520HKC%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for BJ59%20HKC: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: CE61%20YGC
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE61%2520YGC%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for CE61%20YGC: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: ME74%20ZGH
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ME74%2520ZGH%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for ME74%20ZGH: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: PJ68%20AYD
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ68%2520AYD%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for PJ68%20AYD: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: KE19%20ODG
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE19%2520ODG%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for KE19%20ODG: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: DF18%20UUA
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF18%2520UUA%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for DF18%20UUA: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: KM68%20WZP
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM68%2520WZP%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for KM68%20WZP: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: PN68%20BZB
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN68%2520BZB%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for PN68%20BZB: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: RRZ%209472
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RRZ%25209472%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for RRZ%209472: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: PG73%20AHU
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PG73%2520AHU%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for PG73%20AHU: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: WHZ%203609
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WHZ%25203609%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for WHZ%203609: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: MJ15%20GNK
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ15%2520GNK%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for MJ15%20GNK: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: PJ66%20DPK
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ66%2520DPK%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for PJ66%20DPK: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: PK16%20BGU
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK16%2520BGU%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for PK16%20BGU: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: SHZ%204847
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SHZ%25204847%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for SHZ%204847: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: DF14%20ENO
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF14%2520ENO%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for DF14%20ENO: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: DF59%20HXA
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF59%2520HXA%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for DF59%20HXA: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: EGZ%203015
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EGZ%25203015%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for EGZ%203015: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: HW67%20GWK
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW67%2520GWK%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for HW67%20GWK: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: MA66%20FNM
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA66%2520FNM%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for MA66%20FNM: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: PF60%20FKN
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF60%2520FKN%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for PF60%20FKN: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: VEZ%207096
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VEZ%25207096%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for VEZ%207096: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: AF16%20WXA
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF16%2520WXA%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for AF16%20WXA: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: DSZ%207504
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DSZ%25207504%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for DSZ%207504: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: FG67%20GJU
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG67%2520GJU%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for FG67%20GJU: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: ST19%20CBF
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST19%2520CBF%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for ST19%20CBF: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: WG67%20KDZ
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG67%2520KDZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for WG67%20KDZ: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: WHZ%208143
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WHZ%25208143%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for WHZ%208143: 0
2026-03-29 22:05:26 [bca.uk] INFO: Found listing with ID: YB18%20HGA
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB18%2520HGA%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [bca.uk] INFO: Scrape type for YB18%20HGA: 2
2026-03-29 22:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38f5d864-3566-53dd-abf4-6369ead9643c with identifier: YB18%20HGA
2026-03-29 22:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38f5d864-3566-53dd-abf4-6369ead9643c with scrape type 2
2026-03-29 22:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38f5d864-3566-53dd-abf4-6369ead9643c with scrape type 2
2026-03-29 22:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 38f5d864-3566-53dd-abf4-6369ead9643c, identifier: YB18%20HGA
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456015%27 HTTP/1.1" 200 None
2026-03-29 22:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456015 not downloaded yet
2026-03-29 22:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 38f5d864-3566-53dd-abf4-6369ead9643c with identifier: YB18%20HGA
2026-03-29 22:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 38f5d864-3566-53dd-abf4-6369ead9643c with identifier: YB18%20HGA
2026-03-29 22:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 38f5d864-3566-53dd-abf4-6369ead9643c with identifier: YB18%20HGA to the API
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 183,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YB18%20HGA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '38f5d864-3566-53dd-abf4-6369ead9643c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YB18 HGA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YB18%20HGA&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'BMW',
'model': 'X6',
'odometer': 104693,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'BMW X6 3.0 XDRIVE 30D M SPORT ED.STEP Coupe',
'transmission': 'manual',
'trim': 'XDRIVE 30D M SPORT ED.STEP',
'vin': 'WBAKV220100Z96702',
'year': 2018}
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB18%2520HGA%27 HTTP/1.1" 200 None
2026-03-29 22:05:27 [bca.uk] INFO: Saving data for YB18%20HGA: {'auction_closing_time': 1774864800.0, 'created_time': 1774620419.095374, 'last_price_update_time': 1774821927.292158}
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YB18%2520HGA') HTTP/1.1" 204 0
2026-03-29 22:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610849d0>
2026-03-29 22:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_expert_report_file_2b480fa5-f8b1-47cf-89f7-f191d1faf8c9.pdf HTTP/1.1" 201 0
2026-03-29 22:05:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9e23ce11-f3f0-5635-b5b9-03f2e6272954
2026-03-29 22:05:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e23ce11-f3f0-5635-b5b9-03f2e6272954, skipping ID generation
2026-03-29 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e23ce11-f3f0-5635-b5b9-03f2e6272954
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNJ62YDS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NJ62YDS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6173e010>
2026-03-29 22:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE14PLV%252F699455889%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455889/600 saved to cache
2026-03-29 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1944c0b-6133-542d-8b41-67a9ddd47893
2026-03-29 22:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637d28d0>
2026-03-29 22:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPA19DCO%252F699409130%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409130/600 saved to cache
2026-03-29 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da397772-3003-5876-84de-18e19f2e1e0e
2026-03-29 22:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409119/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PA19DCO/42811984?sv=2020-08-04&st=2026-03-29T22%3A00%3A56Z&se=2026-03-29T22%3A25%3A56Z&sr=b&sp=r&sig=5dad8F2568bHOl2s5RwggeSpVONMrl6yr8ByaoDJDOc%3D)
2026-03-29 22:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455896/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE14PLV/42810074?sv=2020-08-04&st=2026-03-29T22%3A05%3A09Z&se=2026-03-29T22%3A30%3A09Z&sr=b&sp=r&sig=541MdBEqN2lGTdrVQerWTQ4Lv%2BWExd94C%2FkstcmEUVg%3D)
2026-03-29 22:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455899/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE14PLV/42810074?sv=2020-08-04&st=2026-03-29T22%3A05%3A09Z&se=2026-03-29T22%3A30%3A09Z&sr=b&sp=r&sig=541MdBEqN2lGTdrVQerWTQ4Lv%2BWExd94C%2FkstcmEUVg%3D)
2026-03-29 22:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455907/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455907>
2026-03-29 22:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455903/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455903>
2026-03-29 22:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV14TTZ/42810271?sv=2020-08-04&st=2026-03-29T22%3A05%3A26Z&se=2026-03-29T22%3A30%3A26Z&sr=b&sp=r&sig=FgPAFqZLo2N8ZmxnTVXtDLCOVp7mvYK9n8e2P5I%2F32w%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV14%20TTZ-GB>
2026-03-29 22:05:27 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:05:27 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699399590%27 HTTP/1.1" 200 None
2026-03-29 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399590 not downloaded yet
2026-03-29 22:05:27 [bca.uk] INFO: Found listing with ID: YH66%20USG
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH66%2520USG%27 HTTP/1.1" 200 None
2026-03-29 22:05:27 [bca.uk] INFO: Scrape type for YH66%20USG: 2
2026-03-29 22:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7275d163-66a7-5597-87e1-7ec9832d6465 with identifier: YH66%20USG
2026-03-29 22:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7275d163-66a7-5597-87e1-7ec9832d6465 with scrape type 2
2026-03-29 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7275d163-66a7-5597-87e1-7ec9832d6465 with scrape type 2
2026-03-29 22:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7275d163-66a7-5597-87e1-7ec9832d6465, identifier: YH66%20USG
2026-03-29 22:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456017%27 HTTP/1.1" 200 None
2026-03-29 22:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456017 not downloaded yet
2026-03-29 22:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7275d163-66a7-5597-87e1-7ec9832d6465 with identifier: YH66%20USG
2026-03-29 22:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7275d163-66a7-5597-87e1-7ec9832d6465 with identifier: YH66%20USG
2026-03-29 22:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7275d163-66a7-5597-87e1-7ec9832d6465 with identifier: YH66%20USG to the API
2026-03-29 22:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH66%20USG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7275d163-66a7-5597-87e1-7ec9832d6465',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH66 USG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH66%20USG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'ADAM',
'odometer': 61842,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL ADAM 1.2 VVT 70 JAM Hatchback',
'transmission': 'manual',
'trim': 'VVT 70 JAM',
'vin': 'W0L0MAP08G6122230',
'year': 2016}
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH66%2520USG%27 HTTP/1.1" 200 None
2026-03-29 22:05:28 [bca.uk] INFO: Saving data for YH66%20USG: {'auction_closing_time': 1774864800.0, 'created_time': 1774622387.402745, 'last_price_update_time': 1774821928.26024}
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH66%2520USG') HTTP/1.1" 204 0
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456046%27 HTTP/1.1" 200 None
2026-03-29 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456046 not downloaded yet
2026-03-29 22:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61069290>
2026-03-29 22:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE14PLV%252F699455895%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455895/600 saved to cache
2026-03-29 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1944c0b-6133-542d-8b41-67a9ddd47893
2026-03-29 22:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617649d0>
2026-03-29 22:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE14PLV%252F699455892%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455892/600 saved to cache
2026-03-29 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1944c0b-6133-542d-8b41-67a9ddd47893
2026-03-29 22:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac60ff6950>
2026-03-29 22:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_expert_report_file_839d07dd-43de-410b-bc32-c59e9e66624c.pdf HTTP/1.1" 201 0
2026-03-29 22:05:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a5cb9c1b-2fac-5aa0-89c7-e23c2249811e
2026-03-29 22:05:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5cb9c1b-2fac-5aa0-89c7-e23c2249811e, skipping ID generation
2026-03-29 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5cb9c1b-2fac-5aa0-89c7-e23c2249811e
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYT66YMF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YT66YMF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH67HFC/42809726?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=aLVrPpUXrfB1VZ7O0yZYRHCjncC2Uv1YIx3J5LA4O1w%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV08TVU/42787563?sv=2020-08-04&st=2026-03-29T22%3A05%3A27Z&se=2026-03-29T22%3A30%3A27Z&sr=b&sp=r&sig=abPHynH8s2xf0kifKXKlpOTe1ehQFdtJ3%2BPcXJSL4zU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV08%20TVU-GB>
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699399591%27 HTTP/1.1" 200 None
2026-03-29 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399591 not downloaded yet
2026-03-29 22:05:28 [bca.uk] INFO: Found listing with ID: YR15%20BJV
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR15%2520BJV%27 HTTP/1.1" 200 None
2026-03-29 22:05:28 [bca.uk] INFO: Scrape type for YR15%20BJV: 0
2026-03-29 22:05:28 [bca.uk] INFO: Found listing with ID: YR64%20ZFO
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR64%2520ZFO%27 HTTP/1.1" 200 None
2026-03-29 22:05:28 [bca.uk] INFO: Scrape type for YR64%20ZFO: 0
2026-03-29 22:05:28 [bca.uk] INFO: Found listing with ID: CK15%20AEP
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK15%2520AEP%27 HTTP/1.1" 200 None
2026-03-29 22:05:28 [bca.uk] INFO: Scrape type for CK15%20AEP: 0
2026-03-29 22:05:28 [bca.uk] INFO: Found listing with ID: DA66%20OXP
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA66%2520OXP%27 HTTP/1.1" 200 None
2026-03-29 22:05:28 [bca.uk] INFO: Scrape type for DA66%20OXP: 2
2026-03-29 22:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32fe26a0-c2ca-5b0b-80f2-903fdc9c1704 with identifier: DA66%20OXP
2026-03-29 22:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32fe26a0-c2ca-5b0b-80f2-903fdc9c1704 with scrape type 2
2026-03-29 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32fe26a0-c2ca-5b0b-80f2-903fdc9c1704 with scrape type 2
2026-03-29 22:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 32fe26a0-c2ca-5b0b-80f2-903fdc9c1704, identifier: DA66%20OXP
2026-03-29 22:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455900/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE14PLV/42810074?sv=2020-08-04&st=2026-03-29T22%3A05%3A09Z&se=2026-03-29T22%3A30%3A09Z&sr=b&sp=r&sig=541MdBEqN2lGTdrVQerWTQ4Lv%2BWExd94C%2FkstcmEUVg%3D)
2026-03-29 22:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456010/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456010>
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456018%27 HTTP/1.1" 200 None
2026-03-29 22:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456018 not downloaded yet
2026-03-29 22:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 32fe26a0-c2ca-5b0b-80f2-903fdc9c1704 with identifier: DA66%20OXP
2026-03-29 22:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 32fe26a0-c2ca-5b0b-80f2-903fdc9c1704 with identifier: DA66%20OXP
2026-03-29 22:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 32fe26a0-c2ca-5b0b-80f2-903fdc9c1704 with identifier: DA66%20OXP to the API
2026-03-29 22:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA66%20OXP-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '32fe26a0-c2ca-5b0b-80f2-903fdc9c1704',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DA66 OXP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DA66%20OXP&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 59108,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE LUXURY StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 HSE LUXURY',
'vin': 'SALCA2AN1HH661560',
'year': 2017}
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA66%2520OXP%27 HTTP/1.1" 200 None
2026-03-29 22:05:29 [bca.uk] INFO: Saving data for DA66%20OXP: {'auction_closing_time': 1774864800.0, 'created_time': 1774188600.455437, 'last_price_update_time': 1774821929.188568}
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DA66%2520OXP') HTTP/1.1" 204 0
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456047%27 HTTP/1.1" 200 None
2026-03-29 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456047 not downloaded yet
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414868%27 HTTP/1.1" 200 None
2026-03-29 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414868 not downloaded yet
2026-03-29 22:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV68URC/42811821?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=UqKQThY1MQH5ObDZI1ey2MVklXRiFzm7WSFSP9Yo17U%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP15SYH/42806364?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Rd4qYDMjPlPfw1eY2qRBNLd1xHPVQnmq6D8gIEro12k%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699399592%27 HTTP/1.1" 200 None
2026-03-29 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399592 not downloaded yet
2026-03-29 22:05:29 [bca.uk] INFO: Found listing with ID: DE14%20WTA
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE14%2520WTA%27 HTTP/1.1" 200 None
2026-03-29 22:05:29 [bca.uk] INFO: Scrape type for DE14%20WTA: 0
2026-03-29 22:05:29 [bca.uk] INFO: Found listing with ID: DE64%20TVD
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE64%2520TVD%27 HTTP/1.1" 200 None
2026-03-29 22:05:29 [bca.uk] INFO: Scrape type for DE64%20TVD: 0
2026-03-29 22:05:29 [bca.uk] INFO: Found listing with ID: DV64%20UBN
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV64%2520UBN%27 HTTP/1.1" 200 None
2026-03-29 22:05:29 [bca.uk] INFO: Scrape type for DV64%20UBN: 0
2026-03-29 22:05:29 [bca.uk] INFO: Found listing with ID: FD16%20VWM
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD16%2520VWM%27 HTTP/1.1" 200 None
2026-03-29 22:05:29 [bca.uk] INFO: Scrape type for FD16%20VWM: 0
2026-03-29 22:05:29 [bca.uk] INFO: Found listing with ID: FL16%20CWO
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL16%2520CWO%27 HTTP/1.1" 200 None
2026-03-29 22:05:29 [bca.uk] INFO: Scrape type for FL16%20CWO: 0
2026-03-29 22:05:29 [bca.uk] INFO: Found listing with ID: GV65%20GPK
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV65%2520GPK%27 HTTP/1.1" 200 None
2026-03-29 22:05:29 [bca.uk] INFO: Scrape type for GV65%20GPK: 0
2026-03-29 22:05:29 [bca.uk] INFO: Found listing with ID: HY65%20KRJ
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY65%2520KRJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:29 [bca.uk] INFO: Scrape type for HY65%20KRJ: 0
2026-03-29 22:05:29 [bca.uk] INFO: Found listing with ID: M70%20ODE
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M70%2520ODE%27 HTTP/1.1" 200 None
2026-03-29 22:05:29 [bca.uk] INFO: Scrape type for M70%20ODE: 2
2026-03-29 22:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6671a6d0-673a-5170-b57c-2fa413a2722d with identifier: M70%20ODE
2026-03-29 22:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6671a6d0-673a-5170-b57c-2fa413a2722d with scrape type 2
2026-03-29 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6671a6d0-673a-5170-b57c-2fa413a2722d with scrape type 2
2026-03-29 22:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6671a6d0-673a-5170-b57c-2fa413a2722d, identifier: M70%20ODE
2026-03-29 22:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618efd50>
2026-03-29 22:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPA19DCO%252F699409119%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409119/600 saved to cache
2026-03-29 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da397772-3003-5876-84de-18e19f2e1e0e
2026-03-29 22:05:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da397772-3003-5876-84de-18e19f2e1e0e, skipping ID generation
2026-03-29 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da397772-3003-5876-84de-18e19f2e1e0e sending to next pipeline
2026-03-29 22:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: da397772-3003-5876-84de-18e19f2e1e0e, identifier: PA19%20DCO
2026-03-29 22:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621384d0>
2026-03-29 22:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE14PLV%252F699455896%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455896/600 saved to cache
2026-03-29 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1944c0b-6133-542d-8b41-67a9ddd47893
2026-03-29 22:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a51410>
2026-03-29 22:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE14PLV%252F699455899%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455899/600 saved to cache
2026-03-29 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1944c0b-6133-542d-8b41-67a9ddd47893
2026-03-29 22:05:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456013/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456013>
2026-03-29 22:05:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399586/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT14HGA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456023%27 HTTP/1.1" 200 None
2026-03-29 22:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456023 not downloaded yet
2026-03-29 22:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6671a6d0-673a-5170-b57c-2fa413a2722d with identifier: M70%20ODE
2026-03-29 22:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6671a6d0-673a-5170-b57c-2fa413a2722d with identifier: M70%20ODE
2026-03-29 22:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6671a6d0-673a-5170-b57c-2fa413a2722d with identifier: M70%20ODE to the API
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=M70%20ODE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6671a6d0-673a-5170-b57c-2fa413a2722d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'M70 ODE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=M70%20ODE&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 65272,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.2 P/T 130 ALLURE Hatchback',
'transmission': 'manual',
'trim': 'P/T 130 ALLURE',
'vin': 'VF3MRHNYHJS047206',
'year': 2018}
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M70%2520ODE%27 HTTP/1.1" 200 None
2026-03-29 22:05:30 [bca.uk] INFO: Saving data for M70%20ODE: {'auction_closing_time': 1774864800.0, 'created_time': 1774706797.336907, 'last_price_update_time': 1774821930.109527}
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='M70%2520ODE') HTTP/1.1" 204 0
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456049%27 HTTP/1.1" 200 None
2026-03-29 22:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456049 not downloaded yet
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414882%27 HTTP/1.1" 200 None
2026-03-29 22:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414882 not downloaded yet
2026-03-29 22:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: da397772-3003-5876-84de-18e19f2e1e0e with identifier: PA19%20DCO
2026-03-29 22:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: da397772-3003-5876-84de-18e19f2e1e0e with identifier: PA19%20DCO
2026-03-29 22:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: da397772-3003-5876-84de-18e19f2e1e0e with identifier: PA19%20DCO to the API
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409119/600>
{'auction_title': '',
'c_o_2_emission_value': 89,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_expert_report_file_283e2938-709c-45ae-b0a6-b224b8c23099.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PA19%20DCO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'da397772-3003-5876-84de-18e19f2e1e0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PA19 DCO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PA19%20DCO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SUZUKI',
'model': 'CELERIO',
'odometer': 9274,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409119/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37224,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409130/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409147/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38238,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409166/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36212,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409181/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36360,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409195/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94921,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409227/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64389,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409249/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74391,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409268/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da397772-3003-5876-84de-18e19f2e1e0e/da397772-3003-5876-84de-18e19f2e1e0e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83041,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PA19DCO/699409286/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'SUZUKI CELERIO 1.0 D/JET SZ3 Hatchback',
'transmission': 'manual',
'trim': 'D/JET SZ3',
'vin': 'MMSLFE62S00127271',
'year': 2019}
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PA19%2520DCO%27 HTTP/1.1" 200 None
2026-03-29 22:05:30 [bca.uk] INFO: Saving data for PA19%20DCO: {'created_time': 1774821930.63316, 'last_price_update_time': 1774821930.633172, 'auction_closing_time': 1774951200.0}
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PA19%2520DCO') HTTP/1.1" 204 0
2026-03-29 22:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP65JXL/42808111?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=NuWfvCjhCnPVyKXKJ4JcyeNaRmV90x6ROfl09hllUPs%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699399594%27 HTTP/1.1" 200 None
2026-03-29 22:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399594 not downloaded yet
2026-03-29 22:05:30 [bca.uk] INFO: Found listing with ID: PY14%20EBA
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY14%2520EBA%27 HTTP/1.1" 200 None
2026-03-29 22:05:30 [bca.uk] INFO: Scrape type for PY14%20EBA: 0
2026-03-29 22:05:30 [bca.uk] INFO: Found listing with ID: SH64%20FFB
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH64%2520FFB%27 HTTP/1.1" 200 None
2026-03-29 22:05:30 [bca.uk] INFO: Scrape type for SH64%20FFB: 0
2026-03-29 22:05:30 [bca.uk] INFO: Found listing with ID: AE16%20SPZ
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE16%2520SPZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:30 [bca.uk] INFO: Scrape type for AE16%20SPZ: 2
2026-03-29 22:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 560a085e-e920-5ae3-9933-4eb9e6652242 with identifier: AE16%20SPZ
2026-03-29 22:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 560a085e-e920-5ae3-9933-4eb9e6652242 with scrape type 2
2026-03-29 22:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 560a085e-e920-5ae3-9933-4eb9e6652242 with scrape type 2
2026-03-29 22:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 560a085e-e920-5ae3-9933-4eb9e6652242, identifier: AE16%20SPZ
2026-03-29 22:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV59NFX/42798282?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Vj26nnLk4nUkuQUUMphnLssRjpy6Za6fEO4Q%2BW%2BcKKU%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:05:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399588/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399588>
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456028%27 HTTP/1.1" 200 None
2026-03-29 22:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456028 not downloaded yet
2026-03-29 22:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 560a085e-e920-5ae3-9933-4eb9e6652242 with identifier: AE16%20SPZ
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-29 22:05:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 560a085e-e920-5ae3-9933-4eb9e6652242 with identifier: AE16%20SPZ
2026-03-29 22:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 560a085e-e920-5ae3-9933-4eb9e6652242 with identifier: AE16%20SPZ to the API
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE16%20SPZ-GB',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '560a085e-e920-5ae3-9933-4eb9e6652242',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE16 SPZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AE16%20SPZ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'ECOSPORT',
'odometer': 65693,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD ECOSPORT 1.5 TDCI 95 TITANIUM StationWagon',
'transmission': 'manual',
'trim': 'TDCI 95 TITANIUM',
'vin': 'WF0BXXMRKBFM33379',
'year': 2016}
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE16%2520SPZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:31 [bca.uk] INFO: Saving data for AE16%20SPZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774425888.279276, 'last_price_update_time': 1774821931.720811}
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AE16%2520SPZ') HTTP/1.1" 204 0
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456051%27 HTTP/1.1" 200 None
2026-03-29 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456051 not downloaded yet
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414901%27 HTTP/1.1" 200 None
2026-03-29 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414901 not downloaded yet
2026-03-29 22:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621330d0>
2026-03-29 22:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_expert_report_file_0c589fdc-2c36-426f-b585-b149f3ff37df.pdf HTTP/1.1" 201 0
2026-03-29 22:05:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6836e689-948e-59c9-ae88-0dac50e055fe
2026-03-29 22:05:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6836e689-948e-59c9-ae88-0dac50e055fe, skipping ID generation
2026-03-29 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6836e689-948e-59c9-ae88-0dac50e055fe
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYH67HFC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YH67HFC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637d20d0>
2026-03-29 22:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE14PLV%252F699455900%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455900/600 saved to cache
2026-03-29 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1944c0b-6133-542d-8b41-67a9ddd47893
2026-03-29 22:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6107f910>
2026-03-29 22:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_expert_report_file_8c5e0b4a-daa3-40cf-817e-0c2effcae48b.pdf HTTP/1.1" 201 0
2026-03-29 22:05:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c423af70-863f-544f-981f-966354022060
2026-03-29 22:05:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c423af70-863f-544f-981f-966354022060, skipping ID generation
2026-03-29 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c423af70-863f-544f-981f-966354022060
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMV68URC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MV68URC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac617028d0>
2026-03-29 22:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_expert_report_file_966127f9-f3fb-4b17-b97b-024cf9e59fae.pdf HTTP/1.1" 201 0
2026-03-29 22:05:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7722f27f-140c-5241-909a-6e6aa692732b
2026-03-29 22:05:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7722f27f-140c-5241-909a-6e6aa692732b, skipping ID generation
2026-03-29 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7722f27f-140c-5241-909a-6e6aa692732b
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCP15SYH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CP15SYH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:05:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399587/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399587>
2026-03-29 22:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455903/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE14PLV/42810074?sv=2020-08-04&st=2026-03-29T22%3A05%3A09Z&se=2026-03-29T22%3A30%3A09Z&sr=b&sp=r&sig=541MdBEqN2lGTdrVQerWTQ4Lv%2BWExd94C%2FkstcmEUVg%3D)
2026-03-29 22:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455907/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE14PLV/42810074?sv=2020-08-04&st=2026-03-29T22%3A05%3A09Z&se=2026-03-29T22%3A30%3A09Z&sr=b&sp=r&sig=541MdBEqN2lGTdrVQerWTQ4Lv%2BWExd94C%2FkstcmEUVg%3D)
2026-03-29 22:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV14TTZ/42810271?sv=2020-08-04&st=2026-03-29T22%3A05%3A26Z&se=2026-03-29T22%3A30%3A26Z&sr=b&sp=r&sig=FgPAFqZLo2N8ZmxnTVXtDLCOVp7mvYK9n8e2P5I%2F32w%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699399598%27 HTTP/1.1" 200 None
2026-03-29 22:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399598 not downloaded yet
2026-03-29 22:05:31 [bca.uk] INFO: Found listing with ID: CU54%20OFO
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU54%2520OFO%27 HTTP/1.1" 200 None
2026-03-29 22:05:31 [bca.uk] INFO: Scrape type for CU54%20OFO: 0
2026-03-29 22:05:31 [bca.uk] INFO: Found listing with ID: GL61%20YHO
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL61%2520YHO%27 HTTP/1.1" 200 None
2026-03-29 22:05:31 [bca.uk] INFO: Scrape type for GL61%20YHO: 0
2026-03-29 22:05:31 [bca.uk] INFO: Found listing with ID: VN17%20XYT
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN17%2520XYT%27 HTTP/1.1" 200 None
2026-03-29 22:05:31 [bca.uk] INFO: Scrape type for VN17%20XYT: 0
2026-03-29 22:05:31 [bca.uk] INFO: Found listing with ID: ASZ%205349
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ASZ%25205349%27 HTTP/1.1" 200 None
2026-03-29 22:05:32 [bca.uk] INFO: Scrape type for ASZ%205349: 0
2026-03-29 22:05:32 [bca.uk] INFO: Found listing with ID: FE04%20PMY
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE04%2520PMY%27 HTTP/1.1" 200 None
2026-03-29 22:05:32 [bca.uk] INFO: Scrape type for FE04%20PMY: 0
2026-03-29 22:05:32 [bca.uk] INFO: Found listing with ID: OY12%20WFC
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY12%2520WFC%27 HTTP/1.1" 200 None
2026-03-29 22:05:32 [bca.uk] INFO: Scrape type for OY12%20WFC: 0
2026-03-29 22:05:32 [bca.uk] INFO: Found listing with ID: YY15%20GXL
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY15%2520GXL%27 HTTP/1.1" 200 None
2026-03-29 22:05:32 [bca.uk] INFO: Scrape type for YY15%20GXL: 0
2026-03-29 22:05:32 [bca.uk] INFO: Found listing with ID: WJ68%20YNB
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ68%2520YNB%27 HTTP/1.1" 200 None
2026-03-29 22:05:32 [bca.uk] INFO: Scrape type for WJ68%20YNB: 2
2026-03-29 22:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d4b83d0-dda6-586e-86d4-d76ca4177117 with identifier: WJ68%20YNB
2026-03-29 22:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d4b83d0-dda6-586e-86d4-d76ca4177117 with scrape type 2
2026-03-29 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d4b83d0-dda6-586e-86d4-d76ca4177117 with scrape type 2
2026-03-29 22:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0d4b83d0-dda6-586e-86d4-d76ca4177117, identifier: WJ68%20YNB
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456032%27 HTTP/1.1" 200 None
2026-03-29 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456032 not downloaded yet
2026-03-29 22:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0d4b83d0-dda6-586e-86d4-d76ca4177117 with identifier: WJ68%20YNB
2026-03-29 22:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0d4b83d0-dda6-586e-86d4-d76ca4177117 with identifier: WJ68%20YNB
2026-03-29 22:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0d4b83d0-dda6-586e-86d4-d76ca4177117 with identifier: WJ68%20YNB to the API
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ68%20YNB-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0d4b83d0-dda6-586e-86d4-d76ca4177117',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ68 YNB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ68%20YNB&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 54542,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 112 TEKNA Hatchback',
'transmission': 'automatic',
'trim': '112 TEKNA',
'vin': 'SJNFBAF15U8033478',
'year': 2018}
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ68%2520YNB%27 HTTP/1.1" 200 None
2026-03-29 22:05:32 [bca.uk] INFO: Saving data for WJ68%20YNB: {'auction_closing_time': 1774864800.0, 'created_time': 1774610858.566656, 'last_price_update_time': 1774821932.530445}
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ68%2520YNB') HTTP/1.1" 204 0
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456054%27 HTTP/1.1" 200 None
2026-03-29 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456054 not downloaded yet
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414918%27 HTTP/1.1" 200 None
2026-03-29 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414918 not downloaded yet
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699248711%27 HTTP/1.1" 200 None
2026-03-29 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248711 not downloaded yet
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387062%27 HTTP/1.1" 200 None
2026-03-29 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387062 not downloaded yet
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089057%27 HTTP/1.1" 200 None
2026-03-29 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089057 not downloaded yet
2026-03-29 22:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61167890>
2026-03-29 22:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_expert_report_file_73b9b9be-4412-4fff-9f32-f4a886be9e48.pdf HTTP/1.1" 201 0
2026-03-29 22:05:32 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4
2026-03-29 22:05:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4, skipping ID generation
2026-03-29 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBP65JXL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BP65JXL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456010/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN62HLC/42810081?sv=2020-08-04&st=2026-03-29T22%3A05%3A15Z&se=2026-03-29T22%3A30%3A15Z&sr=b&sp=r&sig=7S8WdQ3gHe92IypMlrTOVxGXU1Uqv27G6oYLRI%2FeI0k%3D)
2026-03-29 22:05:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399590/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399590>
2026-03-29 22:05:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399591/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399591>
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699399599%27 HTTP/1.1" 200 None
2026-03-29 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399599 not downloaded yet
2026-03-29 22:05:32 [bca.uk] INFO: Found listing with ID: YH19%20LVV
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH19%2520LVV%27 HTTP/1.1" 200 None
2026-03-29 22:05:32 [bca.uk] INFO: Scrape type for YH19%20LVV: 2
2026-03-29 22:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f89fe5c2-e638-54c7-a23a-f85409657332 with identifier: YH19%20LVV
2026-03-29 22:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f89fe5c2-e638-54c7-a23a-f85409657332 with scrape type 2
2026-03-29 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f89fe5c2-e638-54c7-a23a-f85409657332 with scrape type 2
2026-03-29 22:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f89fe5c2-e638-54c7-a23a-f85409657332, identifier: YH19%20LVV
2026-03-29 22:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6102f750>
2026-03-29 22:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_expert_report_file_1cbf0aec-d833-4759-a6c3-18c7af7232d2.pdf HTTP/1.1" 201 0
2026-03-29 22:05:32 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 75379e98-ec74-5bb8-a2ba-dee078101af0
2026-03-29 22:05:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75379e98-ec74-5bb8-a2ba-dee078101af0, skipping ID generation
2026-03-29 22:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75379e98-ec74-5bb8-a2ba-dee078101af0
2026-03-29 22:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFV59NFX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FV59NFX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456013/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN62HLC/42810081?sv=2020-08-04&st=2026-03-29T22%3A05%3A15Z&se=2026-03-29T22%3A30%3A15Z&sr=b&sp=r&sig=7S8WdQ3gHe92IypMlrTOVxGXU1Uqv27G6oYLRI%2FeI0k%3D)
2026-03-29 22:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399586/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT14HGA/42812005?sv=2020-08-04&st=2026-03-29T22%3A05%3A17Z&se=2026-03-29T22%3A30%3A17Z&sr=b&sp=r&sig=waPrjmAums3L%2FvFzJ%2Fhg5dv7M7RjxxPDejipYOMZYCI%3D)
2026-03-29 22:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456046/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456046>
2026-03-29 22:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414847/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YT66YMF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456037%27 HTTP/1.1" 200 None
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456037 not downloaded yet
2026-03-29 22:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f89fe5c2-e638-54c7-a23a-f85409657332 with identifier: YH19%20LVV
2026-03-29 22:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f89fe5c2-e638-54c7-a23a-f85409657332 with identifier: YH19%20LVV
2026-03-29 22:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f89fe5c2-e638-54c7-a23a-f85409657332 with identifier: YH19%20LVV to the API
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH19%20LVV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f89fe5c2-e638-54c7-a23a-f85409657332',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH19 LVV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH19%20LVV&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'BMW',
'model': 'X1',
'odometer': 36896,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW X1 2.0 XDRIVE 18D M SPORT STEP StationWagon',
'transmission': 'manual',
'trim': 'XDRIVE 18D M SPORT STEP',
'vin': 'WBAJH720703F75584',
'year': 2019}
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH19%2520LVV%27 HTTP/1.1" 200 None
2026-03-29 22:05:33 [bca.uk] INFO: Saving data for YH19%20LVV: {'auction_closing_time': 1774951200.0, 'created_time': 1774391970.2624, 'last_price_update_time': 1774821933.365152}
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH19%2520LVV') HTTP/1.1" 204 0
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456055%27 HTTP/1.1" 200 None
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456055 not downloaded yet
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414945%27 HTTP/1.1" 200 None
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414945 not downloaded yet
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699248718%27 HTTP/1.1" 200 None
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248718 not downloaded yet
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387065%27 HTTP/1.1" 200 None
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387065 not downloaded yet
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089061%27 HTTP/1.1" 200 None
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089061 not downloaded yet
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699087892%27 HTTP/1.1" 200 None
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699087892 not downloaded yet
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699399600%27 HTTP/1.1" 200 None
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399600 not downloaded yet
2026-03-29 22:05:33 [bca.uk] INFO: Found listing with ID: EA18%20YDV
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA18%2520YDV%27 HTTP/1.1" 200 None
2026-03-29 22:05:33 [bca.uk] INFO: Scrape type for EA18%20YDV: 2
2026-03-29 22:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6874a08c-0da4-5c41-875d-4cf77e69fa34 with identifier: EA18%20YDV
2026-03-29 22:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6874a08c-0da4-5c41-875d-4cf77e69fa34 with scrape type 2
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6874a08c-0da4-5c41-875d-4cf77e69fa34 with scrape type 2
2026-03-29 22:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6874a08c-0da4-5c41-875d-4cf77e69fa34, identifier: EA18%20YDV
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699453602%27 HTTP/1.1" 200 None
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453602 not downloaded yet
2026-03-29 22:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610004d0>
2026-03-29 22:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE14PLV%252F699455903%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455903/600 saved to cache
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1944c0b-6133-542d-8b41-67a9ddd47893
2026-03-29 22:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61001550>
2026-03-29 22:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE14PLV%252F699455907%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455907/600 saved to cache
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1944c0b-6133-542d-8b41-67a9ddd47893
2026-03-29 22:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614cc050>
2026-03-29 22:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_expert_report_file_4129792f-b8fa-44f1-83b0-0b75e5d6367f.pdf HTTP/1.1" 201 0
2026-03-29 22:05:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3909531a-470f-5688-8297-acd46a9f879d
2026-03-29 22:05:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3909531a-470f-5688-8297-acd46a9f879d, skipping ID generation
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3909531a-470f-5688-8297-acd46a9f879d
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSV14TTZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SV14TTZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399588/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT14HGA/42812005?sv=2020-08-04&st=2026-03-29T22%3A05%3A17Z&se=2026-03-29T22%3A30%3A17Z&sr=b&sp=r&sig=waPrjmAums3L%2FvFzJ%2Fhg5dv7M7RjxxPDejipYOMZYCI%3D)
2026-03-29 22:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414882/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414882>
2026-03-29 22:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456049/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456049>
2026-03-29 22:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6874a08c-0da4-5c41-875d-4cf77e69fa34 with identifier: EA18%20YDV
2026-03-29 22:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6874a08c-0da4-5c41-875d-4cf77e69fa34 with identifier: EA18%20YDV
2026-03-29 22:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6874a08c-0da4-5c41-875d-4cf77e69fa34 with identifier: EA18%20YDV to the API
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA18%20YDV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '0.9L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6874a08c-0da4-5c41-875d-4cf77e69fa34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA18 YDV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA18%20YDV&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'FIAT',
'model': '500',
'odometer': 59401,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FIAT 500 0.9 TWINAIR 105 S Hatchback',
'transmission': 'manual',
'trim': 'TWINAIR 105 S',
'vin': 'ZFA3120000J984262',
'year': 2018}
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA18%2520YDV%27 HTTP/1.1" 200 None
2026-03-29 22:05:34 [bca.uk] INFO: Saving data for EA18%20YDV: {'auction_closing_time': 1774864800.0, 'created_time': 1773930316.305754, 'last_price_update_time': 1774821934.259416}
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA18%2520YDV') HTTP/1.1" 204 0
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456057%27 HTTP/1.1" 200 None
2026-03-29 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456057 not downloaded yet
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414993%27 HTTP/1.1" 200 None
2026-03-29 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414993 not downloaded yet
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699248725%27 HTTP/1.1" 200 None
2026-03-29 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248725 not downloaded yet
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387071%27 HTTP/1.1" 200 None
2026-03-29 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387071 not downloaded yet
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089063%27 HTTP/1.1" 200 None
2026-03-29 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089063 not downloaded yet
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699087913%27 HTTP/1.1" 200 None
2026-03-29 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699087913 not downloaded yet
2026-03-29 22:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV08TVU/42787563?sv=2020-08-04&st=2026-03-29T22%3A05%3A27Z&se=2026-03-29T22%3A30%3A27Z&sr=b&sp=r&sig=abPHynH8s2xf0kifKXKlpOTe1ehQFdtJ3%2BPcXJSL4zU%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:05:34 [bca.uk] INFO: Found listing with ID: OO67%20KEZ
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OO67%2520KEZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:34 [bca.uk] INFO: Scrape type for OO67%20KEZ: 0
2026-03-29 22:05:34 [bca.uk] INFO: Found listing with ID: RF68%20YKB
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF68%2520YKB%27 HTTP/1.1" 200 None
2026-03-29 22:05:34 [bca.uk] INFO: Scrape type for RF68%20YKB: 0
2026-03-29 22:05:34 [bca.uk] INFO: Found listing with ID: EF03%20CXR
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF03%2520CXR%27 HTTP/1.1" 200 None
2026-03-29 22:05:34 [bca.uk] INFO: Scrape type for EF03%20CXR: 2
2026-03-29 22:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 163e018a-b246-5806-b6cb-44f52b19d7ff with identifier: EF03%20CXR
2026-03-29 22:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 163e018a-b246-5806-b6cb-44f52b19d7ff with scrape type 2
2026-03-29 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 163e018a-b246-5806-b6cb-44f52b19d7ff with scrape type 2
2026-03-29 22:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 163e018a-b246-5806-b6cb-44f52b19d7ff, identifier: EF03%20CXR
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699453604%27 HTTP/1.1" 200 None
2026-03-29 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453604 not downloaded yet
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699457962%27 HTTP/1.1" 200 None
2026-03-29 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457962 not downloaded yet
2026-03-29 22:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6334a7d0>
2026-03-29 22:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN62HLC%252F699456010%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456010/600 saved to cache
2026-03-29 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38dd9604-9daa-5b5e-902e-c598576d19d6
2026-03-29 22:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63307b90>
2026-03-29 22:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN62HLC%252F699456013%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456013/600 saved to cache
2026-03-29 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38dd9604-9daa-5b5e-902e-c598576d19d6
2026-03-29 22:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62115c90>
2026-03-29 22:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT14HGA%252F699399586%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399586/600 saved to cache
2026-03-29 22:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2
2026-03-29 22:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399587/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT14HGA/42812005?sv=2020-08-04&st=2026-03-29T22%3A05%3A17Z&se=2026-03-29T22%3A30%3A17Z&sr=b&sp=r&sig=waPrjmAums3L%2FvFzJ%2Fhg5dv7M7RjxxPDejipYOMZYCI%3D)
2026-03-29 22:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399594/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399594>
2026-03-29 22:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399592/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399592>
2026-03-29 22:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456023/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456023>
2026-03-29 22:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 163e018a-b246-5806-b6cb-44f52b19d7ff with identifier: EF03%20CXR
2026-03-29 22:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 163e018a-b246-5806-b6cb-44f52b19d7ff with identifier: EF03%20CXR
2026-03-29 22:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 163e018a-b246-5806-b6cb-44f52b19d7ff with identifier: EF03%20CXR to the API
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EF03%20CXR-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '163e018a-b246-5806-b6cb-44f52b19d7ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EF03 CXR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EF03%20CXR&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'PEUGEOT',
'model': '206',
'odometer': 41331,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-01-01',
'seller_name': None,
'title': 'PEUGEOT 206 1.4 HDI LX Hatchback',
'transmission': 'manual',
'trim': 'HDI LX',
'vin': 'VF32A8HXF43230681',
'year': 2003}
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF03%2520CXR%27 HTTP/1.1" 200 None
2026-03-29 22:05:35 [bca.uk] INFO: Saving data for EF03%20CXR: {'auction_closing_time': 1774951200.0, 'created_time': 1773958957.838155, 'last_price_update_time': 1774821935.108897}
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EF03%2520CXR') HTTP/1.1" 204 0
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456060%27 HTTP/1.1" 200 None
2026-03-29 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456060 not downloaded yet
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699415019%27 HTTP/1.1" 200 None
2026-03-29 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699415019 not downloaded yet
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699248731%27 HTTP/1.1" 200 None
2026-03-29 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248731 not downloaded yet
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387082%27 HTTP/1.1" 200 None
2026-03-29 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387082 not downloaded yet
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089066%27 HTTP/1.1" 200 None
2026-03-29 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089066 not downloaded yet
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699087938%27 HTTP/1.1" 200 None
2026-03-29 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699087938 not downloaded yet
2026-03-29 22:05:35 [bca.uk] INFO: Found listing with ID: LK18%20UPR
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK18%2520UPR%27 HTTP/1.1" 200 None
2026-03-29 22:05:35 [bca.uk] INFO: Scrape type for LK18%20UPR: 2
2026-03-29 22:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6166fbbb-aebd-5789-be19-28e4c3c043a6 with identifier: LK18%20UPR
2026-03-29 22:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6166fbbb-aebd-5789-be19-28e4c3c043a6 with scrape type 2
2026-03-29 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6166fbbb-aebd-5789-be19-28e4c3c043a6 with scrape type 2
2026-03-29 22:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6166fbbb-aebd-5789-be19-28e4c3c043a6, identifier: LK18%20UPR
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699453606%27 HTTP/1.1" 200 None
2026-03-29 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453606 not downloaded yet
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699457966%27 HTTP/1.1" 200 None
2026-03-29 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457966 not downloaded yet
2026-03-29 22:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61831510>
2026-03-29 22:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT14HGA%252F699399588%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399588/600 saved to cache
2026-03-29 22:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2
2026-03-29 22:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399590/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT14HGA/42812005?sv=2020-08-04&st=2026-03-29T22%3A05%3A17Z&se=2026-03-29T22%3A30%3A17Z&sr=b&sp=r&sig=waPrjmAums3L%2FvFzJ%2Fhg5dv7M7RjxxPDejipYOMZYCI%3D)
2026-03-29 22:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414847/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT66YMF/42812098?sv=2020-08-04&st=2026-03-29T22%3A05%3A18Z&se=2026-03-29T22%3A30%3A18Z&sr=b&sp=r&sig=vvtbY7lfWyfzUXxJcw4PY0HqZZ37wGJm65zbIBo7KHs%3D)
2026-03-29 22:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399591/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT14HGA/42812005?sv=2020-08-04&st=2026-03-29T22%3A05%3A17Z&se=2026-03-29T22%3A30%3A17Z&sr=b&sp=r&sig=waPrjmAums3L%2FvFzJ%2Fhg5dv7M7RjxxPDejipYOMZYCI%3D)
2026-03-29 22:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399598/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399598>
2026-03-29 22:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6166fbbb-aebd-5789-be19-28e4c3c043a6 with identifier: LK18%20UPR
2026-03-29 22:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6166fbbb-aebd-5789-be19-28e4c3c043a6 with identifier: LK18%20UPR
2026-03-29 22:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6166fbbb-aebd-5789-be19-28e4c3c043a6 with identifier: LK18%20UPR to the API
2026-03-29 22:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LK18%20UPR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6166fbbb-aebd-5789-be19-28e4c3c043a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LK18 UPR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LK18%20UPR&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'CITROEN',
'model': 'C1 AIRSCAPE',
'odometer': 58499,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'CITROEN C1 AIRSCAPE 1.2 P/T 82 FLAIR Convertible',
'transmission': 'manual',
'trim': 'P/T 82 FLAIR',
'vin': 'VF7PAHMTCHR814560',
'year': 2018}
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK18%2520UPR%27 HTTP/1.1" 200 None
2026-03-29 22:05:36 [bca.uk] INFO: Saving data for LK18%20UPR: {'auction_closing_time': 1774951200.0, 'created_time': 1773838781.219041, 'last_price_update_time': 1774821936.237007}
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LK18%2520UPR') HTTP/1.1" 204 0
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699456064%27 HTTP/1.1" 200 None
2026-03-29 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456064 not downloaded yet
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699415047%27 HTTP/1.1" 200 None
2026-03-29 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699415047 not downloaded yet
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699248736%27 HTTP/1.1" 200 None
2026-03-29 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248736 not downloaded yet
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387090%27 HTTP/1.1" 200 None
2026-03-29 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387090 not downloaded yet
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089069%27 HTTP/1.1" 200 None
2026-03-29 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089069 not downloaded yet
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699087956%27 HTTP/1.1" 200 None
2026-03-29 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699087956 not downloaded yet
2026-03-29 22:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6156bf10>
2026-03-29 22:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_expert_report_file_ba9de00d-7ef3-4186-b56a-e0f5924b07c1.pdf HTTP/1.1" 201 0
2026-03-29 22:05:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82
2026-03-29 22:05:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82, skipping ID generation
2026-03-29 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLV08TVU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LV08TVU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456046/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ62YDS/42810080?sv=2020-08-04&st=2026-03-29T22%3A05%3A13Z&se=2026-03-29T22%3A30%3A13Z&sr=b&sp=r&sig=3uF2r926LhFkKPoPLSCohRVnNGX4IbgEWDcBb0D1E%2B8%3D)
2026-03-29 22:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399599/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399599>
2026-03-29 22:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456049/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ62YDS/42810080?sv=2020-08-04&st=2026-03-29T22%3A05%3A13Z&se=2026-03-29T22%3A30%3A13Z&sr=b&sp=r&sig=3uF2r926LhFkKPoPLSCohRVnNGX4IbgEWDcBb0D1E%2B8%3D)
2026-03-29 22:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453601/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FV59NFX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:05:36 [bca.uk] INFO: Found listing with ID: KK15%20GPV
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK15%2520GPV%27 HTTP/1.1" 200 None
2026-03-29 22:05:36 [bca.uk] INFO: Scrape type for KK15%20GPV: 0
2026-03-29 22:05:36 [bca.uk] INFO: Found listing with ID: SV15%20VVF
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV15%2520VVF%27 HTTP/1.1" 200 None
2026-03-29 22:05:36 [bca.uk] INFO: Scrape type for SV15%20VVF: 0
2026-03-29 22:05:36 [bca.uk] INFO: Found listing with ID: LK66%20RLX
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK66%2520RLX%27 HTTP/1.1" 200 None
2026-03-29 22:05:36 [bca.uk] INFO: Scrape type for LK66%20RLX: 2
2026-03-29 22:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2941f3b-ec29-50d8-afbd-e8c8587ed823 with identifier: LK66%20RLX
2026-03-29 22:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2941f3b-ec29-50d8-afbd-e8c8587ed823 with scrape type 2
2026-03-29 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2941f3b-ec29-50d8-afbd-e8c8587ed823 with scrape type 2
2026-03-29 22:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e2941f3b-ec29-50d8-afbd-e8c8587ed823, identifier: LK66%20RLX
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699453607%27 HTTP/1.1" 200 None
2026-03-29 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453607 not downloaded yet
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699457969%27 HTTP/1.1" 200 None
2026-03-29 22:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457969 not downloaded yet
2026-03-29 22:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e2941f3b-ec29-50d8-afbd-e8c8587ed823 with identifier: LK66%20RLX
2026-03-29 22:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e2941f3b-ec29-50d8-afbd-e8c8587ed823 with identifier: LK66%20RLX
2026-03-29 22:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e2941f3b-ec29-50d8-afbd-e8c8587ed823 with identifier: LK66%20RLX to the API
2026-03-29 22:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LK66%20RLX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e2941f3b-ec29-50d8-afbd-e8c8587ed823',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LK66 RLX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LK66%20RLX&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VAUXHALL',
'model': 'MOKKA',
'odometer': 102427,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL MOKKA 1.4 T 140 EXCLUSIV 2WD S/S StationWagon',
'transmission': 'manual',
'trim': 'T 140 EXCLUSIV 2WD S/S',
'vin': 'W0LJC7E84GB728209',
'year': 2016}
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK66%2520RLX%27 HTTP/1.1" 200 None
2026-03-29 22:05:37 [bca.uk] INFO: Saving data for LK66%20RLX: {'auction_closing_time': 1774864800.0, 'created_time': 1774622055.031987, 'last_price_update_time': 1774821937.145543}
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LK66%2520RLX') HTTP/1.1" 204 0
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699415080%27 HTTP/1.1" 200 None
2026-03-29 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699415080 not downloaded yet
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699248749%27 HTTP/1.1" 200 None
2026-03-29 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248749 not downloaded yet
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387104%27 HTTP/1.1" 200 None
2026-03-29 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387104 not downloaded yet
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089077%27 HTTP/1.1" 200 None
2026-03-29 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089077 not downloaded yet
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699087971%27 HTTP/1.1" 200 None
2026-03-29 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699087971 not downloaded yet
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292578%27 HTTP/1.1" 200 None
2026-03-29 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292578 not downloaded yet
2026-03-29 22:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61605450>
2026-03-29 22:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT14HGA%252F699399587%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399587/600 saved to cache
2026-03-29 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2
2026-03-29 22:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414882/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT66YMF/42812098?sv=2020-08-04&st=2026-03-29T22%3A05%3A18Z&se=2026-03-29T22%3A30%3A18Z&sr=b&sp=r&sig=vvtbY7lfWyfzUXxJcw4PY0HqZZ37wGJm65zbIBo7KHs%3D)
2026-03-29 22:05:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453602/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453602>
2026-03-29 22:05:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457959/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SV14TTZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:05:37 [bca.uk] INFO: Found listing with ID: MJ65%20XFP
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ65%2520XFP%27 HTTP/1.1" 200 None
2026-03-29 22:05:37 [bca.uk] INFO: Scrape type for MJ65%20XFP: 0
2026-03-29 22:05:37 [bca.uk] INFO: Found listing with ID: SM70%20LKK
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM70%2520LKK%27 HTTP/1.1" 200 None
2026-03-29 22:05:37 [bca.uk] INFO: Scrape type for SM70%20LKK: 0
2026-03-29 22:05:37 [bca.uk] INFO: Found listing with ID: AJ17%20HXL
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ17%2520HXL%27 HTTP/1.1" 200 None
2026-03-29 22:05:37 [bca.uk] INFO: Scrape type for AJ17%20HXL: 2
2026-03-29 22:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a541890-0343-5ec1-9e09-787ef67af079 with identifier: AJ17%20HXL
2026-03-29 22:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a541890-0343-5ec1-9e09-787ef67af079 with scrape type 2
2026-03-29 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a541890-0343-5ec1-9e09-787ef67af079 with scrape type 2
2026-03-29 22:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2a541890-0343-5ec1-9e09-787ef67af079, identifier: AJ17%20HXL
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699453609%27 HTTP/1.1" 200 None
2026-03-29 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453609 not downloaded yet
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699457975%27 HTTP/1.1" 200 None
2026-03-29 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457975 not downloaded yet
2026-03-29 22:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456023/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN62HLC/42810081?sv=2020-08-04&st=2026-03-29T22%3A05%3A15Z&se=2026-03-29T22%3A30%3A15Z&sr=b&sp=r&sig=7S8WdQ3gHe92IypMlrTOVxGXU1Uqv27G6oYLRI%2FeI0k%3D)
2026-03-29 22:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2a541890-0343-5ec1-9e09-787ef67af079 with identifier: AJ17%20HXL
2026-03-29 22:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2a541890-0343-5ec1-9e09-787ef67af079 with identifier: AJ17%20HXL
2026-03-29 22:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2a541890-0343-5ec1-9e09-787ef67af079 with identifier: AJ17%20HXL to the API
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AJ17%20HXL-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2a541890-0343-5ec1-9e09-787ef67af079',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AJ17 HXL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AJ17%20HXL&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'AUDI',
'model': 'A4',
'odometer': 121130,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'AUDI A4 2.0 TDI 190 S LINE S-T Saloon',
'transmission': 'automatic',
'trim': 'TDI 190 S LINE S-T',
'vin': 'WAUZZZF42HA171296',
'year': 2017}
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ17%2520HXL%27 HTTP/1.1" 200 None
2026-03-29 22:05:37 [bca.uk] INFO: Saving data for AJ17%20HXL: {'auction_closing_time': 1774864800.0, 'created_time': 1774706800.928404, 'last_price_update_time': 1774821937.837283}
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AJ17%2520HXL') HTTP/1.1" 204 0
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699248758%27 HTTP/1.1" 200 None
2026-03-29 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248758 not downloaded yet
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387115%27 HTTP/1.1" 200 None
2026-03-29 22:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387115 not downloaded yet
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089085%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089085 not downloaded yet
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699087994%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699087994 not downloaded yet
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292583%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292583 not downloaded yet
2026-03-29 22:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399598/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT14HGA/42812005?sv=2020-08-04&st=2026-03-29T22%3A05%3A17Z&se=2026-03-29T22%3A30%3A17Z&sr=b&sp=r&sig=waPrjmAums3L%2FvFzJ%2Fhg5dv7M7RjxxPDejipYOMZYCI%3D)
2026-03-29 22:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399592/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT14HGA/42812005?sv=2020-08-04&st=2026-03-29T22%3A05%3A17Z&se=2026-03-29T22%3A30%3A17Z&sr=b&sp=r&sig=waPrjmAums3L%2FvFzJ%2Fhg5dv7M7RjxxPDejipYOMZYCI%3D)
2026-03-29 22:05:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087913/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699087913>
2026-03-29 22:05:38 [bca.uk] INFO: Found listing with ID: AO65%20YFV
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO65%2520YFV%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [bca.uk] INFO: Scrape type for AO65%20YFV: 0
2026-03-29 22:05:38 [bca.uk] INFO: Found listing with ID: EY18%20ZXV
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY18%2520ZXV%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [bca.uk] INFO: Scrape type for EY18%20ZXV: 0
2026-03-29 22:05:38 [bca.uk] INFO: Found listing with ID: HV15%20WJD
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV15%2520WJD%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [bca.uk] INFO: Scrape type for HV15%20WJD: 0
2026-03-29 22:05:38 [bca.uk] INFO: Found listing with ID: KM62%20FPV
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM62%2520FPV%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [bca.uk] INFO: Scrape type for KM62%20FPV: 0
2026-03-29 22:05:38 [bca.uk] INFO: Found listing with ID: BG56%20VSO
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG56%2520VSO%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [bca.uk] INFO: Scrape type for BG56%20VSO: 0
2026-03-29 22:05:38 [bca.uk] INFO: Found listing with ID: EN59%20JWZ
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN59%2520JWZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [bca.uk] INFO: Scrape type for EN59%20JWZ: 2
2026-03-29 22:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d19c9ad-3315-53e0-b169-a727286e3c05 with identifier: EN59%20JWZ
2026-03-29 22:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d19c9ad-3315-53e0-b169-a727286e3c05 with scrape type 2
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d19c9ad-3315-53e0-b169-a727286e3c05 with scrape type 2
2026-03-29 22:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2d19c9ad-3315-53e0-b169-a727286e3c05, identifier: EN59%20JWZ
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699453612%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453612 not downloaded yet
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699457978%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457978 not downloaded yet
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61109310>
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT14HGA%252F699399590%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399590/600 saved to cache
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632d9190>
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT66YMF%252F699414847%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414847/600 saved to cache
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5cb9c1b-2fac-5aa0-89c7-e23c2249811e
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62072890>
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT14HGA%252F699399591%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399591/600 saved to cache
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632ef710>
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ62YDS%252F699456046%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456046/600 saved to cache
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e23ce11-f3f0-5635-b5b9-03f2e6272954
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614bf1d0>
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ62YDS%252F699456049%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456049/600 saved to cache
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e23ce11-f3f0-5635-b5b9-03f2e6272954
2026-03-29 22:05:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089066/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089066>
2026-03-29 22:05:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087938/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699087938>
2026-03-29 22:05:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387082/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387082>
2026-03-29 22:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399594/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT14HGA/42812005?sv=2020-08-04&st=2026-03-29T22%3A05%3A17Z&se=2026-03-29T22%3A30%3A17Z&sr=b&sp=r&sig=waPrjmAums3L%2FvFzJ%2Fhg5dv7M7RjxxPDejipYOMZYCI%3D)
2026-03-29 22:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2d19c9ad-3315-53e0-b169-a727286e3c05 with identifier: EN59%20JWZ
2026-03-29 22:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2d19c9ad-3315-53e0-b169-a727286e3c05 with identifier: EN59%20JWZ
2026-03-29 22:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2d19c9ad-3315-53e0-b169-a727286e3c05 with identifier: EN59%20JWZ to the API
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN59%20JWZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2d19c9ad-3315-53e0-b169-a727286e3c05',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN59 JWZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN59%20JWZ&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 91926,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.6 TDI 105 SE DSG Hatchback',
'transmission': 'automatic',
'trim': 'TDI 105 SE DSG',
'vin': 'WVWZZZ1KZAW251032',
'year': 2010}
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN59%2520JWZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [bca.uk] INFO: Saving data for EN59%20JWZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774620404.685872, 'last_price_update_time': 1774821938.83619}
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN59%2520JWZ') HTTP/1.1" 204 0
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699248774%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248774 not downloaded yet
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387126%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387126 not downloaded yet
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089093%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089093 not downloaded yet
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699088014%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699088014 not downloaded yet
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292589%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292589 not downloaded yet
2026-03-29 22:05:38 [bca.uk] INFO: Found listing with ID: GD10%20BNJ
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD10%2520BNJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [bca.uk] INFO: Scrape type for GD10%20BNJ: 0
2026-03-29 22:05:38 [bca.uk] INFO: Found listing with ID: GY62%20OLR
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY62%2520OLR%27 HTTP/1.1" 200 None
2026-03-29 22:05:38 [bca.uk] INFO: Scrape type for GY62%20OLR: 0
2026-03-29 22:05:38 [bca.uk] INFO: Found listing with ID: LJ63%20JYB
2026-03-29 22:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ63%2520JYB%27 HTTP/1.1" 200 None
2026-03-29 22:05:39 [bca.uk] INFO: Scrape type for LJ63%20JYB: 0
2026-03-29 22:05:39 [bca.uk] INFO: Found listing with ID: LS06%20BVE
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS06%2520BVE%27 HTTP/1.1" 200 None
2026-03-29 22:05:39 [bca.uk] INFO: Scrape type for LS06%20BVE: 0
2026-03-29 22:05:39 [bca.uk] INFO: Found listing with ID: LT10%20XJA
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT10%2520XJA%27 HTTP/1.1" 200 None
2026-03-29 22:05:39 [bca.uk] INFO: Scrape type for LT10%20XJA: 0
2026-03-29 22:05:39 [bca.uk] INFO: Found listing with ID: LT64%20YWX
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT64%2520YWX%27 HTTP/1.1" 200 None
2026-03-29 22:05:39 [bca.uk] INFO: Scrape type for LT64%20YWX: 0
2026-03-29 22:05:39 [bca.uk] INFO: Found listing with ID: ML10%20HFR
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML10%2520HFR%27 HTTP/1.1" 200 None
2026-03-29 22:05:39 [bca.uk] INFO: Scrape type for ML10%20HFR: 0
2026-03-29 22:05:39 [bca.uk] INFO: Found listing with ID: NA52%20HNU
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA52%2520HNU%27 HTTP/1.1" 200 None
2026-03-29 22:05:39 [bca.uk] INFO: Scrape type for NA52%20HNU: 0
2026-03-29 22:05:39 [bca.uk] INFO: Found listing with ID: NJ15%20YWH
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ15%2520YWH%27 HTTP/1.1" 200 None
2026-03-29 22:05:39 [bca.uk] INFO: Scrape type for NJ15%20YWH: 2
2026-03-29 22:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15ee6299-9b47-56d1-8afa-f9d9bcf94303 with identifier: NJ15%20YWH
2026-03-29 22:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15ee6299-9b47-56d1-8afa-f9d9bcf94303 with scrape type 2
2026-03-29 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15ee6299-9b47-56d1-8afa-f9d9bcf94303 with scrape type 2
2026-03-29 22:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 15ee6299-9b47-56d1-8afa-f9d9bcf94303, identifier: NJ15%20YWH
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699453615%27 HTTP/1.1" 200 None
2026-03-29 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453615 not downloaded yet
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699457986%27 HTTP/1.1" 200 None
2026-03-29 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457986 not downloaded yet
2026-03-29 22:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6193c450>
2026-03-29 22:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT66YMF%252F699414882%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414882/600 saved to cache
2026-03-29 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5cb9c1b-2fac-5aa0-89c7-e23c2249811e
2026-03-29 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620d5990>
2026-03-29 22:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN62HLC%252F699456023%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456023/600 saved to cache
2026-03-29 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38dd9604-9daa-5b5e-902e-c598576d19d6
2026-03-29 22:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453601/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV59NFX/42798282?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Vj26nnLk4nUkuQUUMphnLssRjpy6Za6fEO4Q%2BW%2BcKKU%3D)
2026-03-29 22:05:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087956/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699087956>
2026-03-29 22:05:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292570/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LV08TVU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 15ee6299-9b47-56d1-8afa-f9d9bcf94303 with identifier: NJ15%20YWH
2026-03-29 22:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 15ee6299-9b47-56d1-8afa-f9d9bcf94303 with identifier: NJ15%20YWH
2026-03-29 22:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 15ee6299-9b47-56d1-8afa-f9d9bcf94303 with identifier: NJ15%20YWH to the API
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NJ15%20YWH-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '15ee6299-9b47-56d1-8afa-f9d9bcf94303',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NJ15 YWH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NJ15%20YWH&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 56932,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 70 STING Hatchback',
'transmission': 'manual',
'trim': '70 STING',
'vin': 'W0L0XEP08F6043548',
'year': 2015}
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ15%2520YWH%27 HTTP/1.1" 200 None
2026-03-29 22:05:39 [bca.uk] INFO: Saving data for NJ15%20YWH: {'auction_closing_time': 1774864800.0, 'created_time': 1774610513.187272, 'last_price_update_time': 1774821939.721826}
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NJ15%2520YWH') HTTP/1.1" 204 0
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699248790%27 HTTP/1.1" 200 None
2026-03-29 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248790 not downloaded yet
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387138%27 HTTP/1.1" 200 None
2026-03-29 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387138 not downloaded yet
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089099%27 HTTP/1.1" 200 None
2026-03-29 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089099 not downloaded yet
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699088035%27 HTTP/1.1" 200 None
2026-03-29 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699088035 not downloaded yet
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292594%27 HTTP/1.1" 200 None
2026-03-29 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292594 not downloaded yet
2026-03-29 22:05:39 [bca.uk] INFO: Total items found: 100
2026-03-29 22:05:39 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded
2026-03-29 22:05:39 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:05:39 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620ac2d0>
2026-03-29 22:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT14HGA%252F699399598%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399598/600 saved to cache
2026-03-29 22:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2
2026-03-29 22:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6328c6d0>
2026-03-29 22:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT14HGA%252F699399592%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399592/600 saved to cache
2026-03-29 22:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2
2026-03-29 22:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453602/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV59NFX/42798282?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Vj26nnLk4nUkuQUUMphnLssRjpy6Za6fEO4Q%2BW%2BcKKU%3D)
2026-03-29 22:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457959/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV14TTZ/42810271?sv=2020-08-04&st=2026-03-29T22%3A05%3A26Z&se=2026-03-29T22%3A30%3A26Z&sr=b&sp=r&sig=FgPAFqZLo2N8ZmxnTVXtDLCOVp7mvYK9n8e2P5I%2F32w%3D)
2026-03-29 22:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087913/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP65JXL/42808111?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=NuWfvCjhCnPVyKXKJ4JcyeNaRmV90x6ROfl09hllUPs%3D)
2026-03-29 22:05:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457969/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457969>
2026-03-29 22:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399599/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT14HGA/42812005?sv=2020-08-04&st=2026-03-29T22%3A05%3A17Z&se=2026-03-29T22%3A30%3A17Z&sr=b&sp=r&sig=waPrjmAums3L%2FvFzJ%2Fhg5dv7M7RjxxPDejipYOMZYCI%3D)
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: RJ03%20NRF
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ03%2520NRF%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for RJ03%20NRF: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: WD59%20AZX
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD59%2520AZX%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for WD59%20AZX: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: YB57%20FZC
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB57%2520FZC%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for YB57%20FZC: 2
2026-03-29 22:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9b1844a-f6e4-586f-88aa-fc22f6ebd424 with identifier: YB57%20FZC
2026-03-29 22:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9b1844a-f6e4-586f-88aa-fc22f6ebd424 with scrape type 2
2026-03-29 22:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9b1844a-f6e4-586f-88aa-fc22f6ebd424 with scrape type 2
2026-03-29 22:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b9b1844a-f6e4-586f-88aa-fc22f6ebd424, identifier: YB57%20FZC
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699453618%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453618 not downloaded yet
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699457995%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457995 not downloaded yet
2026-03-29 22:05:40 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:05:40 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b9b1844a-f6e4-586f-88aa-fc22f6ebd424 with identifier: YB57%20FZC
2026-03-29 22:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b9b1844a-f6e4-586f-88aa-fc22f6ebd424 with identifier: YB57%20FZC
2026-03-29 22:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b9b1844a-f6e4-586f-88aa-fc22f6ebd424 with identifier: YB57%20FZC to the API
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 183,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YB57%20FZC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b9b1844a-f6e4-586f-88aa-fc22f6ebd424',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YB57 FZC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YB57%20FZC&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'AUDI',
'model': 'TT',
'odometer': 98220,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'AUDI TT 2.0 TFSI Coupe',
'transmission': 'manual',
'trim': 'TFSI',
'vin': 'TRUZZZ8J481029866',
'year': 2007}
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB57%2520FZC%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Saving data for YB57%20FZC: {'auction_closing_time': 1774864800.0, 'created_time': 1774706806.37222, 'last_price_update_time': 1774821940.523887}
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YB57%2520FZC') HTTP/1.1" 204 0
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699088069%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699088069 not downloaded yet
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292601%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292601 not downloaded yet
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: EO65%20KNR
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO65%2520KNR%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for EO65%20KNR: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: LL62%20RXR
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL62%2520RXR%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for LL62%20RXR: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: HX68%20VCJ
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX68%2520VCJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for HX68%20VCJ: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: FL17%20JFX
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL17%2520JFX%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for FL17%20JFX: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: FJ20%20RXK
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ20%2520RXK%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for FJ20%20RXK: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: BJ67%20FKL
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ67%2520FKL%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for BJ67%20FKL: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: GX10%20XBP
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX10%2520XBP%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for GX10%20XBP: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: YS64%20UYZ
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS64%2520UYZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for YS64%20UYZ: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: YG13%20JDU
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG13%2520JDU%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for YG13%20JDU: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: YA19%20LLG
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA19%2520LLG%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for YA19%20LLG: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: VK67%20ENL
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK67%2520ENL%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for VK67%20ENL: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: SV18%20GVY
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV18%2520GVY%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for SV18%20GVY: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: OW17%20KLK
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW17%2520KLK%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for OW17%20KLK: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: EY20%20UZX
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY20%2520UZX%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for EY20%20UZX: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: YF20%20YTC
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF20%2520YTC%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for YF20%20YTC: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: OV13%20ULH
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV13%2520ULH%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for OV13%20ULH: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: LM17%20HLX
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM17%2520HLX%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for LM17%20HLX: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: GK61%20APX
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK61%2520APX%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for GK61%20APX: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: GF71%20YDC
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF71%2520YDC%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for GF71%20YDC: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: ET66%20WBO
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET66%2520WBO%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for ET66%20WBO: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: EO66%20BRV
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO66%2520BRV%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for EO66%20BRV: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: EJ19%20NRO
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ19%2520NRO%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for EJ19%20NRO: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: DE62%20FON
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE62%2520FON%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for DE62%20FON: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: RK21%20HHP
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK21%2520HHP%27 HTTP/1.1" 200 None
2026-03-29 22:05:40 [bca.uk] INFO: Scrape type for RK21%20HHP: 0
2026-03-29 22:05:40 [bca.uk] INFO: Found listing with ID: PK21%20JWF
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK21%2520JWF%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for PK21%20JWF: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: MV13%20FCF
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV13%2520FCF%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for MV13%20FCF: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: MJ16%20VHE
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ16%2520VHE%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for MJ16%20VHE: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: MH22%20KGO
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH22%2520KGO%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for MH22%20KGO: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: MC66%20XFJ
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC66%2520XFJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for MC66%20XFJ: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: GF19%20JNN
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF19%2520JNN%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for GF19%20JNN: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: EJ65%20WRC
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ65%2520WRC%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for EJ65%20WRC: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: CK20%20UDP
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK20%2520UDP%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for CK20%20UDP: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: BU19%20YAO
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU19%2520YAO%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for BU19%20YAO: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: YH19%20KBB
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH19%2520KBB%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for YH19%20KBB: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: YE62%20AZZ
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE62%2520AZZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for YE62%20AZZ: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: XO09%20SEB
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27XO09%2520SEB%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for XO09%20SEB: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: RY65%20VKS
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY65%2520VKS%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for RY65%20VKS: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: RJ16%20CDK
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ16%2520CDK%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for RJ16%20CDK: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: RF17%20GVT
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF17%2520GVT%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for RF17%20GVT: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: ND16%20UAR
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND16%2520UAR%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for ND16%20UAR: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: LD69%20WFH
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD69%2520WFH%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for LD69%20WFH: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: KR68%20LWZ
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR68%2520LWZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for KR68%20LWZ: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: GV14%20CUC
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV14%2520CUC%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for GV14%20CUC: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: GD69%20OMW
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD69%2520OMW%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for GD69%20OMW: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: EK68%20WBM
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK68%2520WBM%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for EK68%20WBM: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: EF63%20OVD
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF63%2520OVD%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for EF63%20OVD: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: BL66%20VSC
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL66%2520VSC%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for BL66%20VSC: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: AE64%20XBG
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE64%2520XBG%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for AE64%20XBG: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: YD65%20BVG
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD65%2520BVG%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for YD65%20BVG: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: EX69%20XSC
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX69%2520XSC%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for EX69%20XSC: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: DF17%20NMJ
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF17%2520NMJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for DF17%20NMJ: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: DA11%20MYU
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA11%2520MYU%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for DA11%20MYU: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: AX64%20FEG
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX64%2520FEG%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for AX64%20FEG: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: AO19%20AUH
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO19%2520AUH%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for AO19%20AUH: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: N44%20CNC
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27N44%2520CNC%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for N44%20CNC: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: S10%20ULU
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S10%2520ULU%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for S10%20ULU: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: KS17%20LFM
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS17%2520LFM%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for KS17%20LFM: 2
2026-03-29 22:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7e7267c-3859-58ff-bb8b-d88955b93932 with identifier: KS17%20LFM
2026-03-29 22:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7e7267c-3859-58ff-bb8b-d88955b93932 with scrape type 2
2026-03-29 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7e7267c-3859-58ff-bb8b-d88955b93932 with scrape type 2
2026-03-29 22:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a7e7267c-3859-58ff-bb8b-d88955b93932, identifier: KS17%20LFM
2026-03-29 22:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61529890>
2026-03-29 22:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT14HGA%252F699399594%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399594/600 saved to cache
2026-03-29 22:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2
2026-03-29 22:05:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457975/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457975>
2026-03-29 22:05:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453609/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453609>
2026-03-29 22:05:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292578/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292578>
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: YN08%20UVD
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN08%2520UVD%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for YN08%20UVD: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: AJ59%20YCC
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ59%2520YCC%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for AJ59%20YCC: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: BG61%20XGP
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG61%2520XGP%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for BG61%20XGP: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: DA59%20ZDF
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA59%2520ZDF%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for DA59%20ZDF: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: DE61%20AVB
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE61%2520AVB%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for DE61%20AVB: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: DU11%20ZKX
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU11%2520ZKX%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for DU11%20ZKX: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: EJ11%20WXD
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ11%2520WXD%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for EJ11%20WXD: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: ET10%20FWV
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET10%2520FWV%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for ET10%20FWV: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: FE12%20WRX
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE12%2520WRX%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for FE12%20WRX: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: FN15%20HLM
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN15%2520HLM%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for FN15%20HLM: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: MV65%20OCE
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV65%2520OCE%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for MV65%20OCE: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: NJ14%20XCP
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ14%2520XCP%27 HTTP/1.1" 200 None
2026-03-29 22:05:41 [bca.uk] INFO: Scrape type for NJ14%20XCP: 0
2026-03-29 22:05:41 [bca.uk] INFO: Found listing with ID: HK69%20RSZ
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK69%2520RSZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:42 [bca.uk] INFO: Scrape type for HK69%20RSZ: 0
2026-03-29 22:05:42 [bca.uk] INFO: Found listing with ID: KX18%20YJZ
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX18%2520YJZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:42 [bca.uk] INFO: Scrape type for KX18%20YJZ: 0
2026-03-29 22:05:42 [bca.uk] INFO: Found listing with ID: AV67%20YOM
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV67%2520YOM%27 HTTP/1.1" 200 None
2026-03-29 22:05:42 [bca.uk] INFO: Scrape type for AV67%20YOM: 0
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699453622%27 HTTP/1.1" 200 None
2026-03-29 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453622 not downloaded yet
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699458005%27 HTTP/1.1" 200 None
2026-03-29 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699458005 not downloaded yet
2026-03-29 22:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a7e7267c-3859-58ff-bb8b-d88955b93932 with identifier: KS17%20LFM
2026-03-29 22:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a7e7267c-3859-58ff-bb8b-d88955b93932 with identifier: KS17%20LFM
2026-03-29 22:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a7e7267c-3859-58ff-bb8b-d88955b93932 with identifier: KS17%20LFM to the API
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS17%20LFM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a7e7267c-3859-58ff-bb8b-d88955b93932',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS17 LFM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KS17%20LFM&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'MERCEDES-BENZ',
'model': 'C220 D',
'odometer': 54967,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C220 D 2.1 SPORT 9G Saloon',
'transmission': 'manual',
'trim': 'SPORT 9G',
'vin': 'WDD2050042R277834',
'year': 2017}
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS17%2520LFM%27 HTTP/1.1" 200 None
2026-03-29 22:05:42 [bca.uk] INFO: Saving data for KS17%20LFM: {'auction_closing_time': 1774864800.0, 'created_time': 1774621325.060619, 'last_price_update_time': 1774821942.386598}
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KS17%2520LFM') HTTP/1.1" 204 0
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292612%27 HTTP/1.1" 200 None
2026-03-29 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292612 not downloaded yet
2026-03-29 22:05:42 [bca.uk] INFO: Found listing with ID: DS64%20KUP
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS64%2520KUP%27 HTTP/1.1" 200 None
2026-03-29 22:05:42 [bca.uk] INFO: Scrape type for DS64%20KUP: 2
2026-03-29 22:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff597d53-a947-58e9-aa57-dc9ae1cfe4df with identifier: DS64%20KUP
2026-03-29 22:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff597d53-a947-58e9-aa57-dc9ae1cfe4df with scrape type 2
2026-03-29 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff597d53-a947-58e9-aa57-dc9ae1cfe4df with scrape type 2
2026-03-29 22:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ff597d53-a947-58e9-aa57-dc9ae1cfe4df, identifier: DS64%20KUP
2026-03-29 22:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087938/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP65JXL/42808111?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=NuWfvCjhCnPVyKXKJ4JcyeNaRmV90x6ROfl09hllUPs%3D)
2026-03-29 22:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089066/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP15SYH/42806364?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Rd4qYDMjPlPfw1eY2qRBNLd1xHPVQnmq6D8gIEro12k%3D)
2026-03-29 22:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087971/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699087971>
2026-03-29 22:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292583/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292583>
2026-03-29 22:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387082/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV68URC/42811821?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=UqKQThY1MQH5ObDZI1ey2MVklXRiFzm7WSFSP9Yo17U%3D)
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699458013%27 HTTP/1.1" 200 None
2026-03-29 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699458013 not downloaded yet
2026-03-29 22:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ff597d53-a947-58e9-aa57-dc9ae1cfe4df with identifier: DS64%20KUP
2026-03-29 22:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ff597d53-a947-58e9-aa57-dc9ae1cfe4df with identifier: DS64%20KUP
2026-03-29 22:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ff597d53-a947-58e9-aa57-dc9ae1cfe4df with identifier: DS64%20KUP to the API
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DS64%20KUP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ff597d53-a947-58e9-aa57-dc9ae1cfe4df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DS64 KUP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DS64%20KUP&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'VAUXHALL',
'model': 'INSIGNIA',
'odometer': 174991,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA 2.0 CDTI E/F 140 ELITE Hatchback',
'transmission': 'manual',
'trim': 'CDTI E/F 140 ELITE',
'vin': 'W0LGT6ES0E1188666',
'year': 2015}
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS64%2520KUP%27 HTTP/1.1" 200 None
2026-03-29 22:05:42 [bca.uk] INFO: Saving data for DS64%20KUP: {'auction_closing_time': 1774864800.0, 'created_time': 1774621319.366533, 'last_price_update_time': 1774821942.936368}
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DS64%2520KUP') HTTP/1.1" 204 0
2026-03-29 22:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6a499090>
2026-03-29 22:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV59NFX%252F699453601%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453601/600 saved to cache
2026-03-29 22:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75379e98-ec74-5bb8-a2ba-dee078101af0
2026-03-29 22:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62115650>
2026-03-29 22:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV59NFX%252F699453602%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453602/600 saved to cache
2026-03-29 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75379e98-ec74-5bb8-a2ba-dee078101af0
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6156e450>
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV14TTZ%252F699457959%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457959/600 saved to cache
2026-03-29 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3909531a-470f-5688-8297-acd46a9f879d
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61634f90>
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP65JXL%252F699087913%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087913/600 saved to cache
2026-03-29 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4
2026-03-29 22:05:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6156c510>
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT14HGA%252F699399599%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399599/600 saved to cache
2026-03-29 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2
2026-03-29 22:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087956/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP65JXL/42808111?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=NuWfvCjhCnPVyKXKJ4JcyeNaRmV90x6ROfl09hllUPs%3D)
2026-03-29 22:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292570/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV08TVU/42787563?sv=2020-08-04&st=2026-03-29T22%3A05%3A27Z&se=2026-03-29T22%3A30%3A27Z&sr=b&sp=r&sig=abPHynH8s2xf0kifKXKlpOTe1ehQFdtJ3%2BPcXJSL4zU%3D)
2026-03-29 22:05:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292589/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292589>
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292636%27 HTTP/1.1" 200 None
2026-03-29 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292636 not downloaded yet
2026-03-29 22:05:43 [bca.uk] INFO: Found listing with ID: DY61%20NHM
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY61%2520NHM%27 HTTP/1.1" 200 None
2026-03-29 22:05:43 [bca.uk] INFO: Scrape type for DY61%20NHM: 0
2026-03-29 22:05:43 [bca.uk] INFO: Found listing with ID: EU12%20RAX
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU12%2520RAX%27 HTTP/1.1" 200 None
2026-03-29 22:05:43 [bca.uk] INFO: Scrape type for EU12%20RAX: 0
2026-03-29 22:05:43 [bca.uk] INFO: Found listing with ID: FG12%20NLT
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG12%2520NLT%27 HTTP/1.1" 200 None
2026-03-29 22:05:43 [bca.uk] INFO: Scrape type for FG12%20NLT: 2
2026-03-29 22:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa26ba11-51d0-5aa4-bedc-fa00c3caea9b with identifier: FG12%20NLT
2026-03-29 22:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa26ba11-51d0-5aa4-bedc-fa00c3caea9b with scrape type 2
2026-03-29 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa26ba11-51d0-5aa4-bedc-fa00c3caea9b with scrape type 2
2026-03-29 22:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: aa26ba11-51d0-5aa4-bedc-fa00c3caea9b, identifier: FG12%20NLT
2026-03-29 22:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: aa26ba11-51d0-5aa4-bedc-fa00c3caea9b with identifier: FG12%20NLT
2026-03-29 22:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: aa26ba11-51d0-5aa4-bedc-fa00c3caea9b with identifier: FG12%20NLT
2026-03-29 22:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: aa26ba11-51d0-5aa4-bedc-fa00c3caea9b with identifier: FG12%20NLT to the API
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 189,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG12%20NLT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'aa26ba11-51d0-5aa4-bedc-fa00c3caea9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG12 NLT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FG12%20NLT&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'HYUNDAI',
'model': 'IX35',
'odometer': 137263,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'HYUNDAI IX35 2.0 CRDI PREMIUM 4WD StationWagon',
'transmission': 'automatic',
'trim': 'CRDI PREMIUM 4WD',
'vin': 'TMAJU81VSCJ285868',
'year': 2012}
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG12%2520NLT%27 HTTP/1.1" 200 None
2026-03-29 22:05:43 [bca.uk] INFO: Saving data for FG12%20NLT: {'auction_closing_time': 1774864800.0, 'created_time': 1774621317.605293, 'last_price_update_time': 1774821943.689997}
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FG12%2520NLT') HTTP/1.1" 204 0
2026-03-29 22:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457969/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV14TTZ/42810271?sv=2020-08-04&st=2026-03-29T22%3A05%3A26Z&se=2026-03-29T22%3A30%3A26Z&sr=b&sp=r&sig=FgPAFqZLo2N8ZmxnTVXtDLCOVp7mvYK9n8e2P5I%2F32w%3D)
2026-03-29 22:05:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699088035/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699088035>
2026-03-29 22:05:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292594/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292594>
2026-03-29 22:05:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089099/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089099>
2026-03-29 22:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292578/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV08TVU/42787563?sv=2020-08-04&st=2026-03-29T22%3A05%3A27Z&se=2026-03-29T22%3A30%3A27Z&sr=b&sp=r&sig=abPHynH8s2xf0kifKXKlpOTe1ehQFdtJ3%2BPcXJSL4zU%3D)
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292667%27 HTTP/1.1" 200 None
2026-03-29 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292667 not downloaded yet
2026-03-29 22:05:43 [bca.uk] INFO: Found listing with ID: YF62%20DGV
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF62%2520DGV%27 HTTP/1.1" 200 None
2026-03-29 22:05:43 [bca.uk] INFO: Scrape type for YF62%20DGV: 2
2026-03-29 22:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78515709-8a71-57cf-9588-b30df6d723f8 with identifier: YF62%20DGV
2026-03-29 22:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78515709-8a71-57cf-9588-b30df6d723f8 with scrape type 2
2026-03-29 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78515709-8a71-57cf-9588-b30df6d723f8 with scrape type 2
2026-03-29 22:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 78515709-8a71-57cf-9588-b30df6d723f8, identifier: YF62%20DGV
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6112f750>
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP65JXL%252F699087938%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087938/600 saved to cache
2026-03-29 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611b2490>
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP15SYH%252F699089066%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089066/600 saved to cache
2026-03-29 22:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7722f27f-140c-5241-909a-6e6aa692732b
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62187450>
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV68URC%252F699387082%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387082/600 saved to cache
2026-03-29 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c423af70-863f-544f-981f-966354022060
2026-03-29 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453609/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV59NFX/42798282?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Vj26nnLk4nUkuQUUMphnLssRjpy6Za6fEO4Q%2BW%2BcKKU%3D)
2026-03-29 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292583/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV08TVU/42787563?sv=2020-08-04&st=2026-03-29T22%3A05%3A27Z&se=2026-03-29T22%3A30%3A27Z&sr=b&sp=r&sig=abPHynH8s2xf0kifKXKlpOTe1ehQFdtJ3%2BPcXJSL4zU%3D)
2026-03-29 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457975/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV14TTZ/42810271?sv=2020-08-04&st=2026-03-29T22%3A05%3A26Z&se=2026-03-29T22%3A30%3A26Z&sr=b&sp=r&sig=FgPAFqZLo2N8ZmxnTVXtDLCOVp7mvYK9n8e2P5I%2F32w%3D)
2026-03-29 22:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 78515709-8a71-57cf-9588-b30df6d723f8 with identifier: YF62%20DGV
2026-03-29 22:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 78515709-8a71-57cf-9588-b30df6d723f8 with identifier: YF62%20DGV
2026-03-29 22:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 78515709-8a71-57cf-9588-b30df6d723f8 with identifier: YF62%20DGV to the API
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF62%20DGV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '78515709-8a71-57cf-9588-b30df6d723f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF62 DGV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF62%20DGV&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'RENAULT',
'model': 'GRAND SCENIC',
'odometer': 105373,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'RENAULT GRAND SCENIC 1.5 DCI 110 DYNAMIQUE TOM TOM MPV',
'transmission': 'manual',
'trim': 'DCI 110 DYNAMIQUE TOM TOM',
'vin': 'VF1JZS4B648275815',
'year': 2012}
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF62%2520DGV%27 HTTP/1.1" 200 None
2026-03-29 22:05:44 [bca.uk] INFO: Saving data for YF62%20DGV: {'auction_closing_time': 1774864800.0, 'created_time': 1774621331.351693, 'last_price_update_time': 1774821944.286478}
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF62%2520DGV') HTTP/1.1" 204 0
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292701%27 HTTP/1.1" 200 None
2026-03-29 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292701 not downloaded yet
2026-03-29 22:05:44 [bca.uk] INFO: Found listing with ID: YG66%20MEV
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG66%2520MEV%27 HTTP/1.1" 200 None
2026-03-29 22:05:44 [bca.uk] INFO: Scrape type for YG66%20MEV: 0
2026-03-29 22:05:44 [bca.uk] INFO: Found listing with ID: DP64%20OFX
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP64%2520OFX%27 HTTP/1.1" 200 None
2026-03-29 22:05:44 [bca.uk] INFO: Scrape type for DP64%20OFX: 0
2026-03-29 22:05:44 [bca.uk] INFO: Found listing with ID: VA62%20BTY
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA62%2520BTY%27 HTTP/1.1" 200 None
2026-03-29 22:05:44 [bca.uk] INFO: Scrape type for VA62%20BTY: 2
2026-03-29 22:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44fab252-6185-51e4-87e9-3f4c2a42edd8 with identifier: VA62%20BTY
2026-03-29 22:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44fab252-6185-51e4-87e9-3f4c2a42edd8 with scrape type 2
2026-03-29 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44fab252-6185-51e4-87e9-3f4c2a42edd8 with scrape type 2
2026-03-29 22:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 44fab252-6185-51e4-87e9-3f4c2a42edd8, identifier: VA62%20BTY
2026-03-29 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611d0390>
2026-03-29 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP65JXL%252F699087956%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087956/600 saved to cache
2026-03-29 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4
2026-03-29 22:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61048190>
2026-03-29 22:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV08TVU%252F699292570%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292570/600 saved to cache
2026-03-29 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82
2026-03-29 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087971/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP65JXL/42808111?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=NuWfvCjhCnPVyKXKJ4JcyeNaRmV90x6ROfl09hllUPs%3D)
2026-03-29 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699458005/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699458005>
2026-03-29 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453622/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453622>
2026-03-29 22:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292601/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292601>
2026-03-29 22:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292589/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV08TVU/42787563?sv=2020-08-04&st=2026-03-29T22%3A05%3A27Z&se=2026-03-29T22%3A30%3A27Z&sr=b&sp=r&sig=abPHynH8s2xf0kifKXKlpOTe1ehQFdtJ3%2BPcXJSL4zU%3D)
2026-03-29 22:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 44fab252-6185-51e4-87e9-3f4c2a42edd8 with identifier: VA62%20BTY
2026-03-29 22:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 44fab252-6185-51e4-87e9-3f4c2a42edd8 with identifier: VA62%20BTY
2026-03-29 22:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 44fab252-6185-51e4-87e9-3f4c2a42edd8 with identifier: VA62%20BTY to the API
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VA62%20BTY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '44fab252-6185-51e4-87e9-3f4c2a42edd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VA62 BTY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VA62%20BTY&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 109013,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.6 TDI 105 SE Hatchback',
'transmission': 'manual',
'trim': 'TDI 105 SE',
'vin': 'WVWZZZAUZDP020785',
'year': 2013}
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA62%2520BTY%27 HTTP/1.1" 200 None
2026-03-29 22:05:44 [bca.uk] INFO: Saving data for VA62%20BTY: {'auction_closing_time': 1774864800.0, 'created_time': 1774735394.049766, 'last_price_update_time': 1774821944.916044}
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VA62%2520BTY') HTTP/1.1" 204 0
2026-03-29 22:05:44 [bca.uk] INFO: Found listing with ID: VO13%20UKS
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO13%2520UKS%27 HTTP/1.1" 200 None
2026-03-29 22:05:44 [bca.uk] INFO: Scrape type for VO13%20UKS: 2
2026-03-29 22:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eec3315a-de1c-520f-8211-a4488a48f56d with identifier: VO13%20UKS
2026-03-29 22:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eec3315a-de1c-520f-8211-a4488a48f56d with scrape type 2
2026-03-29 22:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eec3315a-de1c-520f-8211-a4488a48f56d with scrape type 2
2026-03-29 22:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: eec3315a-de1c-520f-8211-a4488a48f56d, identifier: VO13%20UKS
2026-03-29 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292612/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292612>
2026-03-29 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699088069/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699088069>
2026-03-29 22:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: eec3315a-de1c-520f-8211-a4488a48f56d with identifier: VO13%20UKS
2026-03-29 22:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: eec3315a-de1c-520f-8211-a4488a48f56d with identifier: VO13%20UKS
2026-03-29 22:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: eec3315a-de1c-520f-8211-a4488a48f56d with identifier: VO13%20UKS to the API
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO13%20UKS-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'eec3315a-de1c-520f-8211-a4488a48f56d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO13 UKS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO13%20UKS&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 74667,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 16V ENERGY Hatchback',
'transmission': 'manual',
'trim': '16V ENERGY',
'vin': 'W0L0SDL08D4115440',
'year': 2013}
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO13%2520UKS%27 HTTP/1.1" 200 None
2026-03-29 22:05:45 [bca.uk] INFO: Saving data for VO13%20UKS: {'auction_closing_time': 1774864800.0, 'created_time': 1774620798.556471, 'last_price_update_time': 1774821945.469405}
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO13%2520UKS') HTTP/1.1" 204 0
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61111150>
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV14TTZ%252F699457969%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457969/600 saved to cache
2026-03-29 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3909531a-470f-5688-8297-acd46a9f879d
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620b8850>
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV08TVU%252F699292578%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292578/600 saved to cache
2026-03-29 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636d7f90>
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV59NFX%252F699453609%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453609/600 saved to cache
2026-03-29 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75379e98-ec74-5bb8-a2ba-dee078101af0
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6156f7d0>
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV08TVU%252F699292583%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292583/600 saved to cache
2026-03-29 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636d4150>
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV14TTZ%252F699457975%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457975/600 saved to cache
2026-03-29 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3909531a-470f-5688-8297-acd46a9f879d
2026-03-29 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292594/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV08TVU/42787563?sv=2020-08-04&st=2026-03-29T22%3A05%3A27Z&se=2026-03-29T22%3A30%3A27Z&sr=b&sp=r&sig=abPHynH8s2xf0kifKXKlpOTe1ehQFdtJ3%2BPcXJSL4zU%3D)
2026-03-29 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292636/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292636>
2026-03-29 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699458013/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699458013>
2026-03-29 22:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292667/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292667>
2026-03-29 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089099/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP15SYH/42806364?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Rd4qYDMjPlPfw1eY2qRBNLd1xHPVQnmq6D8gIEro12k%3D)
2026-03-29 22:05:45 [bca.uk] INFO: Found listing with ID: DS09%20KHK
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS09%2520KHK%27 HTTP/1.1" 200 None
2026-03-29 22:05:45 [bca.uk] INFO: Scrape type for DS09%20KHK: 0
2026-03-29 22:05:45 [bca.uk] INFO: Found listing with ID: DY59%20OYL
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY59%2520OYL%27 HTTP/1.1" 200 None
2026-03-29 22:05:45 [bca.uk] INFO: Scrape type for DY59%20OYL: 2
2026-03-29 22:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cb56991-e767-5f50-9e1e-b3b6fde8ef25 with identifier: DY59%20OYL
2026-03-29 22:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cb56991-e767-5f50-9e1e-b3b6fde8ef25 with scrape type 2
2026-03-29 22:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cb56991-e767-5f50-9e1e-b3b6fde8ef25 with scrape type 2
2026-03-29 22:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4cb56991-e767-5f50-9e1e-b3b6fde8ef25, identifier: DY59%20OYL
2026-03-29 22:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699088035/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP65JXL/42808111?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=NuWfvCjhCnPVyKXKJ4JcyeNaRmV90x6ROfl09hllUPs%3D)
2026-03-29 22:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4cb56991-e767-5f50-9e1e-b3b6fde8ef25 with identifier: DY59%20OYL
2026-03-29 22:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4cb56991-e767-5f50-9e1e-b3b6fde8ef25 with identifier: DY59%20OYL
2026-03-29 22:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4cb56991-e767-5f50-9e1e-b3b6fde8ef25 with identifier: DY59%20OYL to the API
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DY59%20OYL-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4cb56991-e767-5f50-9e1e-b3b6fde8ef25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DY59 OYL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DY59%20OYL&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VOLVO',
'model': 'C30',
'odometer': 129529,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VOLVO C30 1.6 D DRIVE R DESIGN Coupe',
'transmission': 'manual',
'trim': 'D DRIVE R DESIGN',
'vin': 'YV1MK76F2A2174340',
'year': 2009}
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY59%2520OYL%27 HTTP/1.1" 200 None
2026-03-29 22:05:46 [bca.uk] INFO: Saving data for DY59%20OYL: {'auction_closing_time': 1774864800.0, 'created_time': 1773930107.415081, 'last_price_update_time': 1774821946.257106}
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DY59%2520OYL') HTTP/1.1" 204 0
2026-03-29 22:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6104c4d0>
2026-03-29 22:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP65JXL%252F699087971%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087971/600 saved to cache
2026-03-29 22:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4
2026-03-29 22:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6219ff50>
2026-03-29 22:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV08TVU%252F699292589%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292589/600 saved to cache
2026-03-29 22:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82
2026-03-29 22:05:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457995/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457995>
2026-03-29 22:05:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453618/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453618>
2026-03-29 22:05:46 [bca.uk] INFO: Found listing with ID: KS09%20VZK
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS09%2520VZK%27 HTTP/1.1" 200 None
2026-03-29 22:05:46 [bca.uk] INFO: Scrape type for KS09%20VZK: 2
2026-03-29 22:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47fbd3e7-334b-55ca-adcc-a150029eb84e with identifier: KS09%20VZK
2026-03-29 22:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47fbd3e7-334b-55ca-adcc-a150029eb84e with scrape type 2
2026-03-29 22:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47fbd3e7-334b-55ca-adcc-a150029eb84e with scrape type 2
2026-03-29 22:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 47fbd3e7-334b-55ca-adcc-a150029eb84e, identifier: KS09%20VZK
2026-03-29 22:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292601/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV08TVU/42787563?sv=2020-08-04&st=2026-03-29T22%3A05%3A27Z&se=2026-03-29T22%3A30%3A27Z&sr=b&sp=r&sig=abPHynH8s2xf0kifKXKlpOTe1ehQFdtJ3%2BPcXJSL4zU%3D)
2026-03-29 22:05:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248790/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248790>
2026-03-29 22:05:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387138/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387138>
2026-03-29 22:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 47fbd3e7-334b-55ca-adcc-a150029eb84e with identifier: KS09%20VZK
2026-03-29 22:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 47fbd3e7-334b-55ca-adcc-a150029eb84e with identifier: KS09%20VZK
2026-03-29 22:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 47fbd3e7-334b-55ca-adcc-a150029eb84e with identifier: KS09%20VZK to the API
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 162,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS09%20VZK-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '47fbd3e7-334b-55ca-adcc-a150029eb84e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS09 VZK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KS09%20VZK&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MERCEDES-BENZ',
'model': 'A160',
'odometer': 120327,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A160 1.5 ELEGANCE SE Hatchback',
'transmission': 'automatic',
'trim': 'ELEGANCE SE',
'vin': 'WDD1690312J757696',
'year': 2009}
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS09%2520VZK%27 HTTP/1.1" 200 None
2026-03-29 22:05:46 [bca.uk] INFO: Saving data for KS09%20VZK: {'auction_closing_time': 1774864800.0, 'created_time': 1774621318.332009, 'last_price_update_time': 1774821946.826408}
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KS09%2520VZK') HTTP/1.1" 204 0
2026-03-29 22:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699088069/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP65JXL/42808111?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=NuWfvCjhCnPVyKXKJ4JcyeNaRmV90x6ROfl09hllUPs%3D)
2026-03-29 22:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699458005/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV14TTZ/42810271?sv=2020-08-04&st=2026-03-29T22%3A05%3A26Z&se=2026-03-29T22%3A30%3A26Z&sr=b&sp=r&sig=FgPAFqZLo2N8ZmxnTVXtDLCOVp7mvYK9n8e2P5I%2F32w%3D)
2026-03-29 22:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453622/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV59NFX/42798282?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Vj26nnLk4nUkuQUUMphnLssRjpy6Za6fEO4Q%2BW%2BcKKU%3D)
2026-03-29 22:05:46 [bca.uk] INFO: Found listing with ID: KU60%20XCH
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU60%2520XCH%27 HTTP/1.1" 200 None
2026-03-29 22:05:46 [bca.uk] INFO: Scrape type for KU60%20XCH: 2
2026-03-29 22:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac60bf19-8e22-5b08-a6d1-6fe027aedebf with identifier: KU60%20XCH
2026-03-29 22:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac60bf19-8e22-5b08-a6d1-6fe027aedebf with scrape type 2
2026-03-29 22:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac60bf19-8e22-5b08-a6d1-6fe027aedebf with scrape type 2
2026-03-29 22:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ac60bf19-8e22-5b08-a6d1-6fe027aedebf, identifier: KU60%20XCH
2026-03-29 22:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61bbdc90>
2026-03-29 22:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV08TVU%252F699292594%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292594/600 saved to cache
2026-03-29 22:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82
2026-03-29 22:05:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610180d0>
2026-03-29 22:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP15SYH%252F699089099%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089099/600 saved to cache
2026-03-29 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7722f27f-140c-5241-909a-6e6aa692732b
2026-03-29 22:05:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618df350>
2026-03-29 22:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP65JXL%252F699088035%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699088035/600 saved to cache
2026-03-29 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4
2026-03-29 22:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ac60bf19-8e22-5b08-a6d1-6fe027aedebf with identifier: KU60%20XCH
2026-03-29 22:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ac60bf19-8e22-5b08-a6d1-6fe027aedebf with identifier: KU60%20XCH
2026-03-29 22:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ac60bf19-8e22-5b08-a6d1-6fe027aedebf with identifier: KU60%20XCH to the API
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU60%20XCH-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ac60bf19-8e22-5b08-a6d1-6fe027aedebf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU60 XCH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KU60%20XCH&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'AUDI',
'model': 'Q5',
'odometer': 130823,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'AUDI Q5 2.0 TDI 170 QUATTRO SE S-T StationWagon',
'transmission': 'automatic',
'trim': 'TDI 170 QUATTRO SE S-T',
'vin': 'WAUZZZ8R1BA024273',
'year': 2010}
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU60%2520XCH%27 HTTP/1.1" 200 None
2026-03-29 22:05:47 [bca.uk] INFO: Saving data for KU60%20XCH: {'auction_closing_time': 1774864800.0, 'created_time': 1774478641.414568, 'last_price_update_time': 1774821947.334061}
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KU60%2520XCH') HTTP/1.1" 204 0
2026-03-29 22:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292667/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV08TVU/42787563?sv=2020-08-04&st=2026-03-29T22%3A05%3A27Z&se=2026-03-29T22%3A30%3A27Z&sr=b&sp=r&sig=abPHynH8s2xf0kifKXKlpOTe1ehQFdtJ3%2BPcXJSL4zU%3D)
2026-03-29 22:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292612/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV08TVU/42787563?sv=2020-08-04&st=2026-03-29T22%3A05%3A27Z&se=2026-03-29T22%3A30%3A27Z&sr=b&sp=r&sig=abPHynH8s2xf0kifKXKlpOTe1ehQFdtJ3%2BPcXJSL4zU%3D)
2026-03-29 22:05:47 [bca.uk] INFO: Found listing with ID: LY10%20BTE
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY10%2520BTE%27 HTTP/1.1" 200 None
2026-03-29 22:05:47 [bca.uk] INFO: Scrape type for LY10%20BTE: 2
2026-03-29 22:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6698f5fc-274b-50e1-95fb-b175f76efb4c with identifier: LY10%20BTE
2026-03-29 22:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6698f5fc-274b-50e1-95fb-b175f76efb4c with scrape type 2
2026-03-29 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6698f5fc-274b-50e1-95fb-b175f76efb4c with scrape type 2
2026-03-29 22:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6698f5fc-274b-50e1-95fb-b175f76efb4c, identifier: LY10%20BTE
2026-03-29 22:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618ddb50>
2026-03-29 22:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV08TVU%252F699292601%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292601/600 saved to cache
2026-03-29 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82
2026-03-29 22:05:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457986/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457986>
2026-03-29 22:05:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453615/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453615>
2026-03-29 22:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292636/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV08TVU/42787563?sv=2020-08-04&st=2026-03-29T22%3A05%3A27Z&se=2026-03-29T22%3A30%3A27Z&sr=b&sp=r&sig=abPHynH8s2xf0kifKXKlpOTe1ehQFdtJ3%2BPcXJSL4zU%3D)
2026-03-29 22:05:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292701/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292701>
2026-03-29 22:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6698f5fc-274b-50e1-95fb-b175f76efb4c with identifier: LY10%20BTE
2026-03-29 22:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6698f5fc-274b-50e1-95fb-b175f76efb4c with identifier: LY10%20BTE
2026-03-29 22:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6698f5fc-274b-50e1-95fb-b175f76efb4c with identifier: LY10%20BTE to the API
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LY10%20BTE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6698f5fc-274b-50e1-95fb-b175f76efb4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LY10 BTE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LY10%20BTE&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'CITROEN',
'model': 'C3',
'odometer': 72965,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'CITROEN C3 1.6 HDI 90 EXCLUSIVE Hatchback',
'transmission': 'manual',
'trim': 'HDI 90 EXCLUSIVE',
'vin': 'VF7SC9HXCAA577332',
'year': 2010}
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY10%2520BTE%27 HTTP/1.1" 200 None
2026-03-29 22:05:47 [bca.uk] INFO: Saving data for LY10%20BTE: {'auction_closing_time': 1774864800.0, 'created_time': 1774620805.19089, 'last_price_update_time': 1774821947.801935}
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LY10%2520BTE') HTTP/1.1" 204 0
2026-03-29 22:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699458013/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV14TTZ/42810271?sv=2020-08-04&st=2026-03-29T22%3A05%3A26Z&se=2026-03-29T22%3A30%3A26Z&sr=b&sp=r&sig=FgPAFqZLo2N8ZmxnTVXtDLCOVp7mvYK9n8e2P5I%2F32w%3D)
2026-03-29 22:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453618/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV59NFX/42798282?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Vj26nnLk4nUkuQUUMphnLssRjpy6Za6fEO4Q%2BW%2BcKKU%3D)
2026-03-29 22:05:47 [bca.uk] INFO: Found listing with ID: MV60%20OCJ
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV60%2520OCJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:47 [bca.uk] INFO: Scrape type for MV60%20OCJ: 0
2026-03-29 22:05:47 [bca.uk] INFO: Found listing with ID: ND62%20EWM
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND62%2520EWM%27 HTTP/1.1" 200 None
2026-03-29 22:05:47 [bca.uk] INFO: Scrape type for ND62%20EWM: 2
2026-03-29 22:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fc2a305-976b-5d20-86ca-43ed711c23db with identifier: ND62%20EWM
2026-03-29 22:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc2a305-976b-5d20-86ca-43ed711c23db with scrape type 2
2026-03-29 22:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fc2a305-976b-5d20-86ca-43ed711c23db with scrape type 2
2026-03-29 22:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1fc2a305-976b-5d20-86ca-43ed711c23db, identifier: ND62%20EWM
2026-03-29 22:05:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61636190>
2026-03-29 22:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP65JXL%252F699088069%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699088069/600 saved to cache
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61929150>
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV14TTZ%252F699458005%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699458005/600 saved to cache
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3909531a-470f-5688-8297-acd46a9f879d
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62117950>
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV59NFX%252F699453622%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453622/600 saved to cache
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75379e98-ec74-5bb8-a2ba-dee078101af0
2026-03-29 22:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457995/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV14TTZ/42810271?sv=2020-08-04&st=2026-03-29T22%3A05%3A26Z&se=2026-03-29T22%3A30%3A26Z&sr=b&sp=r&sig=FgPAFqZLo2N8ZmxnTVXtDLCOVp7mvYK9n8e2P5I%2F32w%3D)
2026-03-29 22:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1fc2a305-976b-5d20-86ca-43ed711c23db with identifier: ND62%20EWM
2026-03-29 22:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1fc2a305-976b-5d20-86ca-43ed711c23db with identifier: ND62%20EWM
2026-03-29 22:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1fc2a305-976b-5d20-86ca-43ed711c23db with identifier: ND62%20EWM to the API
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND62%20EWM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1fc2a305-976b-5d20-86ca-43ed711c23db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND62 EWM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND62%20EWM&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 111765,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.2 TEKNA Hatchback',
'transmission': 'manual',
'trim': 'TEKNA',
'vin': 'MDHFBUK13U0519658',
'year': 2012}
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND62%2520EWM%27 HTTP/1.1" 200 None
2026-03-29 22:05:48 [bca.uk] INFO: Saving data for ND62%20EWM: {'auction_closing_time': 1774864800.0, 'created_time': 1774735392.152456, 'last_price_update_time': 1774821948.358092}
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND62%2520EWM') HTTP/1.1" 204 0
2026-03-29 22:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387138/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV68URC/42811821?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=UqKQThY1MQH5ObDZI1ey2MVklXRiFzm7WSFSP9Yo17U%3D)
2026-03-29 22:05:48 [bca.uk] INFO: Found listing with ID: OV07%20NNA
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV07%2520NNA%27 HTTP/1.1" 200 None
2026-03-29 22:05:48 [bca.uk] INFO: Scrape type for OV07%20NNA: 2
2026-03-29 22:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0406c53-da78-545a-93b7-f05f99baea7e with identifier: OV07%20NNA
2026-03-29 22:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0406c53-da78-545a-93b7-f05f99baea7e with scrape type 2
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0406c53-da78-545a-93b7-f05f99baea7e with scrape type 2
2026-03-29 22:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c0406c53-da78-545a-93b7-f05f99baea7e, identifier: OV07%20NNA
2026-03-29 22:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457978/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457978>
2026-03-29 22:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248774/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248774>
2026-03-29 22:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699088014/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699088014>
2026-03-29 22:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387126/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387126>
2026-03-29 22:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089093/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089093>
2026-03-29 22:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c0406c53-da78-545a-93b7-f05f99baea7e with identifier: OV07%20NNA
2026-03-29 22:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c0406c53-da78-545a-93b7-f05f99baea7e with identifier: OV07%20NNA
2026-03-29 22:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c0406c53-da78-545a-93b7-f05f99baea7e with identifier: OV07%20NNA to the API
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 207,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV07%20NNA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c0406c53-da78-545a-93b7-f05f99baea7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV07 NNA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV07%20NNA&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'SUBARU',
'model': 'LEGACY OUTBACK',
'odometer': 143535,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'SUBARU LEGACY OUTBACK 2.5 173 SEN SPORT TOURER Estate',
'transmission': 'automatic',
'trim': '173 SEN SPORT TOURER',
'vin': 'JF1BP9KLA7G048237',
'year': 2007}
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV07%2520NNA%27 HTTP/1.1" 200 None
2026-03-29 22:05:48 [bca.uk] INFO: Saving data for OV07%20NNA: {'auction_closing_time': 1774864800.0, 'created_time': 1774524274.223216, 'last_price_update_time': 1774821948.763132}
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV07%2520NNA') HTTP/1.1" 204 0
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632c8e10>
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV08TVU%252F699292667%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292667/600 saved to cache
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632cc710>
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV08TVU%252F699292612%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292612/600 saved to cache
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c4d310>
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV08TVU%252F699292636%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292636/600 saved to cache
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6214bb90>
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV14TTZ%252F699458013%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699458013/600 saved to cache
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3909531a-470f-5688-8297-acd46a9f879d
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c4d2d0>
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV59NFX%252F699453618%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453618/600 saved to cache
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75379e98-ec74-5bb8-a2ba-dee078101af0
2026-03-29 22:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453612/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453612>
2026-03-29 22:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248790/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH67HFC/42809726?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=aLVrPpUXrfB1VZ7O0yZYRHCjncC2Uv1YIx3J5LA4O1w%3D)
2026-03-29 22:05:48 [bca.uk] INFO: Found listing with ID: OY14%20LMF
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY14%2520LMF%27 HTTP/1.1" 200 None
2026-03-29 22:05:48 [bca.uk] INFO: Scrape type for OY14%20LMF: 0
2026-03-29 22:05:48 [bca.uk] INFO: Found listing with ID: P60%20GOB
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P60%2520GOB%27 HTTP/1.1" 200 None
2026-03-29 22:05:48 [bca.uk] INFO: Scrape type for P60%20GOB: 2
2026-03-29 22:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a6c66a3-5609-50c9-bc1e-1b6e2c8d4e7c with identifier: P60%20GOB
2026-03-29 22:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a6c66a3-5609-50c9-bc1e-1b6e2c8d4e7c with scrape type 2
2026-03-29 22:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a6c66a3-5609-50c9-bc1e-1b6e2c8d4e7c with scrape type 2
2026-03-29 22:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2a6c66a3-5609-50c9-bc1e-1b6e2c8d4e7c, identifier: P60%20GOB
2026-03-29 22:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2a6c66a3-5609-50c9-bc1e-1b6e2c8d4e7c with identifier: P60%20GOB
2026-03-29 22:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2a6c66a3-5609-50c9-bc1e-1b6e2c8d4e7c with identifier: P60%20GOB
2026-03-29 22:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2a6c66a3-5609-50c9-bc1e-1b6e2c8d4e7c with identifier: P60%20GOB to the API
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=P60%20GOB-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2a6c66a3-5609-50c9-bc1e-1b6e2c8d4e7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'P60 GOB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=P60%20GOB&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'CITROEN',
'model': 'DS4',
'odometer': 124652,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'CITROEN DS4 2.0 HDI 160 DSTYLE Hatchback',
'transmission': 'manual',
'trim': 'HDI 160 DSTYLE',
'vin': 'VF7NXRHH8CY614488',
'year': 2012}
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P60%2520GOB%27 HTTP/1.1" 200 None
2026-03-29 22:05:49 [bca.uk] INFO: Saving data for P60%20GOB: {'auction_closing_time': 1774864800.0, 'created_time': 1774622489.588226, 'last_price_update_time': 1774821949.397594}
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='P60%2520GOB') HTTP/1.1" 204 0
2026-03-29 22:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611d2a90>
2026-03-29 22:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV14TTZ%252F699457995%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457995/600 saved to cache
2026-03-29 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3909531a-470f-5688-8297-acd46a9f879d
2026-03-29 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637fb950>
2026-03-29 22:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV68URC%252F699387138%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387138/600 saved to cache
2026-03-29 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c423af70-863f-544f-981f-966354022060
2026-03-29 22:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387115/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387115>
2026-03-29 22:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089085/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089085>
2026-03-29 22:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087994/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699087994>
2026-03-29 22:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292701/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV08TVU/42787563?sv=2020-08-04&st=2026-03-29T22%3A05%3A27Z&se=2026-03-29T22%3A30%3A27Z&sr=b&sp=r&sig=abPHynH8s2xf0kifKXKlpOTe1ehQFdtJ3%2BPcXJSL4zU%3D)
2026-03-29 22:05:49 [bca.uk] INFO: Found listing with ID: PJ12%20NEO
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ12%2520NEO%27 HTTP/1.1" 200 None
2026-03-29 22:05:49 [bca.uk] INFO: Scrape type for PJ12%20NEO: 2
2026-03-29 22:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf9384a7-c2b5-5829-81c5-0ab07891768a with identifier: PJ12%20NEO
2026-03-29 22:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf9384a7-c2b5-5829-81c5-0ab07891768a with scrape type 2
2026-03-29 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf9384a7-c2b5-5829-81c5-0ab07891768a with scrape type 2
2026-03-29 22:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cf9384a7-c2b5-5829-81c5-0ab07891768a, identifier: PJ12%20NEO
2026-03-29 22:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453615/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV59NFX/42798282?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Vj26nnLk4nUkuQUUMphnLssRjpy6Za6fEO4Q%2BW%2BcKKU%3D)
2026-03-29 22:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457986/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV14TTZ/42810271?sv=2020-08-04&st=2026-03-29T22%3A05%3A26Z&se=2026-03-29T22%3A30%3A26Z&sr=b&sp=r&sig=FgPAFqZLo2N8ZmxnTVXtDLCOVp7mvYK9n8e2P5I%2F32w%3D)
2026-03-29 22:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cf9384a7-c2b5-5829-81c5-0ab07891768a with identifier: PJ12%20NEO
2026-03-29 22:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cf9384a7-c2b5-5829-81c5-0ab07891768a with identifier: PJ12%20NEO
2026-03-29 22:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cf9384a7-c2b5-5829-81c5-0ab07891768a with identifier: PJ12%20NEO to the API
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ12%20NEO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'cf9384a7-c2b5-5829-81c5-0ab07891768a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ12 NEO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ12%20NEO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'ZAFIRA TOURER',
'odometer': 109931,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VAUXHALL ZAFIRA TOURER 2.0 CDTI 130 E/F EXCLUSIV MPV',
'transmission': 'manual',
'trim': 'CDTI 130 E/F EXCLUSIV',
'vin': 'W0LPD9EM3C2053446',
'year': 2012}
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ12%2520NEO%27 HTTP/1.1" 200 None
2026-03-29 22:05:49 [bca.uk] INFO: Saving data for PJ12%20NEO: {'auction_closing_time': 1774864800.0, 'created_time': 1774735393.343568, 'last_price_update_time': 1774821949.898647}
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ12%2520NEO') HTTP/1.1" 204 0
2026-03-29 22:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248758/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248758>
2026-03-29 22:05:49 [bca.uk] INFO: Found listing with ID: SA62%20FAO
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA62%2520FAO%27 HTTP/1.1" 200 None
2026-03-29 22:05:49 [bca.uk] INFO: Scrape type for SA62%20FAO: 0
2026-03-29 22:05:49 [bca.uk] INFO: Found listing with ID: AP17%20LGF
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP17%2520LGF%27 HTTP/1.1" 200 None
2026-03-29 22:05:49 [bca.uk] INFO: Scrape type for AP17%20LGF: 2
2026-03-29 22:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2acfb3fd-c70f-5159-a4ef-29be5c93f30b with identifier: AP17%20LGF
2026-03-29 22:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2acfb3fd-c70f-5159-a4ef-29be5c93f30b with scrape type 2
2026-03-29 22:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2acfb3fd-c70f-5159-a4ef-29be5c93f30b with scrape type 2
2026-03-29 22:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2acfb3fd-c70f-5159-a4ef-29be5c93f30b, identifier: AP17%20LGF
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619195d0>
2026-03-29 22:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH67HFC%252F699248790%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248790/600 saved to cache
2026-03-29 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6836e689-948e-59c9-ae88-0dac50e055fe
2026-03-29 22:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457978/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV14TTZ/42810271?sv=2020-08-04&st=2026-03-29T22%3A05%3A26Z&se=2026-03-29T22%3A30%3A26Z&sr=b&sp=r&sig=FgPAFqZLo2N8ZmxnTVXtDLCOVp7mvYK9n8e2P5I%2F32w%3D)
2026-03-29 22:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089093/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP15SYH/42806364?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Rd4qYDMjPlPfw1eY2qRBNLd1xHPVQnmq6D8gIEro12k%3D)
2026-03-29 22:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2acfb3fd-c70f-5159-a4ef-29be5c93f30b with identifier: AP17%20LGF
2026-03-29 22:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2acfb3fd-c70f-5159-a4ef-29be5c93f30b with identifier: AP17%20LGF
2026-03-29 22:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2acfb3fd-c70f-5159-a4ef-29be5c93f30b with identifier: AP17%20LGF to the API
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AP17%20LGF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2acfb3fd-c70f-5159-a4ef-29be5c93f30b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AP17 LGF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AP17%20LGF&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 64346,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 100 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 ZETEC',
'vin': 'WF0CXXGAKCHU58671',
'year': 2017}
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP17%2520LGF%27 HTTP/1.1" 200 None
2026-03-29 22:05:50 [bca.uk] INFO: Saving data for AP17%20LGF: {'auction_closing_time': 1774864800.0, 'created_time': 1774622495.894769, 'last_price_update_time': 1774821950.4807}
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AP17%2520LGF') HTTP/1.1" 204 0
2026-03-29 22:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248774/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH67HFC/42809726?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=aLVrPpUXrfB1VZ7O0yZYRHCjncC2Uv1YIx3J5LA4O1w%3D)
2026-03-29 22:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699088014/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP65JXL/42808111?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=NuWfvCjhCnPVyKXKJ4JcyeNaRmV90x6ROfl09hllUPs%3D)
2026-03-29 22:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387126/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV68URC/42811821?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=UqKQThY1MQH5ObDZI1ey2MVklXRiFzm7WSFSP9Yo17U%3D)
2026-03-29 22:05:50 [bca.uk] INFO: Found listing with ID: BD57%20OLK
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD57%2520OLK%27 HTTP/1.1" 200 None
2026-03-29 22:05:50 [bca.uk] INFO: Scrape type for BD57%20OLK: 2
2026-03-29 22:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f1a744f-dcf7-513c-adf2-49d9ca828470 with identifier: BD57%20OLK
2026-03-29 22:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f1a744f-dcf7-513c-adf2-49d9ca828470 with scrape type 2
2026-03-29 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f1a744f-dcf7-513c-adf2-49d9ca828470 with scrape type 2
2026-03-29 22:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8f1a744f-dcf7-513c-adf2-49d9ca828470, identifier: BD57%20OLK
2026-03-29 22:05:50 [bca.uk] INFO: Total items found: 100
2026-03-29 22:05:50 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded
2026-03-29 22:05:50 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:05:50 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614ce910>
2026-03-29 22:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV08TVU%252F699292701%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292701/600 saved to cache
2026-03-29 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82
2026-03-29 22:05:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82, skipping ID generation
2026-03-29 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82 sending to next pipeline
2026-03-29 22:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82, identifier: LV08%20TVU
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61164f50>
2026-03-29 22:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV59NFX%252F699453615%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453615/600 saved to cache
2026-03-29 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75379e98-ec74-5bb8-a2ba-dee078101af0
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b3450>
2026-03-29 22:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV14TTZ%252F699457986%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457986/600 saved to cache
2026-03-29 22:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3909531a-470f-5688-8297-acd46a9f879d
2026-03-29 22:05:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089077/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089077>
2026-03-29 22:05:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387104/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387104>
2026-03-29 22:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8f1a744f-dcf7-513c-adf2-49d9ca828470 with identifier: BD57%20OLK
2026-03-29 22:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8f1a744f-dcf7-513c-adf2-49d9ca828470 with identifier: BD57%20OLK
2026-03-29 22:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8f1a744f-dcf7-513c-adf2-49d9ca828470 with identifier: BD57%20OLK to the API
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 183,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD57%20OLK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8f1a744f-dcf7-513c-adf2-49d9ca828470',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BD57 OLK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BD57%20OLK&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'AUDI',
'model': 'TT',
'odometer': 132337,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'AUDI TT 2.0 TFSI S-T Coupe',
'transmission': 'automatic',
'trim': 'TFSI S-T',
'vin': 'TRUZZZ8J881024203',
'year': 2007}
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD57%2520OLK%27 HTTP/1.1" 200 None
2026-03-29 22:05:51 [bca.uk] INFO: Saving data for BD57%20OLK: {'auction_closing_time': 1774864800.0, 'created_time': 1774735394.452872, 'last_price_update_time': 1774821951.216897}
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BD57%2520OLK') HTTP/1.1" 204 0
2026-03-29 22:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82 with identifier: LV08%20TVU
2026-03-29 22:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82 with identifier: LV08%20TVU
2026-03-29 22:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82 with identifier: LV08%20TVU to the API
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292701/600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_expert_report_file_ba9de00d-7ef3-4186-b56a-e0f5924b07c1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV08%20TVU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': '35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LV08 TVU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LV08%20TVU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 125954,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45652,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292570/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43218,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292578/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43631,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292583/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41130,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292589/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38128,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292594/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36638,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292601/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106661,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292612/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54653,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292636/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86380,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292667/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82/35c5dd53-bd6c-5ef6-a8e5-9f8f1ac02c82_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55251,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV08TVU/699292701/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'RENAULT CLIO 1.2 CAMPUS 2007 Hatchback',
'transmission': 'manual',
'trim': 'CAMPUS 2007',
'vin': 'VF1CB1KEF39365850',
'year': 2008}
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV08%2520TVU%27 HTTP/1.1" 200 None
2026-03-29 22:05:51 [bca.uk] INFO: Saving data for LV08%20TVU: {'created_time': 1774821951.593658, 'last_price_update_time': 1774821951.593667, 'auction_closing_time': 1775210400.0}
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LV08%2520TVU') HTTP/1.1" 204 0
2026-03-29 22:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453612/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV59NFX/42798282?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Vj26nnLk4nUkuQUUMphnLssRjpy6Za6fEO4Q%2BW%2BcKKU%3D)
2026-03-29 22:05:51 [bca.uk] INFO: Found listing with ID: CN63%20OLH
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN63%2520OLH%27 HTTP/1.1" 200 None
2026-03-29 22:05:51 [bca.uk] INFO: Scrape type for CN63%20OLH: 2
2026-03-29 22:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39f18d5c-38c9-5802-bc90-29e03976b40f with identifier: CN63%20OLH
2026-03-29 22:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39f18d5c-38c9-5802-bc90-29e03976b40f with scrape type 2
2026-03-29 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39f18d5c-38c9-5802-bc90-29e03976b40f with scrape type 2
2026-03-29 22:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 39f18d5c-38c9-5802-bc90-29e03976b40f, identifier: CN63%20OLH
2026-03-29 22:05:51 [bca.uk] INFO: Found listing with ID: YB66%20SGO
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB66%2520SGO%27 HTTP/1.1" 200 None
2026-03-29 22:05:51 [bca.uk] INFO: Scrape type for YB66%20SGO: 2
2026-03-29 22:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72028644-e7e8-53a8-a690-b78abf0d7020 with identifier: YB66%20SGO
2026-03-29 22:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72028644-e7e8-53a8-a690-b78abf0d7020 with scrape type 2
2026-03-29 22:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72028644-e7e8-53a8-a690-b78abf0d7020 with scrape type 2
2026-03-29 22:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 72028644-e7e8-53a8-a690-b78abf0d7020, identifier: YB66%20SGO
2026-03-29 22:05:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248749/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248749>
2026-03-29 22:05:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699415080/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699415080>
2026-03-29 22:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387115/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV68URC/42811821?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=UqKQThY1MQH5ObDZI1ey2MVklXRiFzm7WSFSP9Yo17U%3D)
2026-03-29 22:05:51 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:05:51 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 39f18d5c-38c9-5802-bc90-29e03976b40f with identifier: CN63%20OLH
2026-03-29 22:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 39f18d5c-38c9-5802-bc90-29e03976b40f with identifier: CN63%20OLH
2026-03-29 22:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 39f18d5c-38c9-5802-bc90-29e03976b40f with identifier: CN63%20OLH to the API
2026-03-29 22:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CN63%20OLH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '39f18d5c-38c9-5802-bc90-29e03976b40f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CN63 OLH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CN63%20OLH&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VOLVO',
'model': 'V60 SPORTWAGON',
'odometer': 135388,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VOLVO V60 SPORTWAGON 1.6 D2 115 BUSINESS EDITION P/S Estate',
'transmission': 'automatic',
'trim': 'D2 115 BUSINESS EDITION P/S',
'vin': 'YV1FW848BE1157465',
'year': 2013}
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN63%2520OLH%27 HTTP/1.1" 200 None
2026-03-29 22:05:52 [bca.uk] INFO: Saving data for CN63%20OLH: {'auction_closing_time': 1774864800.0, 'created_time': 1774735381.927656, 'last_price_update_time': 1774821952.146241}
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CN63%2520OLH') HTTP/1.1" 204 0
2026-03-29 22:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 72028644-e7e8-53a8-a690-b78abf0d7020 with identifier: YB66%20SGO
2026-03-29 22:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 72028644-e7e8-53a8-a690-b78abf0d7020 with identifier: YB66%20SGO
2026-03-29 22:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 72028644-e7e8-53a8-a690-b78abf0d7020 with identifier: YB66%20SGO to the API
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YB66%20SGO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '72028644-e7e8-53a8-a690-b78abf0d7020',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YB66 SGO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YB66%20SGO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BMW',
'model': '116D',
'odometer': 61376,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'BMW 116D 1.5 SPORT Hatchback',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WBA1V720805D51334',
'year': 2017}
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB66%2520SGO%27 HTTP/1.1" 200 None
2026-03-29 22:05:52 [bca.uk] INFO: Saving data for YB66%20SGO: {'auction_closing_time': 1774864800.0, 'created_time': 1774621719.418673, 'last_price_update_time': 1774821952.449261}
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YB66%2520SGO') HTTP/1.1" 204 0
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69b9e4d0>
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV14TTZ%252F699457978%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457978/600 saved to cache
2026-03-29 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3909531a-470f-5688-8297-acd46a9f879d
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611d26d0>
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP15SYH%252F699089093%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089093/600 saved to cache
2026-03-29 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7722f27f-140c-5241-909a-6e6aa692732b
2026-03-29 22:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac622588d0>
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH67HFC%252F699248774%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248774/600 saved to cache
2026-03-29 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6836e689-948e-59c9-ae88-0dac50e055fe
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6112f790>
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP65JXL%252F699088014%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699088014/600 saved to cache
2026-03-29 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac622588d0>
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV68URC%252F699387126%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387126/600 saved to cache
2026-03-29 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c423af70-863f-544f-981f-966354022060
2026-03-29 22:05:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453607/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453607>
2026-03-29 22:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248758/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH67HFC/42809726?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=aLVrPpUXrfB1VZ7O0yZYRHCjncC2Uv1YIx3J5LA4O1w%3D)
2026-03-29 22:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087994/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP65JXL/42808111?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=NuWfvCjhCnPVyKXKJ4JcyeNaRmV90x6ROfl09hllUPs%3D)
2026-03-29 22:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089085/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP15SYH/42806364?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Rd4qYDMjPlPfw1eY2qRBNLd1xHPVQnmq6D8gIEro12k%3D)
2026-03-29 22:05:52 [bca.uk] INFO: Found listing with ID: DA64%20WPD
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA64%2520WPD%27 HTTP/1.1" 200 None
2026-03-29 22:05:52 [bca.uk] INFO: Scrape type for DA64%20WPD: 0
2026-03-29 22:05:52 [bca.uk] INFO: Found listing with ID: OY18%20OKJ
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY18%2520OKJ%27 HTTP/1.1" 200 None
2026-03-29 22:05:52 [bca.uk] INFO: Scrape type for OY18%20OKJ: 0
2026-03-29 22:05:52 [bca.uk] INFO: Found listing with ID: PJ18%20YMZ
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ18%2520YMZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:52 [bca.uk] INFO: Scrape type for PJ18%20YMZ: 2
2026-03-29 22:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bd7ebf5-ae34-55f8-94ed-1ff1eb7ffac5 with identifier: PJ18%20YMZ
2026-03-29 22:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bd7ebf5-ae34-55f8-94ed-1ff1eb7ffac5 with scrape type 2
2026-03-29 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bd7ebf5-ae34-55f8-94ed-1ff1eb7ffac5 with scrape type 2
2026-03-29 22:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5bd7ebf5-ae34-55f8-94ed-1ff1eb7ffac5, identifier: PJ18%20YMZ
2026-03-29 22:05:52 [bca.uk] INFO: Found listing with ID: BG16%20XLF
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG16%2520XLF%27 HTTP/1.1" 200 None
2026-03-29 22:05:52 [bca.uk] INFO: Scrape type for BG16%20XLF: 2
2026-03-29 22:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1 with identifier: BG16%20XLF
2026-03-29 22:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1 with scrape type 2
2026-03-29 22:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1 with scrape type 2
2026-03-29 22:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1, identifier: BG16%20XLF
2026-03-29 22:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5bd7ebf5-ae34-55f8-94ed-1ff1eb7ffac5 with identifier: PJ18%20YMZ
2026-03-29 22:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5bd7ebf5-ae34-55f8-94ed-1ff1eb7ffac5 with identifier: PJ18%20YMZ
2026-03-29 22:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5bd7ebf5-ae34-55f8-94ed-1ff1eb7ffac5 with identifier: PJ18%20YMZ to the API
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ18%20YMZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5bd7ebf5-ae34-55f8-94ed-1ff1eb7ffac5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ18 YMZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ18%20YMZ&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MERCEDES-BENZ',
'model': 'GLC 220 D',
'odometer': 56708,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ GLC 220 D 2.1 AMG LINE PREMIUM 4M 9G StationWagon',
'transmission': 'manual',
'trim': 'AMG LINE PREMIUM 4M 9G',
'vin': 'WDC2539052V099887',
'year': 2018}
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ18%2520YMZ%27 HTTP/1.1" 200 None
2026-03-29 22:05:53 [bca.uk] INFO: Saving data for PJ18%20YMZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774477437.554435, 'last_price_update_time': 1774821953.342862}
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ18%2520YMZ') HTTP/1.1" 204 0
2026-03-29 22:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1 with identifier: BG16%20XLF
2026-03-29 22:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1 with identifier: BG16%20XLF
2026-03-29 22:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1 with identifier: BG16%20XLF to the API
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 87,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG16%20XLF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '87d34cfc-b28c-5d6a-a3f6-5fc7152cdfd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG16 XLF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BG16%20XLF&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'DS AUTOMOBILES',
'model': 'DS 3',
'odometer': 54942,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'DS AUTOMOBILES DS 3 1.6 BLUEHDI 100 ELEGANCE Hatchback',
'transmission': 'manual',
'trim': 'BLUEHDI 100 ELEGANCE',
'vin': 'VF7SABHY6GW533745',
'year': 2016}
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG16%2520XLF%27 HTTP/1.1" 200 None
2026-03-29 22:05:53 [bca.uk] INFO: Saving data for BG16%20XLF: {'auction_closing_time': 1774864800.0, 'created_time': 1774735340.68456, 'last_price_update_time': 1774821953.646983}
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BG16%2520XLF') HTTP/1.1" 204 0
2026-03-29 22:05:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618ef5d0>
2026-03-29 22:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV59NFX%252F699453612%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453612/600 saved to cache
2026-03-29 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75379e98-ec74-5bb8-a2ba-dee078101af0
2026-03-29 22:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248736/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248736>
2026-03-29 22:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089069/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089069>
2026-03-29 22:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699415047/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699415047>
2026-03-29 22:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387090/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387090>
2026-03-29 22:05:53 [bca.uk] INFO: Found listing with ID: RX68%20XHM
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX68%2520XHM%27 HTTP/1.1" 200 None
2026-03-29 22:05:53 [bca.uk] INFO: Scrape type for RX68%20XHM: 2
2026-03-29 22:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 502dec79-4436-5ea8-b8a4-1afd151a13a2 with identifier: RX68%20XHM
2026-03-29 22:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 502dec79-4436-5ea8-b8a4-1afd151a13a2 with scrape type 2
2026-03-29 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 502dec79-4436-5ea8-b8a4-1afd151a13a2 with scrape type 2
2026-03-29 22:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 502dec79-4436-5ea8-b8a4-1afd151a13a2, identifier: RX68%20XHM
2026-03-29 22:05:53 [bca.uk] INFO: Found listing with ID: ET68%20NZV
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET68%2520NZV%27 HTTP/1.1" 200 None
2026-03-29 22:05:53 [bca.uk] INFO: Scrape type for ET68%20NZV: 2
2026-03-29 22:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e70a7b0-8916-5411-aea9-a2ed8b2c02bb with identifier: ET68%20NZV
2026-03-29 22:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e70a7b0-8916-5411-aea9-a2ed8b2c02bb with scrape type 2
2026-03-29 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e70a7b0-8916-5411-aea9-a2ed8b2c02bb with scrape type 2
2026-03-29 22:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5e70a7b0-8916-5411-aea9-a2ed8b2c02bb, identifier: ET68%20NZV
2026-03-29 22:05:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611d5ed0>
2026-03-29 22:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV68URC%252F699387115%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387115/600 saved to cache
2026-03-29 22:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c423af70-863f-544f-981f-966354022060
2026-03-29 22:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457966/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457966>
2026-03-29 22:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456064/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456064>
2026-03-29 22:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 502dec79-4436-5ea8-b8a4-1afd151a13a2 with identifier: RX68%20XHM
2026-03-29 22:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 502dec79-4436-5ea8-b8a4-1afd151a13a2 with identifier: RX68%20XHM
2026-03-29 22:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 502dec79-4436-5ea8-b8a4-1afd151a13a2 with identifier: RX68%20XHM to the API
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RX68%20XHM-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '502dec79-4436-5ea8-b8a4-1afd151a13a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RX68 XHM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RX68%20XHM&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 82544,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.5 VTEC TURBO 180 SPORT Hatchback',
'transmission': 'automatic',
'trim': 'VTEC TURBO 180 SPORT',
'vin': 'SHHFK7860JU005440',
'year': 2018}
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX68%2520XHM%27 HTTP/1.1" 200 None
2026-03-29 22:05:54 [bca.uk] INFO: Saving data for RX68%20XHM: {'auction_closing_time': 1774864800.0, 'created_time': 1774735391.213022, 'last_price_update_time': 1774821954.275177}
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RX68%2520XHM') HTTP/1.1" 204 0
2026-03-29 22:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5e70a7b0-8916-5411-aea9-a2ed8b2c02bb with identifier: ET68%20NZV
2026-03-29 22:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5e70a7b0-8916-5411-aea9-a2ed8b2c02bb with identifier: ET68%20NZV
2026-03-29 22:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5e70a7b0-8916-5411-aea9-a2ed8b2c02bb with identifier: ET68%20NZV to the API
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 151,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ET68%20NZV-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5e70a7b0-8916-5411-aea9-a2ed8b2c02bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ET68 NZV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ET68%20NZV&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'PEUGEOT',
'model': 'TRAVELLER',
'odometer': 92942,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'PEUGEOT TRAVELLER 2.0 ELUEHDI 180 ALLURE COMP.EAT6 MPV',
'transmission': 'automatic',
'trim': 'ELUEHDI 180 ALLURE COMP.EAT6',
'vin': 'VF3VEAHHWJZ035920',
'year': 2019}
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET68%2520NZV%27 HTTP/1.1" 200 None
2026-03-29 22:05:54 [bca.uk] INFO: Saving data for ET68%20NZV: {'auction_closing_time': 1774864800.0, 'created_time': 1774275134.958729, 'last_price_update_time': 1774821954.643801}
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ET68%2520NZV') HTTP/1.1" 204 0
2026-03-29 22:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089077/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP15SYH/42806364?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Rd4qYDMjPlPfw1eY2qRBNLd1xHPVQnmq6D8gIEro12k%3D)
2026-03-29 22:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387104/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV68URC/42811821?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=UqKQThY1MQH5ObDZI1ey2MVklXRiFzm7WSFSP9Yo17U%3D)
2026-03-29 22:05:54 [bca.uk] INFO: Found listing with ID: HT19%20CVS
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT19%2520CVS%27 HTTP/1.1" 200 None
2026-03-29 22:05:54 [bca.uk] INFO: Scrape type for HT19%20CVS: 2
2026-03-29 22:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2b3f5c4-70ca-530a-a56a-701b7ee98ebe with identifier: HT19%20CVS
2026-03-29 22:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2b3f5c4-70ca-530a-a56a-701b7ee98ebe with scrape type 2
2026-03-29 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2b3f5c4-70ca-530a-a56a-701b7ee98ebe with scrape type 2
2026-03-29 22:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d2b3f5c4-70ca-530a-a56a-701b7ee98ebe, identifier: HT19%20CVS
2026-03-29 22:05:54 [bca.uk] INFO: Found listing with ID: FR68%20BNA
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR68%2520BNA%27 HTTP/1.1" 200 None
2026-03-29 22:05:54 [bca.uk] INFO: Scrape type for FR68%20BNA: 2
2026-03-29 22:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8a20e8b-ecb3-5d71-89a9-3194ce4c0d03 with identifier: FR68%20BNA
2026-03-29 22:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8a20e8b-ecb3-5d71-89a9-3194ce4c0d03 with scrape type 2
2026-03-29 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8a20e8b-ecb3-5d71-89a9-3194ce4c0d03 with scrape type 2
2026-03-29 22:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a8a20e8b-ecb3-5d71-89a9-3194ce4c0d03, identifier: FR68%20BNA
2026-03-29 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61102890>
2026-03-29 22:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH67HFC%252F699248758%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248758/600 saved to cache
2026-03-29 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6836e689-948e-59c9-ae88-0dac50e055fe
2026-03-29 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61122510>
2026-03-29 22:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP65JXL%252F699087994%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087994/600 saved to cache
2026-03-29 22:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4
2026-03-29 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6158aa90>
2026-03-29 22:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP15SYH%252F699089085%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089085/600 saved to cache
2026-03-29 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7722f27f-140c-5241-909a-6e6aa692732b
2026-03-29 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453607/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV59NFX/42798282?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Vj26nnLk4nUkuQUUMphnLssRjpy6Za6fEO4Q%2BW%2BcKKU%3D)
2026-03-29 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453606/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453606>
2026-03-29 22:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d2b3f5c4-70ca-530a-a56a-701b7ee98ebe with identifier: HT19%20CVS
2026-03-29 22:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d2b3f5c4-70ca-530a-a56a-701b7ee98ebe with identifier: HT19%20CVS
2026-03-29 22:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d2b3f5c4-70ca-530a-a56a-701b7ee98ebe with identifier: HT19%20CVS to the API
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HT19%20CVS-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd2b3f5c4-70ca-530a-a56a-701b7ee98ebe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HT19 CVS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HT19%20CVS&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 41159,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'RENAULT CLIO 0.9 TCE 90 ICONIC Hatchback',
'transmission': 'manual',
'trim': 'TCE 90 ICONIC',
'vin': 'VF1R9800062734886',
'year': 2019}
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT19%2520CVS%27 HTTP/1.1" 200 None
2026-03-29 22:05:55 [bca.uk] INFO: Saving data for HT19%20CVS: {'auction_closing_time': 1774951200.0, 'created_time': 1774735379.866401, 'last_price_update_time': 1774821955.313081}
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HT19%2520CVS') HTTP/1.1" 204 0
2026-03-29 22:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a8a20e8b-ecb3-5d71-89a9-3194ce4c0d03 with identifier: FR68%20BNA
2026-03-29 22:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a8a20e8b-ecb3-5d71-89a9-3194ce4c0d03 with identifier: FR68%20BNA
2026-03-29 22:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a8a20e8b-ecb3-5d71-89a9-3194ce4c0d03 with identifier: FR68%20BNA to the API
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FR68%20BNA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a8a20e8b-ecb3-5d71-89a9-3194ce4c0d03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FR68 BNA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FR68%20BNA&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'KUGA',
'odometer': 72723,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD KUGA 1.5 TDCI 120 2WD TITANIUM ED. StationWagon',
'transmission': 'manual',
'trim': 'TDCI 120 2WD TITANIUM ED.',
'vin': 'WF0AXXWPMAKC87774',
'year': 2019}
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR68%2520BNA%27 HTTP/1.1" 200 None
2026-03-29 22:05:55 [bca.uk] INFO: Saving data for FR68%20BNA: {'auction_closing_time': 1774864800.0, 'created_time': 1774621705.980413, 'last_price_update_time': 1774821955.702739}
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FR68%2520BNA') HTTP/1.1" 204 0
2026-03-29 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248749/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH67HFC/42809726?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=aLVrPpUXrfB1VZ7O0yZYRHCjncC2Uv1YIx3J5LA4O1w%3D)
2026-03-29 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699415080/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT66YMF/42812098?sv=2020-08-04&st=2026-03-29T22%3A05%3A18Z&se=2026-03-29T22%3A30%3A18Z&sr=b&sp=r&sig=vvtbY7lfWyfzUXxJcw4PY0HqZZ37wGJm65zbIBo7KHs%3D)
2026-03-29 22:05:55 [bca.uk] INFO: Found listing with ID: LT70%20TDO
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT70%2520TDO%27 HTTP/1.1" 200 None
2026-03-29 22:05:55 [bca.uk] INFO: Scrape type for LT70%20TDO: 2
2026-03-29 22:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d540cd8f-d715-5405-a8d5-11721b31b439 with identifier: LT70%20TDO
2026-03-29 22:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d540cd8f-d715-5405-a8d5-11721b31b439 with scrape type 2
2026-03-29 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d540cd8f-d715-5405-a8d5-11721b31b439 with scrape type 2
2026-03-29 22:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d540cd8f-d715-5405-a8d5-11721b31b439, identifier: LT70%20TDO
2026-03-29 22:05:55 [bca.uk] INFO: Found listing with ID: GX18%20JHA
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX18%2520JHA%27 HTTP/1.1" 200 None
2026-03-29 22:05:55 [bca.uk] INFO: Scrape type for GX18%20JHA: 0
2026-03-29 22:05:55 [bca.uk] INFO: Found listing with ID: ML64%20UOC
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML64%2520UOC%27 HTTP/1.1" 200 None
2026-03-29 22:05:55 [bca.uk] INFO: Scrape type for ML64%20UOC: 2
2026-03-29 22:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88e92d7-3467-57cc-a745-f163ee70bddc with identifier: ML64%20UOC
2026-03-29 22:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88e92d7-3467-57cc-a745-f163ee70bddc with scrape type 2
2026-03-29 22:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e88e92d7-3467-57cc-a745-f163ee70bddc with scrape type 2
2026-03-29 22:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e88e92d7-3467-57cc-a745-f163ee70bddc, identifier: ML64%20UOC
2026-03-29 22:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387090/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV68URC/42811821?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=UqKQThY1MQH5ObDZI1ey2MVklXRiFzm7WSFSP9Yo17U%3D)
2026-03-29 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248731/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248731>
2026-03-29 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699415019/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699415019>
2026-03-29 22:05:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456060/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456060>
2026-03-29 22:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d540cd8f-d715-5405-a8d5-11721b31b439 with identifier: LT70%20TDO
2026-03-29 22:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d540cd8f-d715-5405-a8d5-11721b31b439 with identifier: LT70%20TDO
2026-03-29 22:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d540cd8f-d715-5405-a8d5-11721b31b439 with identifier: LT70%20TDO to the API
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT70%20TDO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd540cd8f-d715-5405-a8d5-11721b31b439',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT70 TDO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT70%20TDO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'PEUGEOT',
'model': '208',
'odometer': 34563,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'PEUGEOT 208 1.2 P/T 75 ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'P/T 75 ACTIVE',
'vin': 'VR3UPHMHDLT076359',
'year': 2020}
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT70%2520TDO%27 HTTP/1.1" 200 None
2026-03-29 22:05:56 [bca.uk] INFO: Saving data for LT70%20TDO: {'auction_closing_time': 1774951200.0, 'created_time': 1774735383.120061, 'last_price_update_time': 1774821956.249865}
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT70%2520TDO') HTTP/1.1" 204 0
2026-03-29 22:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e88e92d7-3467-57cc-a745-f163ee70bddc with identifier: ML64%20UOC
2026-03-29 22:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e88e92d7-3467-57cc-a745-f163ee70bddc with identifier: ML64%20UOC
2026-03-29 22:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e88e92d7-3467-57cc-a745-f163ee70bddc with identifier: ML64%20UOC to the API
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML64%20UOC-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e88e92d7-3467-57cc-a745-f163ee70bddc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML64 UOC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML64%20UOC&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'VOLVO',
'model': 'V40 X-COUNTRY',
'odometer': 50112,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLVO V40 X-COUNTRY 1.6 D2 115 LUX P/S Hatchback',
'transmission': 'automatic',
'trim': 'D2 115 LUX P/S',
'vin': 'YV1MZ845BF2065142',
'year': 2014}
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML64%2520UOC%27 HTTP/1.1" 200 None
2026-03-29 22:05:56 [bca.uk] INFO: Saving data for ML64%20UOC: {'auction_closing_time': 1774864800.0, 'created_time': 1774620788.990174, 'last_price_update_time': 1774821956.544938}
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML64%2520UOC') HTTP/1.1" 204 0
2026-03-29 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a25cd0>
2026-03-29 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP15SYH%252F699089077%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089077/600 saved to cache
2026-03-29 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7722f27f-140c-5241-909a-6e6aa692732b
2026-03-29 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63765f90>
2026-03-29 22:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV68URC%252F699387104%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387104/600 saved to cache
2026-03-29 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c423af70-863f-544f-981f-966354022060
2026-03-29 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089069/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP15SYH/42806364?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Rd4qYDMjPlPfw1eY2qRBNLd1xHPVQnmq6D8gIEro12k%3D)
2026-03-29 22:05:56 [bca.uk] INFO: Found listing with ID: BJ68%20UWN
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ68%2520UWN%27 HTTP/1.1" 200 None
2026-03-29 22:05:56 [bca.uk] INFO: Scrape type for BJ68%20UWN: 2
2026-03-29 22:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f05d113-747f-52ed-a1ad-9799bad35377 with identifier: BJ68%20UWN
2026-03-29 22:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f05d113-747f-52ed-a1ad-9799bad35377 with scrape type 2
2026-03-29 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f05d113-747f-52ed-a1ad-9799bad35377 with scrape type 2
2026-03-29 22:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7f05d113-747f-52ed-a1ad-9799bad35377, identifier: BJ68%20UWN
2026-03-29 22:05:56 [bca.uk] INFO: Found listing with ID: DS18%20FJC
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS18%2520FJC%27 HTTP/1.1" 200 None
2026-03-29 22:05:56 [bca.uk] INFO: Scrape type for DS18%20FJC: 0
2026-03-29 22:05:56 [bca.uk] INFO: Found listing with ID: DA57%20XKX
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA57%2520XKX%27 HTTP/1.1" 200 None
2026-03-29 22:05:56 [bca.uk] INFO: Scrape type for DA57%20XKX: 0
2026-03-29 22:05:56 [bca.uk] INFO: Found listing with ID: DK10%20YMG
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK10%2520YMG%27 HTTP/1.1" 200 None
2026-03-29 22:05:56 [bca.uk] INFO: Scrape type for DK10%20YMG: 0
2026-03-29 22:05:56 [bca.uk] INFO: Found listing with ID: DK12%20ZGD
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK12%2520ZGD%27 HTTP/1.1" 200 None
2026-03-29 22:05:56 [bca.uk] INFO: Scrape type for DK12%20ZGD: 0
2026-03-29 22:05:56 [bca.uk] INFO: Found listing with ID: DY63%20HCO
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY63%2520HCO%27 HTTP/1.1" 200 None
2026-03-29 22:05:56 [bca.uk] INFO: Scrape type for DY63%20HCO: 0
2026-03-29 22:05:56 [bca.uk] INFO: Found listing with ID: GK63%20TXV
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK63%2520TXV%27 HTTP/1.1" 200 None
2026-03-29 22:05:56 [bca.uk] INFO: Scrape type for GK63%20TXV: 2
2026-03-29 22:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e40cd5b-90a1-5489-b32b-18d7c5c72182 with identifier: GK63%20TXV
2026-03-29 22:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e40cd5b-90a1-5489-b32b-18d7c5c72182 with scrape type 2
2026-03-29 22:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e40cd5b-90a1-5489-b32b-18d7c5c72182 with scrape type 2
2026-03-29 22:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2e40cd5b-90a1-5489-b32b-18d7c5c72182, identifier: GK63%20TXV
2026-03-29 22:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699415047/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT66YMF/42812098?sv=2020-08-04&st=2026-03-29T22%3A05%3A18Z&se=2026-03-29T22%3A30%3A18Z&sr=b&sp=r&sig=vvtbY7lfWyfzUXxJcw4PY0HqZZ37wGJm65zbIBo7KHs%3D)
2026-03-29 22:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7f05d113-747f-52ed-a1ad-9799bad35377 with identifier: BJ68%20UWN
2026-03-29 22:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7f05d113-747f-52ed-a1ad-9799bad35377 with identifier: BJ68%20UWN
2026-03-29 22:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7f05d113-747f-52ed-a1ad-9799bad35377 with identifier: BJ68%20UWN to the API
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ68%20UWN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7f05d113-747f-52ed-a1ad-9799bad35377',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ68 UWN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ68%20UWN&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 76699,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 ZETEC EDITION Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 ZETEC EDITION',
'vin': 'WF05XXGCC5JT29100',
'year': 2018}
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ68%2520UWN%27 HTTP/1.1" 200 None
2026-03-29 22:05:57 [bca.uk] INFO: Saving data for BJ68%20UWN: {'auction_closing_time': 1774951200.0, 'created_time': 1774735378.505773, 'last_price_update_time': 1774821957.244573}
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ68%2520UWN') HTTP/1.1" 204 0
2026-03-29 22:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2e40cd5b-90a1-5489-b32b-18d7c5c72182 with identifier: GK63%20TXV
2026-03-29 22:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2e40cd5b-90a1-5489-b32b-18d7c5c72182 with identifier: GK63%20TXV
2026-03-29 22:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2e40cd5b-90a1-5489-b32b-18d7c5c72182 with identifier: GK63%20TXV to the API
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK63%20TXV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2e40cd5b-90a1-5489-b32b-18d7c5c72182',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK63 TXV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GK63%20TXV&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 107540,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.2 TSI 85 S Hatchback',
'transmission': 'manual',
'trim': 'TSI 85 S',
'vin': 'WVWZZZAUZEW096389',
'year': 2013}
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK63%2520TXV%27 HTTP/1.1" 200 None
2026-03-29 22:05:57 [bca.uk] INFO: Saving data for GK63%20TXV: {'auction_closing_time': 1774864800.0, 'created_time': 1774621694.256985, 'last_price_update_time': 1774821957.528902}
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GK63%2520TXV') HTTP/1.1" 204 0
2026-03-29 22:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62159cd0>
2026-03-29 22:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV59NFX%252F699453607%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453607/600 saved to cache
2026-03-29 22:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75379e98-ec74-5bb8-a2ba-dee078101af0
2026-03-29 22:05:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6156e9d0>
2026-03-29 22:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH67HFC%252F699248749%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248749/600 saved to cache
2026-03-29 22:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6836e689-948e-59c9-ae88-0dac50e055fe
2026-03-29 22:05:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61793b50>
2026-03-29 22:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT66YMF%252F699415080%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699415080/600 saved to cache
2026-03-29 22:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5cb9c1b-2fac-5aa0-89c7-e23c2249811e
2026-03-29 22:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457966/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV14TTZ/42810271?sv=2020-08-04&st=2026-03-29T22%3A05%3A26Z&se=2026-03-29T22%3A30%3A26Z&sr=b&sp=r&sig=FgPAFqZLo2N8ZmxnTVXtDLCOVp7mvYK9n8e2P5I%2F32w%3D)
2026-03-29 22:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453606/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV59NFX/42798282?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Vj26nnLk4nUkuQUUMphnLssRjpy6Za6fEO4Q%2BW%2BcKKU%3D)
2026-03-29 22:05:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457962/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699457962>
2026-03-29 22:05:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453604/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699453604>
2026-03-29 22:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248736/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH67HFC/42809726?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=aLVrPpUXrfB1VZ7O0yZYRHCjncC2Uv1YIx3J5LA4O1w%3D)
2026-03-29 22:05:57 [bca.uk] INFO: Found listing with ID: BJ70%20EHU
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ70%2520EHU%27 HTTP/1.1" 200 None
2026-03-29 22:05:57 [bca.uk] INFO: Scrape type for BJ70%20EHU: 2
2026-03-29 22:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf35b337-845e-537f-a976-08188cca66f3 with identifier: BJ70%20EHU
2026-03-29 22:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf35b337-845e-537f-a976-08188cca66f3 with scrape type 2
2026-03-29 22:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf35b337-845e-537f-a976-08188cca66f3 with scrape type 2
2026-03-29 22:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cf35b337-845e-537f-a976-08188cca66f3, identifier: BJ70%20EHU
2026-03-29 22:05:57 [bca.uk] INFO: Found listing with ID: MJ12%20UFB
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ12%2520UFB%27 HTTP/1.1" 200 None
2026-03-29 22:05:57 [bca.uk] INFO: Scrape type for MJ12%20UFB: 2
2026-03-29 22:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b00777e-53b6-528a-adac-a2ef527c4d18 with identifier: MJ12%20UFB
2026-03-29 22:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b00777e-53b6-528a-adac-a2ef527c4d18 with scrape type 2
2026-03-29 22:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b00777e-53b6-528a-adac-a2ef527c4d18 with scrape type 2
2026-03-29 22:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4b00777e-53b6-528a-adac-a2ef527c4d18, identifier: MJ12%20UFB
2026-03-29 22:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456064/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ62YDS/42810080?sv=2020-08-04&st=2026-03-29T22%3A05%3A13Z&se=2026-03-29T22%3A30%3A13Z&sr=b&sp=r&sig=3uF2r926LhFkKPoPLSCohRVnNGX4IbgEWDcBb0D1E%2B8%3D)
2026-03-29 22:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cf35b337-845e-537f-a976-08188cca66f3 with identifier: BJ70%20EHU
2026-03-29 22:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cf35b337-845e-537f-a976-08188cca66f3 with identifier: BJ70%20EHU
2026-03-29 22:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cf35b337-845e-537f-a976-08188cca66f3 with identifier: BJ70%20EHU to the API
2026-03-29 22:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 165,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ70%20EHU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cf35b337-845e-537f-a976-08188cca66f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ70 EHU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ70%20EHU&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VOLVO',
'model': 'XC40',
'odometer': 69983,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VOLVO XC40 2.0 B4P R DESIGN PRO G/T StationWagon',
'transmission': 'automatic',
'trim': 'B4P R DESIGN PRO G/T',
'vin': 'YV1XZK9BDM2441360',
'year': 2020}
2026-03-29 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ70%2520EHU%27 HTTP/1.1" 200 None
2026-03-29 22:05:58 [bca.uk] INFO: Saving data for BJ70%20EHU: {'auction_closing_time': 1774951200.0, 'created_time': 1774735369.907614, 'last_price_update_time': 1774821958.481463}
2026-03-29 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ70%2520EHU') HTTP/1.1" 204 0
2026-03-29 22:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4b00777e-53b6-528a-adac-a2ef527c4d18 with identifier: MJ12%20UFB
2026-03-29 22:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4b00777e-53b6-528a-adac-a2ef527c4d18 with identifier: MJ12%20UFB
2026-03-29 22:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4b00777e-53b6-528a-adac-a2ef527c4d18 with identifier: MJ12%20UFB to the API
2026-03-29 22:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ12%20UFB-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4b00777e-53b6-528a-adac-a2ef527c4d18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ12 UFB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ12%20UFB&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'KA',
'odometer': 91180,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD KA 1.2 ZETEC S/S Hatchback',
'transmission': 'manual',
'trim': 'ZETEC S/S',
'vin': 'WF0UXXLTRUCD69649',
'year': 2012}
2026-03-29 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ12%2520UFB%27 HTTP/1.1" 200 None
2026-03-29 22:05:58 [bca.uk] INFO: Saving data for MJ12%20UFB: {'auction_closing_time': 1774864800.0, 'created_time': 1774621672.742413, 'last_price_update_time': 1774821958.853905}
2026-03-29 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ12%2520UFB') HTTP/1.1" 204 0
2026-03-29 22:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089063/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089063>
2026-03-29 22:05:58 [bca.uk] INFO: Found listing with ID: KJ73%20EOT
2026-03-29 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ73%2520EOT%27 HTTP/1.1" 200 None
2026-03-29 22:05:58 [bca.uk] INFO: Scrape type for KJ73%20EOT: 2
2026-03-29 22:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab2f45d0-e564-5ded-8cb4-0288835f055c with identifier: KJ73%20EOT
2026-03-29 22:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab2f45d0-e564-5ded-8cb4-0288835f055c with scrape type 2
2026-03-29 22:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab2f45d0-e564-5ded-8cb4-0288835f055c with scrape type 2
2026-03-29 22:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ab2f45d0-e564-5ded-8cb4-0288835f055c, identifier: KJ73%20EOT
2026-03-29 22:05:59 [bca.uk] INFO: Found listing with ID: PE14%20KXO
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE14%2520KXO%27 HTTP/1.1" 200 None
2026-03-29 22:05:59 [bca.uk] INFO: Scrape type for PE14%20KXO: 2
2026-03-29 22:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9dbe1dc-f4cc-54f3-bf21-9f2441bfb711 with identifier: PE14%20KXO
2026-03-29 22:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9dbe1dc-f4cc-54f3-bf21-9f2441bfb711 with scrape type 2
2026-03-29 22:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9dbe1dc-f4cc-54f3-bf21-9f2441bfb711 with scrape type 2
2026-03-29 22:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c9dbe1dc-f4cc-54f3-bf21-9f2441bfb711, identifier: PE14%20KXO
2026-03-29 22:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6377b6d0>
2026-03-29 22:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV68URC%252F699387090%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387090/600 saved to cache
2026-03-29 22:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c423af70-863f-544f-981f-966354022060
2026-03-29 22:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620aa690>
2026-03-29 22:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP15SYH%252F699089069%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089069/600 saved to cache
2026-03-29 22:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7722f27f-140c-5241-909a-6e6aa692732b
2026-03-29 22:05:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:05:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:05:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:05:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61121490>
2026-03-29 22:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT66YMF%252F699415047%252F600') HTTP/1.1" 204 0
2026-03-29 22:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699415047/600 saved to cache
2026-03-29 22:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5cb9c1b-2fac-5aa0-89c7-e23c2249811e
2026-03-29 22:05:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387071/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387071>
2026-03-29 22:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248731/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH67HFC/42809726?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=aLVrPpUXrfB1VZ7O0yZYRHCjncC2Uv1YIx3J5LA4O1w%3D)
2026-03-29 22:05:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414993/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414993>
2026-03-29 22:05:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248725/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248725>
2026-03-29 22:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456060/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ62YDS/42810080?sv=2020-08-04&st=2026-03-29T22%3A05%3A13Z&se=2026-03-29T22%3A30%3A13Z&sr=b&sp=r&sig=3uF2r926LhFkKPoPLSCohRVnNGX4IbgEWDcBb0D1E%2B8%3D)
2026-03-29 22:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ab2f45d0-e564-5ded-8cb4-0288835f055c with identifier: KJ73%20EOT
2026-03-29 22:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ab2f45d0-e564-5ded-8cb4-0288835f055c with identifier: KJ73%20EOT
2026-03-29 22:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ab2f45d0-e564-5ded-8cb4-0288835f055c with identifier: KJ73%20EOT to the API
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KJ73%20EOT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ab2f45d0-e564-5ded-8cb4-0288835f055c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KJ73 EOT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KJ73%20EOT&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MERCEDES-BENZ',
'model': 'CLA 180 S/B',
'odometer': 11034,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLA 180 S/B 1.3 AMG LINE EXECUTIVE DCT Estate',
'transmission': 'automatic',
'trim': 'AMG LINE EXECUTIVE DCT',
'vin': 'W1K5M8EB4RN459525',
'year': 2024}
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ73%2520EOT%27 HTTP/1.1" 200 None
2026-03-29 22:05:59 [bca.uk] INFO: Saving data for KJ73%20EOT: {'auction_closing_time': 1774951200.0, 'created_time': 1774735361.858642, 'last_price_update_time': 1774821959.556973}
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KJ73%2520EOT') HTTP/1.1" 204 0
2026-03-29 22:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c9dbe1dc-f4cc-54f3-bf21-9f2441bfb711 with identifier: PE14%20KXO
2026-03-29 22:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c9dbe1dc-f4cc-54f3-bf21-9f2441bfb711 with identifier: PE14%20KXO
2026-03-29 22:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c9dbe1dc-f4cc-54f3-bf21-9f2441bfb711 with identifier: PE14%20KXO to the API
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PE14%20KXO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c9dbe1dc-f4cc-54f3-bf21-9f2441bfb711',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PE14 KXO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PE14%20KXO&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 40983,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TI-VCT 125 TITANIUM NAVIGATOR Hatchback',
'transmission': 'automatic',
'trim': 'TI-VCT 125 TITANIUM NAVIGATOR',
'vin': 'WF0KXXGCBKES27765',
'year': 2014}
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE14%2520KXO%27 HTTP/1.1" 200 None
2026-03-29 22:05:59 [bca.uk] INFO: Saving data for PE14%20KXO: {'auction_closing_time': 1774864800.0, 'created_time': 1774621700.92926, 'last_price_update_time': 1774821959.867376}
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PE14%2520KXO') HTTP/1.1" 204 0
2026-03-29 22:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699415019/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT66YMF/42812098?sv=2020-08-04&st=2026-03-29T22%3A05%3A18Z&se=2026-03-29T22%3A30%3A18Z&sr=b&sp=r&sig=vvtbY7lfWyfzUXxJcw4PY0HqZZ37wGJm65zbIBo7KHs%3D)
2026-03-29 22:05:59 [bca.uk] INFO: Found listing with ID: BP15%20GZB
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP15%2520GZB%27 HTTP/1.1" 200 None
2026-03-29 22:05:59 [bca.uk] INFO: Scrape type for BP15%20GZB: 2
2026-03-29 22:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 283b6c92-cce2-544a-9b3b-da049a06ca33 with identifier: BP15%20GZB
2026-03-29 22:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 283b6c92-cce2-544a-9b3b-da049a06ca33 with scrape type 2
2026-03-29 22:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 283b6c92-cce2-544a-9b3b-da049a06ca33 with scrape type 2
2026-03-29 22:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 283b6c92-cce2-544a-9b3b-da049a06ca33, identifier: BP15%20GZB
2026-03-29 22:06:00 [bca.uk] INFO: Found listing with ID: PN57%20XKS
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN57%2520XKS%27 HTTP/1.1" 200 None
2026-03-29 22:06:00 [bca.uk] INFO: Scrape type for PN57%20XKS: 0
2026-03-29 22:06:00 [bca.uk] INFO: Found listing with ID: PY15%20TGO
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY15%2520TGO%27 HTTP/1.1" 200 None
2026-03-29 22:06:00 [bca.uk] INFO: Scrape type for PY15%20TGO: 2
2026-03-29 22:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 830419de-9cf7-53e9-9135-911d8bd5b61a with identifier: PY15%20TGO
2026-03-29 22:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 830419de-9cf7-53e9-9135-911d8bd5b61a with scrape type 2
2026-03-29 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 830419de-9cf7-53e9-9135-911d8bd5b61a with scrape type 2
2026-03-29 22:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 830419de-9cf7-53e9-9135-911d8bd5b61a, identifier: PY15%20TGO
2026-03-29 22:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6368e610>
2026-03-29 22:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV14TTZ%252F699457966%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457966/600 saved to cache
2026-03-29 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3909531a-470f-5688-8297-acd46a9f879d
2026-03-29 22:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac60ffae10>
2026-03-29 22:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV59NFX%252F699453606%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453606/600 saved to cache
2026-03-29 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75379e98-ec74-5bb8-a2ba-dee078101af0
2026-03-29 22:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63545610>
2026-03-29 22:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH67HFC%252F699248736%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248736/600 saved to cache
2026-03-29 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6836e689-948e-59c9-ae88-0dac50e055fe
2026-03-29 22:06:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:06:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62197390>
2026-03-29 22:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ62YDS%252F699456064%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456064/600 saved to cache
2026-03-29 22:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e23ce11-f3f0-5635-b5b9-03f2e6272954
2026-03-29 22:06:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399600/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699399600>
2026-03-29 22:06:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456057/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456057>
2026-03-29 22:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 283b6c92-cce2-544a-9b3b-da049a06ca33 with identifier: BP15%20GZB
2026-03-29 22:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 283b6c92-cce2-544a-9b3b-da049a06ca33 with identifier: BP15%20GZB
2026-03-29 22:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 283b6c92-cce2-544a-9b3b-da049a06ca33 with identifier: BP15%20GZB to the API
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 292,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BP15%20GZB-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '5.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '283b6c92-cce2-544a-9b3b-da049a06ca33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BP15 GZB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BP15%20GZB&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'JAGUAR',
'model': 'XKR',
'odometer': 19925,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'JAGUAR XKR 5.0 V8 SUPERCHARGED DYNAMIC Coupe',
'transmission': 'automatic',
'trim': 'V8 SUPERCHARGED DYNAMIC',
'vin': 'SAJAC45R8FMB56318',
'year': 2015}
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP15%2520GZB%27 HTTP/1.1" 200 None
2026-03-29 22:06:00 [bca.uk] INFO: Saving data for BP15%20GZB: {'auction_closing_time': 1774951200.0, 'created_time': 1774735362.263865, 'last_price_update_time': 1774821960.697184}
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BP15%2520GZB') HTTP/1.1" 204 0
2026-03-29 22:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 830419de-9cf7-53e9-9135-911d8bd5b61a with identifier: PY15%20TGO
2026-03-29 22:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 830419de-9cf7-53e9-9135-911d8bd5b61a with identifier: PY15%20TGO
2026-03-29 22:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 830419de-9cf7-53e9-9135-911d8bd5b61a with identifier: PY15%20TGO to the API
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PY15%20TGO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '830419de-9cf7-53e9-9135-911d8bd5b61a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PY15 TGO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PY15%20TGO&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'GRAND CONNECT',
'odometer': 133437,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FORD GRAND CONNECT 1.6 TDCI 115 TITANIUM (5ST) MPV',
'transmission': 'manual',
'trim': 'TDCI 115 TITANIUM (5ST)',
'vin': 'WF05XXWPG5FL19077',
'year': 2015}
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY15%2520TGO%27 HTTP/1.1" 200 None
2026-03-29 22:06:01 [bca.uk] INFO: Saving data for PY15%20TGO: {'auction_closing_time': 1774864800.0, 'created_time': 1774621684.690704, 'last_price_update_time': 1774821961.032139}
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PY15%2520TGO') HTTP/1.1" 204 0
2026-03-29 22:06:01 [bca.uk] INFO: Found listing with ID: VX52%20YYH
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX52%2520YYH%27 HTTP/1.1" 200 None
2026-03-29 22:06:01 [bca.uk] INFO: Scrape type for VX52%20YYH: 2
2026-03-29 22:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08d9ff90-12a7-5f3d-86ac-c640dc2351b5 with identifier: VX52%20YYH
2026-03-29 22:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08d9ff90-12a7-5f3d-86ac-c640dc2351b5 with scrape type 2
2026-03-29 22:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08d9ff90-12a7-5f3d-86ac-c640dc2351b5 with scrape type 2
2026-03-29 22:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 08d9ff90-12a7-5f3d-86ac-c640dc2351b5, identifier: VX52%20YYH
2026-03-29 22:06:01 [bca.uk] INFO: Found listing with ID: SK13%20XZN
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK13%2520XZN%27 HTTP/1.1" 200 None
2026-03-29 22:06:01 [bca.uk] INFO: Scrape type for SK13%20XZN: 0
2026-03-29 22:06:01 [bca.uk] INFO: Found listing with ID: VO12%20XVT
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO12%2520XVT%27 HTTP/1.1" 200 None
2026-03-29 22:06:01 [bca.uk] INFO: Scrape type for VO12%20XVT: 0
2026-03-29 22:06:01 [bca.uk] INFO: Found listing with ID: YP66%20VYN
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP66%2520VYN%27 HTTP/1.1" 200 None
2026-03-29 22:06:01 [bca.uk] INFO: Scrape type for YP66%20VYN: 0
2026-03-29 22:06:01 [bca.uk] INFO: Found listing with ID: CW58%20JRW
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CW58%2520JRW%27 HTTP/1.1" 200 None
2026-03-29 22:06:01 [bca.uk] INFO: Scrape type for CW58%20JRW: 0
2026-03-29 22:06:01 [bca.uk] INFO: Found listing with ID: LC08%20XBB
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC08%2520XBB%27 HTTP/1.1" 200 None
2026-03-29 22:06:01 [bca.uk] INFO: Scrape type for LC08%20XBB: 2
2026-03-29 22:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f85ebd75-b202-5555-83e0-f40ad749d770 with identifier: LC08%20XBB
2026-03-29 22:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f85ebd75-b202-5555-83e0-f40ad749d770 with scrape type 2
2026-03-29 22:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f85ebd75-b202-5555-83e0-f40ad749d770 with scrape type 2
2026-03-29 22:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f85ebd75-b202-5555-83e0-f40ad749d770, identifier: LC08%20XBB
2026-03-29 22:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6187bd10>
2026-03-29 22:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH67HFC%252F699248731%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248731/600 saved to cache
2026-03-29 22:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6836e689-948e-59c9-ae88-0dac50e055fe
2026-03-29 22:06:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:06:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:06:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618ef0d0>
2026-03-29 22:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ62YDS%252F699456060%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456060/600 saved to cache
2026-03-29 22:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e23ce11-f3f0-5635-b5b9-03f2e6272954
2026-03-29 22:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453604/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV59NFX/42798282?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Vj26nnLk4nUkuQUUMphnLssRjpy6Za6fEO4Q%2BW%2BcKKU%3D)
2026-03-29 22:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089063/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP15SYH/42806364?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Rd4qYDMjPlPfw1eY2qRBNLd1xHPVQnmq6D8gIEro12k%3D)
2026-03-29 22:06:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087892/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699087892>
2026-03-29 22:06:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387065/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387065>
2026-03-29 22:06:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089061/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089061>
2026-03-29 22:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457962/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV14TTZ/42810271?sv=2020-08-04&st=2026-03-29T22%3A05%3A26Z&se=2026-03-29T22%3A30%3A26Z&sr=b&sp=r&sig=FgPAFqZLo2N8ZmxnTVXtDLCOVp7mvYK9n8e2P5I%2F32w%3D)
2026-03-29 22:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 08d9ff90-12a7-5f3d-86ac-c640dc2351b5 with identifier: VX52%20YYH
2026-03-29 22:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 08d9ff90-12a7-5f3d-86ac-c640dc2351b5 with identifier: VX52%20YYH
2026-03-29 22:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 08d9ff90-12a7-5f3d-86ac-c640dc2351b5 with identifier: VX52%20YYH to the API
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VX52%20YYH-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '08d9ff90-12a7-5f3d-86ac-c640dc2351b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VX52 YYH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VX52%20YYH&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 30831,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.4 I-DSI SE Hatchback',
'transmission': 'manual',
'trim': 'I-DSI SE',
'vin': 'JHMGD17502S241222',
'year': 2002}
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX52%2520YYH%27 HTTP/1.1" 200 None
2026-03-29 22:06:01 [bca.uk] INFO: Saving data for VX52%20YYH: {'auction_closing_time': 1774951200.0, 'created_time': 1774735359.767617, 'last_price_update_time': 1774821961.777845}
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VX52%2520YYH') HTTP/1.1" 204 0
2026-03-29 22:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f85ebd75-b202-5555-83e0-f40ad749d770 with identifier: LC08%20XBB
2026-03-29 22:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f85ebd75-b202-5555-83e0-f40ad749d770 with identifier: LC08%20XBB
2026-03-29 22:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f85ebd75-b202-5555-83e0-f40ad749d770 with identifier: LC08%20XBB to the API
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC08%20XBB-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f85ebd75-b202-5555-83e0-f40ad749d770',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC08 XBB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LC08%20XBB&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 60636,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.4 I-DSI SPORT CVT-7 Hatchback',
'transmission': 'manual',
'trim': 'I-DSI SPORT CVT-7',
'vin': 'LUCGE389083216916',
'year': 2008}
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC08%2520XBB%27 HTTP/1.1" 200 None
2026-03-29 22:06:02 [bca.uk] INFO: Saving data for LC08%20XBB: {'auction_closing_time': 1774864800.0, 'created_time': 1774735390.345679, 'last_price_update_time': 1774821962.175302}
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LC08%2520XBB') HTTP/1.1" 204 0
2026-03-29 22:06:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:06:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62197dd0>
2026-03-29 22:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT66YMF%252F699415019%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699415019/600 saved to cache
2026-03-29 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5cb9c1b-2fac-5aa0-89c7-e23c2249811e
2026-03-29 22:06:02 [bca.uk] INFO: Total items found: 100
2026-03-29 22:06:02 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded
2026-03-29 22:06:02 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:06:02 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:06:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248718/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248718>
2026-03-29 22:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248725/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH67HFC/42809726?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=aLVrPpUXrfB1VZ7O0yZYRHCjncC2Uv1YIx3J5LA4O1w%3D)
2026-03-29 22:06:02 [bca.uk] INFO: Found listing with ID: WU66%20XNV
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU66%2520XNV%27 HTTP/1.1" 200 None
2026-03-29 22:06:02 [bca.uk] INFO: Scrape type for WU66%20XNV: 2
2026-03-29 22:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51da0f1d-592f-5dda-b1f6-cadeb5cfb790 with identifier: WU66%20XNV
2026-03-29 22:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51da0f1d-592f-5dda-b1f6-cadeb5cfb790 with scrape type 2
2026-03-29 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51da0f1d-592f-5dda-b1f6-cadeb5cfb790 with scrape type 2
2026-03-29 22:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 51da0f1d-592f-5dda-b1f6-cadeb5cfb790, identifier: WU66%20XNV
2026-03-29 22:06:02 [bca.uk] INFO: Found listing with ID: VKZ%202608
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VKZ%25202608%27 HTTP/1.1" 200 None
2026-03-29 22:06:02 [bca.uk] INFO: Scrape type for VKZ%202608: 2
2026-03-29 22:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0e083fc-0fc7-5652-936e-3a40315f73e3 with identifier: VKZ%202608
2026-03-29 22:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e083fc-0fc7-5652-936e-3a40315f73e3 with scrape type 2
2026-03-29 22:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0e083fc-0fc7-5652-936e-3a40315f73e3 with scrape type 2
2026-03-29 22:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a0e083fc-0fc7-5652-936e-3a40315f73e3, identifier: VKZ%202608
2026-03-29 22:06:02 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:06:02 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 51da0f1d-592f-5dda-b1f6-cadeb5cfb790 with identifier: WU66%20XNV
2026-03-29 22:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 51da0f1d-592f-5dda-b1f6-cadeb5cfb790 with identifier: WU66%20XNV
2026-03-29 22:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 51da0f1d-592f-5dda-b1f6-cadeb5cfb790 with identifier: WU66%20XNV to the API
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WU66%20XNV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '51da0f1d-592f-5dda-b1f6-cadeb5cfb790',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WU66 XNV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WU66%20XNV&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'PEUGEOT',
'model': '308',
'odometer': 68999,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.2 P/T 130 ALLURE EAT6 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 ALLURE EAT6',
'vin': 'VF3LPHNYWGS251550',
'year': 2016}
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU66%2520XNV%27 HTTP/1.1" 200 None
2026-03-29 22:06:02 [bca.uk] INFO: Saving data for WU66%20XNV: {'auction_closing_time': 1774864800.0, 'created_time': 1774735340.275341, 'last_price_update_time': 1774821962.864691}
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WU66%2520XNV') HTTP/1.1" 204 0
2026-03-29 22:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a0e083fc-0fc7-5652-936e-3a40315f73e3 with identifier: VKZ%202608
2026-03-29 22:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a0e083fc-0fc7-5652-936e-3a40315f73e3 with identifier: VKZ%202608
2026-03-29 22:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a0e083fc-0fc7-5652-936e-3a40315f73e3 with identifier: VKZ%202608 to the API
2026-03-29 22:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VKZ%202608-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a0e083fc-0fc7-5652-936e-3a40315f73e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VKZ 2608',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VKZ%202608&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 128852,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'FORD FOCUS 2.0 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'TITANIUM',
'vin': 'WF0PXXGCDP8B12189',
'year': 2008}
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VKZ%25202608%27 HTTP/1.1" 200 None
2026-03-29 22:06:03 [bca.uk] INFO: Saving data for VKZ%202608: {'auction_closing_time': 1774864800.0, 'created_time': 1774735374.604453, 'last_price_update_time': 1774821963.155569}
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VKZ%25202608') HTTP/1.1" 204 0
2026-03-29 22:06:03 [bca.uk] INFO: Found listing with ID: YE59%20VRX
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE59%2520VRX%27 HTTP/1.1" 200 None
2026-03-29 22:06:03 [bca.uk] INFO: Scrape type for YE59%20VRX: 2
2026-03-29 22:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e840cff7-63ef-534e-a127-ffab51ca54c5 with identifier: YE59%20VRX
2026-03-29 22:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e840cff7-63ef-534e-a127-ffab51ca54c5 with scrape type 2
2026-03-29 22:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e840cff7-63ef-534e-a127-ffab51ca54c5 with scrape type 2
2026-03-29 22:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e840cff7-63ef-534e-a127-ffab51ca54c5, identifier: YE59%20VRX
2026-03-29 22:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456055/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456055>
2026-03-29 22:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414945/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414945>
2026-03-29 22:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456037/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456037>
2026-03-29 22:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387071/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV68URC/42811821?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=UqKQThY1MQH5ObDZI1ey2MVklXRiFzm7WSFSP9Yo17U%3D)
2026-03-29 22:06:03 [bca.uk] INFO: Found listing with ID: DS15%20KUO
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS15%2520KUO%27 HTTP/1.1" 200 None
2026-03-29 22:06:03 [bca.uk] INFO: Scrape type for DS15%20KUO: 0
2026-03-29 22:06:03 [bca.uk] INFO: Found listing with ID: FP65%20EUR
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP65%2520EUR%27 HTTP/1.1" 200 None
2026-03-29 22:06:03 [bca.uk] INFO: Scrape type for FP65%20EUR: 2
2026-03-29 22:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 484f934c-eb0c-5acf-ac79-fe2e0b847b08 with identifier: FP65%20EUR
2026-03-29 22:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 484f934c-eb0c-5acf-ac79-fe2e0b847b08 with scrape type 2
2026-03-29 22:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 484f934c-eb0c-5acf-ac79-fe2e0b847b08 with scrape type 2
2026-03-29 22:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 484f934c-eb0c-5acf-ac79-fe2e0b847b08, identifier: FP65%20EUR
2026-03-29 22:06:03 [bca.uk] INFO: Found listing with ID: AU61%20XXN
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU61%2520XXN%27 HTTP/1.1" 200 None
2026-03-29 22:06:03 [bca.uk] INFO: Scrape type for AU61%20XXN: 0
2026-03-29 22:06:03 [bca.uk] INFO: Found listing with ID: AV12%20XOM
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV12%2520XOM%27 HTTP/1.1" 200 None
2026-03-29 22:06:03 [bca.uk] INFO: Scrape type for AV12%20XOM: 2
2026-03-29 22:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 530e01d0-f521-59d6-894f-203412bcfac6 with identifier: AV12%20XOM
2026-03-29 22:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 530e01d0-f521-59d6-894f-203412bcfac6 with scrape type 2
2026-03-29 22:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 530e01d0-f521-59d6-894f-203412bcfac6 with scrape type 2
2026-03-29 22:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 530e01d0-f521-59d6-894f-203412bcfac6, identifier: AV12%20XOM
2026-03-29 22:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e840cff7-63ef-534e-a127-ffab51ca54c5 with identifier: YE59%20VRX
2026-03-29 22:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e840cff7-63ef-534e-a127-ffab51ca54c5 with identifier: YE59%20VRX
2026-03-29 22:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e840cff7-63ef-534e-a127-ffab51ca54c5 with identifier: YE59%20VRX to the API
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YE59%20VRX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e840cff7-63ef-534e-a127-ffab51ca54c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YE59 VRX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YE59%20VRX&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'BMW',
'model': '320D',
'odometer': 141770,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 M SPORT Coupe',
'transmission': 'automatic',
'trim': 'M SPORT',
'vin': 'WBAWD12090PP60465',
'year': 2010}
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE59%2520VRX%27 HTTP/1.1" 200 None
2026-03-29 22:06:03 [bca.uk] INFO: Saving data for YE59%20VRX: {'auction_closing_time': 1774864800.0, 'created_time': 1774735386.801983, 'last_price_update_time': 1774821963.822596}
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YE59%2520VRX') HTTP/1.1" 204 0
2026-03-29 22:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414993/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT66YMF/42812098?sv=2020-08-04&st=2026-03-29T22%3A05%3A18Z&se=2026-03-29T22%3A30%3A18Z&sr=b&sp=r&sig=vvtbY7lfWyfzUXxJcw4PY0HqZZ37wGJm65zbIBo7KHs%3D)
2026-03-29 22:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456057/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ62YDS/42810080?sv=2020-08-04&st=2026-03-29T22%3A05%3A13Z&se=2026-03-29T22%3A30%3A13Z&sr=b&sp=r&sig=3uF2r926LhFkKPoPLSCohRVnNGX4IbgEWDcBb0D1E%2B8%3D)
2026-03-29 22:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 484f934c-eb0c-5acf-ac79-fe2e0b847b08 with identifier: FP65%20EUR
2026-03-29 22:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 484f934c-eb0c-5acf-ac79-fe2e0b847b08 with identifier: FP65%20EUR
2026-03-29 22:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 484f934c-eb0c-5acf-ac79-fe2e0b847b08 with identifier: FP65%20EUR to the API
2026-03-29 22:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FP65%20EUR-GB',
'category': 'Car',
'color': 'orange',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '484f934c-eb0c-5acf-ac79-fe2e0b847b08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FP65 EUR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FP65%20EUR&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'CITROEN',
'model': 'C1',
'odometer': 73745,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'CITROEN C1 1.2 P/T 82 FLAIR Hatchback',
'transmission': 'manual',
'trim': 'P/T 82 FLAIR',
'vin': 'VF7PAHMTCFR771726',
'year': 2016}
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP65%2520EUR%27 HTTP/1.1" 200 None
2026-03-29 22:06:04 [bca.uk] INFO: Saving data for FP65%20EUR: {'auction_closing_time': 1774864800.0, 'created_time': 1774477724.473477, 'last_price_update_time': 1774821964.163377}
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FP65%2520EUR') HTTP/1.1" 204 0
2026-03-29 22:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 530e01d0-f521-59d6-894f-203412bcfac6 with identifier: AV12%20XOM
2026-03-29 22:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 530e01d0-f521-59d6-894f-203412bcfac6 with identifier: AV12%20XOM
2026-03-29 22:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 530e01d0-f521-59d6-894f-203412bcfac6 with identifier: AV12%20XOM to the API
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV12%20XOM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '530e01d0-f521-59d6-894f-203412bcfac6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV12 XOM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV12%20XOM&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 130144,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TDCI 115 TITANIUM X Hatchback',
'transmission': 'manual',
'trim': 'TDCI 115 TITANIUM X',
'vin': 'WF0KXXGCBKCC15110',
'year': 2012}
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV12%2520XOM%27 HTTP/1.1" 200 None
2026-03-29 22:06:04 [bca.uk] INFO: Saving data for AV12%20XOM: {'auction_closing_time': 1774864800.0, 'created_time': 1774621511.117031, 'last_price_update_time': 1774821964.484027}
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV12%2520XOM') HTTP/1.1" 204 0
2026-03-29 22:06:04 [bca.uk] INFO: Found listing with ID: YP07%20ZRX
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP07%2520ZRX%27 HTTP/1.1" 200 None
2026-03-29 22:06:04 [bca.uk] INFO: Scrape type for YP07%20ZRX: 2
2026-03-29 22:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2 with identifier: YP07%20ZRX
2026-03-29 22:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2 with scrape type 2
2026-03-29 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2 with scrape type 2
2026-03-29 22:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2, identifier: YP07%20ZRX
2026-03-29 22:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399600/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT14HGA/42812005?sv=2020-08-04&st=2026-03-29T22%3A05%3A17Z&se=2026-03-29T22%3A30%3A17Z&sr=b&sp=r&sig=waPrjmAums3L%2FvFzJ%2Fhg5dv7M7RjxxPDejipYOMZYCI%3D)
2026-03-29 22:06:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087856/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BP65JXL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:06:04 [bca.uk] INFO: Found listing with ID: LL16%20FYY
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL16%2520FYY%27 HTTP/1.1" 200 None
2026-03-29 22:06:04 [bca.uk] INFO: Scrape type for LL16%20FYY: 2
2026-03-29 22:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc084816-a7cd-510e-bdb1-fb2509736d3b with identifier: LL16%20FYY
2026-03-29 22:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc084816-a7cd-510e-bdb1-fb2509736d3b with scrape type 2
2026-03-29 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc084816-a7cd-510e-bdb1-fb2509736d3b with scrape type 2
2026-03-29 22:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cc084816-a7cd-510e-bdb1-fb2509736d3b, identifier: LL16%20FYY
2026-03-29 22:06:04 [bca.uk] INFO: Found listing with ID: BG14%20OHU
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG14%2520OHU%27 HTTP/1.1" 200 None
2026-03-29 22:06:04 [bca.uk] INFO: Scrape type for BG14%20OHU: 2
2026-03-29 22:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adcd49ce-e0fe-5874-8c1b-a8a55d414bd7 with identifier: BG14%20OHU
2026-03-29 22:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adcd49ce-e0fe-5874-8c1b-a8a55d414bd7 with scrape type 2
2026-03-29 22:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adcd49ce-e0fe-5874-8c1b-a8a55d414bd7 with scrape type 2
2026-03-29 22:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: adcd49ce-e0fe-5874-8c1b-a8a55d414bd7, identifier: BG14%20OHU
2026-03-29 22:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2 with identifier: YP07%20ZRX
2026-03-29 22:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2 with identifier: YP07%20ZRX
2026-03-29 22:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9778d0fc-88ae-5ce5-b8be-dfaa70e989c2 with identifier: YP07%20ZRX to the API
2026-03-29 22:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 171,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YP07%20ZRX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9778d0fc-88ae-5ce5-b8be-dfaa70e989c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YP07 ZRX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YP07%20ZRX&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VOLKSWAGEN',
'model': 'GOLF PLUS',
'odometer': 88019,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF PLUS 1.6 FSI SE Hatchback',
'transmission': 'manual',
'trim': 'FSI SE',
'vin': 'WVWZZZ1KZ7W605493',
'year': 2007}
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP07%2520ZRX%27 HTTP/1.1" 200 None
2026-03-29 22:06:05 [bca.uk] INFO: Saving data for YP07%20ZRX: {'auction_closing_time': 1774864800.0, 'created_time': 1774735388.084639, 'last_price_update_time': 1774821965.131967}
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YP07%2520ZRX') HTTP/1.1" 204 0
2026-03-29 22:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62195f10>
2026-03-29 22:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV59NFX%252F699453604%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453604/600 saved to cache
2026-03-29 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75379e98-ec74-5bb8-a2ba-dee078101af0
2026-03-29 22:06:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75379e98-ec74-5bb8-a2ba-dee078101af0, skipping ID generation
2026-03-29 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75379e98-ec74-5bb8-a2ba-dee078101af0 sending to next pipeline
2026-03-29 22:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 75379e98-ec74-5bb8-a2ba-dee078101af0, identifier: FV59%20NFX
2026-03-29 22:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61bb0d50>
2026-03-29 22:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP15SYH%252F699089063%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089063/600 saved to cache
2026-03-29 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7722f27f-140c-5241-909a-6e6aa692732b
2026-03-29 22:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61bb9b10>
2026-03-29 22:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV14TTZ%252F699457962%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457962/600 saved to cache
2026-03-29 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3909531a-470f-5688-8297-acd46a9f879d
2026-03-29 22:06:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3909531a-470f-5688-8297-acd46a9f879d, skipping ID generation
2026-03-29 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3909531a-470f-5688-8297-acd46a9f879d sending to next pipeline
2026-03-29 22:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3909531a-470f-5688-8297-acd46a9f879d, identifier: SV14%20TTZ
2026-03-29 22:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632e0110>
2026-03-29 22:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH67HFC%252F699248725%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248725/600 saved to cache
2026-03-29 22:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6836e689-948e-59c9-ae88-0dac50e055fe
2026-03-29 22:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089061/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP15SYH/42806364?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Rd4qYDMjPlPfw1eY2qRBNLd1xHPVQnmq6D8gIEro12k%3D)
2026-03-29 22:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387065/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV68URC/42811821?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=UqKQThY1MQH5ObDZI1ey2MVklXRiFzm7WSFSP9Yo17U%3D)
2026-03-29 22:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087892/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP65JXL/42808111?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=NuWfvCjhCnPVyKXKJ4JcyeNaRmV90x6ROfl09hllUPs%3D)
2026-03-29 22:06:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089057/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089057>
2026-03-29 22:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cc084816-a7cd-510e-bdb1-fb2509736d3b with identifier: LL16%20FYY
2026-03-29 22:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cc084816-a7cd-510e-bdb1-fb2509736d3b with identifier: LL16%20FYY
2026-03-29 22:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cc084816-a7cd-510e-bdb1-fb2509736d3b with identifier: LL16%20FYY to the API
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 94,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LL16%20FYY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'cc084816-a7cd-510e-bdb1-fb2509736d3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL16 FYY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LL16%20FYY&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 100078,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD MONDEO 1.5 TDCI 120 ECO TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'TDCI 120 ECO TITANIUM',
'vin': 'WF0EXXWPCEGG42057',
'year': 2016}
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL16%2520FYY%27 HTTP/1.1" 200 None
2026-03-29 22:06:05 [bca.uk] INFO: Saving data for LL16%20FYY: {'auction_closing_time': 1774864800.0, 'created_time': 1774477751.39214, 'last_price_update_time': 1774821965.828644}
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LL16%2520FYY') HTTP/1.1" 204 0
2026-03-29 22:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: adcd49ce-e0fe-5874-8c1b-a8a55d414bd7 with identifier: BG14%20OHU
2026-03-29 22:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: adcd49ce-e0fe-5874-8c1b-a8a55d414bd7 with identifier: BG14%20OHU
2026-03-29 22:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: adcd49ce-e0fe-5874-8c1b-a8a55d414bd7 with identifier: BG14%20OHU to the API
2026-03-29 22:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG14%20OHU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'adcd49ce-e0fe-5874-8c1b-a8a55d414bd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG14 OHU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BG14%20OHU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 120908,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.5 DCI 110 TEKNA Hatchback',
'transmission': 'manual',
'trim': 'DCI 110 TEKNA',
'vin': 'SJNFAAJ11U1106884',
'year': 2014}
2026-03-29 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG14%2520OHU%27 HTTP/1.1" 200 None
2026-03-29 22:06:06 [bca.uk] INFO: Saving data for BG14%20OHU: {'auction_closing_time': 1774864800.0, 'created_time': 1774621511.709352, 'last_price_update_time': 1774821966.172141}
2026-03-29 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BG14%2520OHU') HTTP/1.1" 204 0
2026-03-29 22:06:06 [bca.uk] INFO: Found listing with ID: BF12%20MYT
2026-03-29 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF12%2520MYT%27 HTTP/1.1" 200 None
2026-03-29 22:06:06 [bca.uk] INFO: Scrape type for BF12%20MYT: 2
2026-03-29 22:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be3301d1-7f13-5013-82e2-ed3f1a597939 with identifier: BF12%20MYT
2026-03-29 22:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be3301d1-7f13-5013-82e2-ed3f1a597939 with scrape type 2
2026-03-29 22:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be3301d1-7f13-5013-82e2-ed3f1a597939 with scrape type 2
2026-03-29 22:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: be3301d1-7f13-5013-82e2-ed3f1a597939, identifier: BF12%20MYT
2026-03-29 22:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 75379e98-ec74-5bb8-a2ba-dee078101af0 with identifier: FV59%20NFX
2026-03-29 22:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 75379e98-ec74-5bb8-a2ba-dee078101af0 with identifier: FV59%20NFX
2026-03-29 22:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 75379e98-ec74-5bb8-a2ba-dee078101af0 with identifier: FV59%20NFX to the API
2026-03-29 22:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453604/600>
{'auction_title': '',
'c_o_2_emission_value': 141,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_expert_report_file_1cbf0aec-d833-4759-a6c3-18c7af7232d2.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FV59%20NFX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': '75379e98-ec74-5bb8-a2ba-dee078101af0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FV59 NFX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FV59%20NFX&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'PEUGEOT',
'model': '207',
'odometer': 105522,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43186,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453601/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42588,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453602/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39690,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453604/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40522,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453606/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37536,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453607/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35841,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453609/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90841,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453612/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75824,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453615/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77175,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453618/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75379e98-ec74-5bb8-a2ba-dee078101af0/75379e98-ec74-5bb8-a2ba-dee078101af0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72308,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV59NFX/699453622/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'PEUGEOT 207 1.6 VTI 120 SPORT Hatchback',
'transmission': 'manual',
'trim': 'VTI 120 SPORT',
'vin': 'VF3WA5FS09E094930',
'year': 2009}
2026-03-29 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV59%2520NFX%27 HTTP/1.1" 200 None
2026-03-29 22:06:06 [bca.uk] INFO: Saving data for FV59%20NFX: {'created_time': 1774821966.645437, 'last_price_update_time': 1774821966.645448, 'auction_closing_time': 1775210400.0}
2026-03-29 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FV59%2520NFX') HTTP/1.1" 204 0
2026-03-29 22:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3909531a-470f-5688-8297-acd46a9f879d with identifier: SV14%20TTZ
2026-03-29 22:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3909531a-470f-5688-8297-acd46a9f879d with identifier: SV14%20TTZ
2026-03-29 22:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3909531a-470f-5688-8297-acd46a9f879d with identifier: SV14%20TTZ to the API
2026-03-29 22:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457962/600>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_expert_report_file_4129792f-b8fa-44f1-83b0-0b75e5d6367f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV14%20TTZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3909531a-470f-5688-8297-acd46a9f879d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV14 TTZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV14%20TTZ&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MAZDA',
'model': '6 TOURER',
'odometer': 91227,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43766,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457959/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42994,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457962/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41827,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457966/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42390,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457969/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36465,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457975/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35296,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457978/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82583,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457986/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64242,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699457995/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80648,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699458005/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3909531a-470f-5688-8297-acd46a9f879d/3909531a-470f-5688-8297-acd46a9f879d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74504,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV14TTZ/699458013/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MAZDA 6 TOURER 2.0 145 SE-L Estate',
'transmission': 'manual',
'trim': '145 SE-L',
'vin': 'JMZGJ596611162765',
'year': 2014}
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV14%2520TTZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:07 [bca.uk] INFO: Saving data for SV14%20TTZ: {'created_time': 1774821967.127387, 'last_price_update_time': 1774821967.127398, 'auction_closing_time': 1775210400.0}
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV14%2520TTZ') HTTP/1.1" 204 0
2026-03-29 22:06:07 [bca.uk] INFO: Found listing with ID: MV65%20CCA
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV65%2520CCA%27 HTTP/1.1" 200 None
2026-03-29 22:06:07 [bca.uk] INFO: Scrape type for MV65%20CCA: 2
2026-03-29 22:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 419fcf8a-2034-51e6-b754-37b9a8107691 with identifier: MV65%20CCA
2026-03-29 22:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 419fcf8a-2034-51e6-b754-37b9a8107691 with scrape type 2
2026-03-29 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 419fcf8a-2034-51e6-b754-37b9a8107691 with scrape type 2
2026-03-29 22:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 419fcf8a-2034-51e6-b754-37b9a8107691, identifier: MV65%20CCA
2026-03-29 22:06:07 [bca.uk] INFO: Found listing with ID: BL12%20HFK
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL12%2520HFK%27 HTTP/1.1" 200 None
2026-03-29 22:06:07 [bca.uk] INFO: Scrape type for BL12%20HFK: 0
2026-03-29 22:06:07 [bca.uk] INFO: Found listing with ID: EK63%20FTA
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520FTA%27 HTTP/1.1" 200 None
2026-03-29 22:06:07 [bca.uk] INFO: Scrape type for EK63%20FTA: 2
2026-03-29 22:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f3242ee-badd-5243-9618-1a2a403b68bc with identifier: EK63%20FTA
2026-03-29 22:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f3242ee-badd-5243-9618-1a2a403b68bc with scrape type 2
2026-03-29 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f3242ee-badd-5243-9618-1a2a403b68bc with scrape type 2
2026-03-29 22:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0f3242ee-badd-5243-9618-1a2a403b68bc, identifier: EK63%20FTA
2026-03-29 22:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: be3301d1-7f13-5013-82e2-ed3f1a597939 with identifier: BF12%20MYT
2026-03-29 22:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: be3301d1-7f13-5013-82e2-ed3f1a597939 with identifier: BF12%20MYT
2026-03-29 22:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: be3301d1-7f13-5013-82e2-ed3f1a597939 with identifier: BF12%20MYT to the API
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BF12%20MYT-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'be3301d1-7f13-5013-82e2-ed3f1a597939',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BF12 MYT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BF12%20MYT&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 75528,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 16V SE Hatchback',
'transmission': 'manual',
'trim': '16V SE',
'vin': 'W0L0SDL68C4133567',
'year': 2012}
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF12%2520MYT%27 HTTP/1.1" 200 None
2026-03-29 22:06:07 [bca.uk] INFO: Saving data for BF12%20MYT: {'auction_closing_time': 1774864800.0, 'created_time': 1774735389.966115, 'last_price_update_time': 1774821967.696056}
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BF12%2520MYT') HTTP/1.1" 204 0
2026-03-29 22:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61bc6390>
2026-03-29 22:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV68URC%252F699387071%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387071/600 saved to cache
2026-03-29 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c423af70-863f-544f-981f-966354022060
2026-03-29 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620bae90>
2026-03-29 22:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT66YMF%252F699414993%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414993/600 saved to cache
2026-03-29 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5cb9c1b-2fac-5aa0-89c7-e23c2249811e
2026-03-29 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615efb10>
2026-03-29 22:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ62YDS%252F699456057%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456057/600 saved to cache
2026-03-29 22:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e23ce11-f3f0-5635-b5b9-03f2e6272954
2026-03-29 22:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248718/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH67HFC/42809726?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=aLVrPpUXrfB1VZ7O0yZYRHCjncC2Uv1YIx3J5LA4O1w%3D)
2026-03-29 22:06:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387062/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387062>
2026-03-29 22:06:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248711/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699248711>
2026-03-29 22:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 419fcf8a-2034-51e6-b754-37b9a8107691 with identifier: MV65%20CCA
2026-03-29 22:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 419fcf8a-2034-51e6-b754-37b9a8107691 with identifier: MV65%20CCA
2026-03-29 22:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 419fcf8a-2034-51e6-b754-37b9a8107691 with identifier: MV65%20CCA to the API
2026-03-29 22:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 95,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MV65%20CCA-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '419fcf8a-2034-51e6-b754-37b9a8107691',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MV65 CCA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MV65%20CCA&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 110242,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.6 BLUEHDI 100 ALLURE MPV',
'transmission': 'manual',
'trim': 'BLUEHDI 100 ALLURE',
'vin': 'VF3CUBHY6FY085961',
'year': 2015}
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV65%2520CCA%27 HTTP/1.1" 200 None
2026-03-29 22:06:08 [bca.uk] INFO: Saving data for MV65%20CCA: {'auction_closing_time': 1774864800.0, 'created_time': 1774477705.948592, 'last_price_update_time': 1774821968.176862}
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MV65%2520CCA') HTTP/1.1" 204 0
2026-03-29 22:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0f3242ee-badd-5243-9618-1a2a403b68bc with identifier: EK63%20FTA
2026-03-29 22:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0f3242ee-badd-5243-9618-1a2a403b68bc with identifier: EK63%20FTA
2026-03-29 22:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0f3242ee-badd-5243-9618-1a2a403b68bc with identifier: EK63%20FTA to the API
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK63%20FTA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0f3242ee-badd-5243-9618-1a2a403b68bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EK63 FTA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EK63%20FTA&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 101706,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.4 I-VTEC SE Hatchback',
'transmission': 'manual',
'trim': 'I-VTEC SE',
'vin': 'SHHFK1740DU005427',
'year': 2013}
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520FTA%27 HTTP/1.1" 200 None
2026-03-29 22:06:08 [bca.uk] INFO: Saving data for EK63%20FTA: {'auction_closing_time': 1774864800.0, 'created_time': 1774735366.182169, 'last_price_update_time': 1774821968.473146}
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EK63%2520FTA') HTTP/1.1" 204 0
2026-03-29 22:06:08 [bca.uk] INFO: Found listing with ID: EA62%20XPM
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA62%2520XPM%27 HTTP/1.1" 200 None
2026-03-29 22:06:08 [bca.uk] INFO: Scrape type for EA62%20XPM: 0
2026-03-29 22:06:08 [bca.uk] INFO: Found listing with ID: FE14%20AVW
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE14%2520AVW%27 HTTP/1.1" 200 None
2026-03-29 22:06:08 [bca.uk] INFO: Scrape type for FE14%20AVW: 2
2026-03-29 22:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b235e50-3e0e-57b8-82d8-92073950f59f with identifier: FE14%20AVW
2026-03-29 22:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b235e50-3e0e-57b8-82d8-92073950f59f with scrape type 2
2026-03-29 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b235e50-3e0e-57b8-82d8-92073950f59f with scrape type 2
2026-03-29 22:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2b235e50-3e0e-57b8-82d8-92073950f59f, identifier: FE14%20AVW
2026-03-29 22:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456037/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN62HLC/42810081?sv=2020-08-04&st=2026-03-29T22%3A05%3A15Z&se=2026-03-29T22%3A30%3A15Z&sr=b&sp=r&sig=7S8WdQ3gHe92IypMlrTOVxGXU1Uqv27G6oYLRI%2FeI0k%3D)
2026-03-29 22:06:08 [bca.uk] INFO: Found listing with ID: PE16%20VRM
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE16%2520VRM%27 HTTP/1.1" 200 None
2026-03-29 22:06:08 [bca.uk] INFO: Scrape type for PE16%20VRM: 0
2026-03-29 22:06:08 [bca.uk] INFO: Found listing with ID: FG66%20KHH
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG66%2520KHH%27 HTTP/1.1" 200 None
2026-03-29 22:06:08 [bca.uk] INFO: Scrape type for FG66%20KHH: 0
2026-03-29 22:06:08 [bca.uk] INFO: Found listing with ID: FP11%20OHH
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP11%2520OHH%27 HTTP/1.1" 200 None
2026-03-29 22:06:08 [bca.uk] INFO: Scrape type for FP11%20OHH: 2
2026-03-29 22:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9153a9c4-5990-5981-85ad-c93a9119ac4b with identifier: FP11%20OHH
2026-03-29 22:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9153a9c4-5990-5981-85ad-c93a9119ac4b with scrape type 2
2026-03-29 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9153a9c4-5990-5981-85ad-c93a9119ac4b with scrape type 2
2026-03-29 22:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9153a9c4-5990-5981-85ad-c93a9119ac4b, identifier: FP11%20OHH
2026-03-29 22:06:08 [bca.uk] INFO: Found listing with ID: EO61%20TBV
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO61%2520TBV%27 HTTP/1.1" 200 None
2026-03-29 22:06:08 [bca.uk] INFO: Scrape type for EO61%20TBV: 0
2026-03-29 22:06:08 [bca.uk] INFO: Found listing with ID: FT61%20VUR
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT61%2520VUR%27 HTTP/1.1" 200 None
2026-03-29 22:06:08 [bca.uk] INFO: Scrape type for FT61%20VUR: 2
2026-03-29 22:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a45df846-9de9-5dca-bfcb-dcf57dc2b59b with identifier: FT61%20VUR
2026-03-29 22:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a45df846-9de9-5dca-bfcb-dcf57dc2b59b with scrape type 2
2026-03-29 22:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a45df846-9de9-5dca-bfcb-dcf57dc2b59b with scrape type 2
2026-03-29 22:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a45df846-9de9-5dca-bfcb-dcf57dc2b59b, identifier: FT61%20VUR
2026-03-29 22:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2b235e50-3e0e-57b8-82d8-92073950f59f with identifier: FE14%20AVW
2026-03-29 22:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2b235e50-3e0e-57b8-82d8-92073950f59f with identifier: FE14%20AVW
2026-03-29 22:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2b235e50-3e0e-57b8-82d8-92073950f59f with identifier: FE14%20AVW to the API
2026-03-29 22:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE14%20AVW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2b235e50-3e0e-57b8-82d8-92073950f59f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FE14 AVW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FE14%20AVW&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 116643,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 ZETEC',
'vin': 'WF0KXXGCBKEL72438',
'year': 2014}
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE14%2520AVW%27 HTTP/1.1" 200 None
2026-03-29 22:06:09 [bca.uk] INFO: Saving data for FE14%20AVW: {'auction_closing_time': 1774864800.0, 'created_time': 1774621482.547477, 'last_price_update_time': 1774821969.160474}
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FE14%2520AVW') HTTP/1.1" 204 0
2026-03-29 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414945/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT66YMF/42812098?sv=2020-08-04&st=2026-03-29T22%3A05%3A18Z&se=2026-03-29T22%3A30%3A18Z&sr=b&sp=r&sig=vvtbY7lfWyfzUXxJcw4PY0HqZZ37wGJm65zbIBo7KHs%3D)
2026-03-29 22:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087856/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BP65JXL/42808111?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=NuWfvCjhCnPVyKXKJ4JcyeNaRmV90x6ROfl09hllUPs%3D)
2026-03-29 22:06:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414918/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414918>
2026-03-29 22:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9153a9c4-5990-5981-85ad-c93a9119ac4b with identifier: FP11%20OHH
2026-03-29 22:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9153a9c4-5990-5981-85ad-c93a9119ac4b with identifier: FP11%20OHH
2026-03-29 22:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9153a9c4-5990-5981-85ad-c93a9119ac4b with identifier: FP11%20OHH to the API
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 93,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FP11%20OHH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '9153a9c4-5990-5981-85ad-c93a9119ac4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FP11 OHH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FP11%20OHH&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'TOYOTA',
'model': 'AURIS',
'odometer': 172111,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'TOYOTA AURIS 1.8 VVTI HYBRID T SPIRIT Hatchback',
'transmission': 'automatic',
'trim': 'VVTI HYBRID T SPIRIT',
'vin': 'SB1KS56E00E035079',
'year': 2011}
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP11%2520OHH%27 HTTP/1.1" 200 None
2026-03-29 22:06:09 [bca.uk] INFO: Saving data for FP11%20OHH: {'auction_closing_time': 1774864800.0, 'created_time': 1774735338.133718, 'last_price_update_time': 1774821969.488044}
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FP11%2520OHH') HTTP/1.1" 204 0
2026-03-29 22:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a45df846-9de9-5dca-bfcb-dcf57dc2b59b with identifier: FT61%20VUR
2026-03-29 22:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a45df846-9de9-5dca-bfcb-dcf57dc2b59b with identifier: FT61%20VUR
2026-03-29 22:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a45df846-9de9-5dca-bfcb-dcf57dc2b59b with identifier: FT61%20VUR to the API
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FT61%20VUR-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a45df846-9de9-5dca-bfcb-dcf57dc2b59b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FT61 VUR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FT61%20VUR&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'AUDI',
'model': 'A4 AVANT',
'odometer': 146097,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'AUDI A4 AVANT 2.0 TDI 143 SE M-T Estate',
'transmission': 'manual',
'trim': 'TDI 143 SE M-T',
'vin': 'WAUZZZ8K5DA004856',
'year': 2012}
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT61%2520VUR%27 HTTP/1.1" 200 None
2026-03-29 22:06:09 [bca.uk] INFO: Saving data for FT61%20VUR: {'auction_closing_time': 1774864800.0, 'created_time': 1774735367.385299, 'last_price_update_time': 1774821969.786145}
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FT61%2520VUR') HTTP/1.1" 204 0
2026-03-29 22:06:09 [bca.uk] INFO: Found listing with ID: MT07%20FBY
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT07%2520FBY%27 HTTP/1.1" 200 None
2026-03-29 22:06:09 [bca.uk] INFO: Scrape type for MT07%20FBY: 2
2026-03-29 22:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5efd40b-81d0-5f93-9693-58ba123af3be with identifier: MT07%20FBY
2026-03-29 22:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5efd40b-81d0-5f93-9693-58ba123af3be with scrape type 2
2026-03-29 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5efd40b-81d0-5f93-9693-58ba123af3be with scrape type 2
2026-03-29 22:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b5efd40b-81d0-5f93-9693-58ba123af3be, identifier: MT07%20FBY
2026-03-29 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c1e2d0>
2026-03-29 22:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT14HGA%252F699399600%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399600/600 saved to cache
2026-03-29 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2
2026-03-29 22:06:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2, skipping ID generation
2026-03-29 22:06:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2 sending to next pipeline
2026-03-29 22:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2, identifier: LT14%20HGA
2026-03-29 22:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c08850>
2026-03-29 22:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP15SYH%252F699089061%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089061/600 saved to cache
2026-03-29 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7722f27f-140c-5241-909a-6e6aa692732b
2026-03-29 22:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c0c510>
2026-03-29 22:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV68URC%252F699387065%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387065/600 saved to cache
2026-03-29 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c423af70-863f-544f-981f-966354022060
2026-03-29 22:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c1be90>
2026-03-29 22:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP65JXL%252F699087892%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087892/600 saved to cache
2026-03-29 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4
2026-03-29 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456032/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456032>
2026-03-29 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456054/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456054>
2026-03-29 22:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089053/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CP15SYH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456055/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ62YDS/42810080?sv=2020-08-04&st=2026-03-29T22%3A05%3A13Z&se=2026-03-29T22%3A30%3A13Z&sr=b&sp=r&sig=3uF2r926LhFkKPoPLSCohRVnNGX4IbgEWDcBb0D1E%2B8%3D)
2026-03-29 22:06:10 [bca.uk] INFO: Found listing with ID: GJ11%20JRU
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ11%2520JRU%27 HTTP/1.1" 200 None
2026-03-29 22:06:10 [bca.uk] INFO: Scrape type for GJ11%20JRU: 0
2026-03-29 22:06:10 [bca.uk] INFO: Found listing with ID: GU12%20NFM
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU12%2520NFM%27 HTTP/1.1" 200 None
2026-03-29 22:06:10 [bca.uk] INFO: Scrape type for GU12%20NFM: 0
2026-03-29 22:06:10 [bca.uk] INFO: Found listing with ID: GU59%20RWV
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU59%2520RWV%27 HTTP/1.1" 200 None
2026-03-29 22:06:10 [bca.uk] INFO: Scrape type for GU59%20RWV: 2
2026-03-29 22:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ad8d91f-b311-579f-a1af-d991c2e4de78 with identifier: GU59%20RWV
2026-03-29 22:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ad8d91f-b311-579f-a1af-d991c2e4de78 with scrape type 2
2026-03-29 22:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ad8d91f-b311-579f-a1af-d991c2e4de78 with scrape type 2
2026-03-29 22:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1ad8d91f-b311-579f-a1af-d991c2e4de78, identifier: GU59%20RWV
2026-03-29 22:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b5efd40b-81d0-5f93-9693-58ba123af3be with identifier: MT07%20FBY
2026-03-29 22:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b5efd40b-81d0-5f93-9693-58ba123af3be with identifier: MT07%20FBY
2026-03-29 22:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b5efd40b-81d0-5f93-9693-58ba123af3be with identifier: MT07%20FBY to the API
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT07%20FBY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b5efd40b-81d0-5f93-9693-58ba123af3be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT07 FBY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT07%20FBY&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 140738,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.4 I-DSI SE I-SHIFT Hatchback',
'transmission': 'automatic',
'trim': 'I-DSI SE I-SHIFT',
'vin': 'SHHFK18407U013324',
'year': 2007}
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT07%2520FBY%27 HTTP/1.1" 200 None
2026-03-29 22:06:10 [bca.uk] INFO: Saving data for MT07%20FBY: {'auction_closing_time': 1774864800.0, 'created_time': 1774735377.253475, 'last_price_update_time': 1774821970.618456}
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT07%2520FBY') HTTP/1.1" 204 0
2026-03-29 22:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2 with identifier: LT14%20HGA
2026-03-29 22:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2 with identifier: LT14%20HGA
2026-03-29 22:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2 with identifier: LT14%20HGA to the API
2026-03-29 22:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399600/600>
{'auction_title': '',
'c_o_2_emission_value': 198,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_expert_report_file_df0334cc-b623-4b04-80e6-ee0b5839dcb3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT14%20HGA-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT14 HGA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT14%20HGA&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'VIVARO 2.7T',
'odometer': 95693,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43303,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399586/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43176,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399587/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39727,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399588/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38186,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399590/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37005,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399591/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399592/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69642,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399594/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53221,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399598/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76622,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399599/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2/b0dcfaba-8c06-5ef2-b029-2ff11f5b53f2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58439,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT14HGA/699399600/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL VIVARO 2.7T 2.0 CDTI 115 SWB SPORTIVE PanelVan',
'transmission': 'manual',
'trim': 'CDTI 115 SWB SPORTIVE',
'vin': 'W0LF7A1A1EV617060',
'year': 2014}
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT14%2520HGA%27 HTTP/1.1" 200 None
2026-03-29 22:06:11 [bca.uk] INFO: Saving data for LT14%20HGA: {'created_time': 1774821971.15066, 'last_price_update_time': 1774821971.150671, 'auction_closing_time': 1775124000.0}
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT14%2520HGA') HTTP/1.1" 204 0
2026-03-29 22:06:11 [scrapy.extensions.logstats] INFO: Crawled 148 pages (at 14 pages/min), scraped 368 items (at 93 items/min)
2026-03-29 22:06:11 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-29 22:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1ad8d91f-b311-579f-a1af-d991c2e4de78 with identifier: GU59%20RWV
2026-03-29 22:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1ad8d91f-b311-579f-a1af-d991c2e4de78 with identifier: GU59%20RWV
2026-03-29 22:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1ad8d91f-b311-579f-a1af-d991c2e4de78 with identifier: GU59%20RWV to the API
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU59%20RWV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1ad8d91f-b311-579f-a1af-d991c2e4de78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU59 RWV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU59%20RWV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 76415,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.4 LIFE Hatchback',
'transmission': 'manual',
'trim': 'LIFE',
'vin': 'W0L0AHL48A8006280',
'year': 2009}
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU59%2520RWV%27 HTTP/1.1" 200 None
2026-03-29 22:06:11 [bca.uk] INFO: Saving data for GU59%20RWV: {'auction_closing_time': 1774864800.0, 'created_time': 1774621543.978848, 'last_price_update_time': 1774821971.468051}
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU59%2520RWV') HTTP/1.1" 204 0
2026-03-29 22:06:11 [bca.uk] INFO: Found listing with ID: NX63%20FVZ
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX63%2520FVZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:11 [bca.uk] INFO: Scrape type for NX63%20FVZ: 0
2026-03-29 22:06:11 [bca.uk] INFO: Found listing with ID: PE59%20LYK
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE59%2520LYK%27 HTTP/1.1" 200 None
2026-03-29 22:06:11 [bca.uk] INFO: Scrape type for PE59%20LYK: 2
2026-03-29 22:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b47f1f94-f045-5f47-ba01-e11d6a69034f with identifier: PE59%20LYK
2026-03-29 22:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b47f1f94-f045-5f47-ba01-e11d6a69034f with scrape type 2
2026-03-29 22:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b47f1f94-f045-5f47-ba01-e11d6a69034f with scrape type 2
2026-03-29 22:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b47f1f94-f045-5f47-ba01-e11d6a69034f, identifier: PE59%20LYK
2026-03-29 22:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a2b8d0>
2026-03-29 22:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH67HFC%252F699248718%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248718/600 saved to cache
2026-03-29 22:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6836e689-948e-59c9-ae88-0dac50e055fe
2026-03-29 22:06:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:06:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:06:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac637d1150>
2026-03-29 22:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN62HLC%252F699456037%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456037/600 saved to cache
2026-03-29 22:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38dd9604-9daa-5b5e-902e-c598576d19d6
2026-03-29 22:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089057/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP15SYH/42806364?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Rd4qYDMjPlPfw1eY2qRBNLd1xHPVQnmq6D8gIEro12k%3D)
2026-03-29 22:06:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414901/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414901>
2026-03-29 22:06:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387055/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MV68URC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:06:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YH67HFC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:06:11 [bca.uk] INFO: Found listing with ID: LX14%20YNM
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX14%2520YNM%27 HTTP/1.1" 200 None
2026-03-29 22:06:11 [bca.uk] INFO: Scrape type for LX14%20YNM: 2
2026-03-29 22:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcb438d4-a794-57c3-893d-53a7efa952ba with identifier: LX14%20YNM
2026-03-29 22:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb438d4-a794-57c3-893d-53a7efa952ba with scrape type 2
2026-03-29 22:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcb438d4-a794-57c3-893d-53a7efa952ba with scrape type 2
2026-03-29 22:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dcb438d4-a794-57c3-893d-53a7efa952ba, identifier: LX14%20YNM
2026-03-29 22:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b47f1f94-f045-5f47-ba01-e11d6a69034f with identifier: PE59%20LYK
2026-03-29 22:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b47f1f94-f045-5f47-ba01-e11d6a69034f with identifier: PE59%20LYK
2026-03-29 22:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b47f1f94-f045-5f47-ba01-e11d6a69034f with identifier: PE59%20LYK to the API
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PE59%20LYK-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b47f1f94-f045-5f47-ba01-e11d6a69034f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PE59 LYK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PE59%20LYK&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FIAT',
'model': '500',
'odometer': 93581,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 POP Hatchback',
'transmission': 'manual',
'trim': 'POP',
'vin': 'ZFA31200000434286',
'year': 2009}
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE59%2520LYK%27 HTTP/1.1" 200 None
2026-03-29 22:06:12 [bca.uk] INFO: Saving data for PE59%20LYK: {'auction_closing_time': 1774864800.0, 'created_time': 1774621482.029546, 'last_price_update_time': 1774821972.082643}
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PE59%2520LYK') HTTP/1.1" 204 0
2026-03-29 22:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dcb438d4-a794-57c3-893d-53a7efa952ba with identifier: LX14%20YNM
2026-03-29 22:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dcb438d4-a794-57c3-893d-53a7efa952ba with identifier: LX14%20YNM
2026-03-29 22:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dcb438d4-a794-57c3-893d-53a7efa952ba with identifier: LX14%20YNM to the API
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX14%20YNM-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dcb438d4-a794-57c3-893d-53a7efa952ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LX14 YNM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LX14%20YNM&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'KIA',
'model': 'VENGA',
'odometer': 137181,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'KIA VENGA 1.6 2 MPV',
'transmission': 'automatic',
'trim': '2',
'vin': 'U5YEH812MEL077162',
'year': 2014}
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX14%2520YNM%27 HTTP/1.1" 200 None
2026-03-29 22:06:12 [bca.uk] INFO: Saving data for LX14%20YNM: {'auction_closing_time': 1774864800.0, 'created_time': 1774621524.170357, 'last_price_update_time': 1774821972.449732}
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LX14%2520YNM') HTTP/1.1" 204 0
2026-03-29 22:06:12 [bca.uk] INFO: Found listing with ID: SL63%20HWN
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL63%2520HWN%27 HTTP/1.1" 200 None
2026-03-29 22:06:12 [bca.uk] INFO: Scrape type for SL63%20HWN: 0
2026-03-29 22:06:12 [bca.uk] INFO: Found listing with ID: WN18%20XOM
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN18%2520XOM%27 HTTP/1.1" 200 None
2026-03-29 22:06:12 [bca.uk] INFO: Scrape type for WN18%20XOM: 0
2026-03-29 22:06:12 [bca.uk] INFO: Found listing with ID: PF68%20ZTH
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF68%2520ZTH%27 HTTP/1.1" 200 None
2026-03-29 22:06:12 [bca.uk] INFO: Scrape type for PF68%20ZTH: 0
2026-03-29 22:06:12 [bca.uk] INFO: Found listing with ID: OY68%20FWV
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY68%2520FWV%27 HTTP/1.1" 200 None
2026-03-29 22:06:12 [bca.uk] INFO: Scrape type for OY68%20FWV: 2
2026-03-29 22:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b5ca7e9-d25c-5689-b351-05dff35dccfa with identifier: OY68%20FWV
2026-03-29 22:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b5ca7e9-d25c-5689-b351-05dff35dccfa with scrape type 2
2026-03-29 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b5ca7e9-d25c-5689-b351-05dff35dccfa with scrape type 2
2026-03-29 22:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2b5ca7e9-d25c-5689-b351-05dff35dccfa, identifier: OY68%20FWV
2026-03-29 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c497d0>
2026-03-29 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT66YMF%252F699414945%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414945/600 saved to cache
2026-03-29 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5cb9c1b-2fac-5aa0-89c7-e23c2249811e
2026-03-29 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a64f90>
2026-03-29 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBP65JXL%252F699087856%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087856/600 saved to cache
2026-03-29 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4
2026-03-29 22:06:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4, skipping ID generation
2026-03-29 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4 sending to next pipeline
2026-03-29 22:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4, identifier: BP65%20JXL
2026-03-29 22:06:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:06:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61574390>
2026-03-29 22:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ62YDS%252F699456055%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456055/600 saved to cache
2026-03-29 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e23ce11-f3f0-5635-b5b9-03f2e6272954
2026-03-29 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414918/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT66YMF/42812098?sv=2020-08-04&st=2026-03-29T22%3A05%3A18Z&se=2026-03-29T22%3A30%3A18Z&sr=b&sp=r&sig=vvtbY7lfWyfzUXxJcw4PY0HqZZ37wGJm65zbIBo7KHs%3D)
2026-03-29 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248711/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH67HFC/42809726?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=aLVrPpUXrfB1VZ7O0yZYRHCjncC2Uv1YIx3J5LA4O1w%3D)
2026-03-29 22:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456051/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456051>
2026-03-29 22:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387062/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV68URC/42811821?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=UqKQThY1MQH5ObDZI1ey2MVklXRiFzm7WSFSP9Yo17U%3D)
2026-03-29 22:06:12 [bca.uk] INFO: Found listing with ID: OE05%20XXM
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE05%2520XXM%27 HTTP/1.1" 200 None
2026-03-29 22:06:12 [bca.uk] INFO: Scrape type for OE05%20XXM: 2
2026-03-29 22:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f812a82e-f47e-5956-9607-76fa69063190 with identifier: OE05%20XXM
2026-03-29 22:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f812a82e-f47e-5956-9607-76fa69063190 with scrape type 2
2026-03-29 22:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f812a82e-f47e-5956-9607-76fa69063190 with scrape type 2
2026-03-29 22:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f812a82e-f47e-5956-9607-76fa69063190, identifier: OE05%20XXM
2026-03-29 22:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2b5ca7e9-d25c-5689-b351-05dff35dccfa with identifier: OY68%20FWV
2026-03-29 22:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2b5ca7e9-d25c-5689-b351-05dff35dccfa with identifier: OY68%20FWV
2026-03-29 22:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2b5ca7e9-d25c-5689-b351-05dff35dccfa with identifier: OY68%20FWV to the API
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 197,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OY68%20FWV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2b5ca7e9-d25c-5689-b351-05dff35dccfa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OY68 FWV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OY68%20FWV&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'LAND ROVER',
'model': 'DISCOVERY',
'odometer': 68245,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY 2.0 SD4 240 HSE StationWagon',
'transmission': 'automatic',
'trim': 'SD4 240 HSE',
'vin': 'SALRA2AN5KA083764',
'year': 2018}
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY68%2520FWV%27 HTTP/1.1" 200 None
2026-03-29 22:06:13 [bca.uk] INFO: Saving data for OY68%20FWV: {'auction_closing_time': 1774864800.0, 'created_time': 1774621463.820464, 'last_price_update_time': 1774821973.220706}
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OY68%2520FWV') HTTP/1.1" 204 0
2026-03-29 22:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4 with identifier: BP65%20JXL
2026-03-29 22:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4 with identifier: BP65%20JXL
2026-03-29 22:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4 with identifier: BP65%20JXL to the API
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087856/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_expert_report_file_73b9b9be-4412-4fff-9f32-f4a886be9e48.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BP65%20JXL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Electric',
'id': 'e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BP65 JXL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BP65%20JXL&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'TESLA',
'model': 'MODEL S',
'odometer': 196705,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41139,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087856/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39396,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087892/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39209,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087913/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38777,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087938/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34585,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087956/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33133,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087971/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92957,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699087994/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83810,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699088014/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96306,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699088035/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4/e7f8acf1-83c2-563a-90b0-56e2f1b1d2a4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63151,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BP65JXL/699088069/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'TESLA MODEL S 85KWH D/M Hatchback',
'transmission': 'automatic',
'trim': '85KWH D/M',
'vin': '5YJSB7E27FF105473',
'year': 2015}
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP65%2520JXL%27 HTTP/1.1" 200 None
2026-03-29 22:06:13 [bca.uk] INFO: Saving data for BP65%20JXL: {'created_time': 1774821973.58068, 'last_price_update_time': 1774821973.580692, 'auction_closing_time': 1775210400.0}
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BP65%2520JXL') HTTP/1.1" 204 0
2026-03-29 22:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089053/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP15SYH/42806364?sv=2020-08-04&st=2026-03-29T22%3A05%3A24Z&se=2026-03-29T22%3A30%3A24Z&sr=b&sp=r&sig=Rd4qYDMjPlPfw1eY2qRBNLd1xHPVQnmq6D8gIEro12k%3D)
2026-03-29 22:06:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456047/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456047>
2026-03-29 22:06:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456028/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456028>
2026-03-29 22:06:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414868/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414868>
2026-03-29 22:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f812a82e-f47e-5956-9607-76fa69063190 with identifier: OE05%20XXM
2026-03-29 22:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f812a82e-f47e-5956-9607-76fa69063190 with identifier: OE05%20XXM
2026-03-29 22:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f812a82e-f47e-5956-9607-76fa69063190 with identifier: OE05%20XXM to the API
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 271,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OE05%20XXM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f812a82e-f47e-5956-9607-76fa69063190',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OE05 XXM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OE05%20XXM&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 147106,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 2.7 TDV6 HSE StationWagon',
'transmission': 'automatic',
'trim': 'TDV6 HSE',
'vin': 'SALLSAA135A912604',
'year': 2005}
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE05%2520XXM%27 HTTP/1.1" 200 None
2026-03-29 22:06:13 [bca.uk] INFO: Saving data for OE05%20XXM: {'auction_closing_time': 1774864800.0, 'created_time': 1774620766.769035, 'last_price_update_time': 1774821973.875473}
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OE05%2520XXM') HTTP/1.1" 204 0
2026-03-29 22:06:13 [bca.uk] INFO: Found listing with ID: AY64%20SVS
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY64%2520SVS%27 HTTP/1.1" 200 None
2026-03-29 22:06:13 [bca.uk] INFO: Scrape type for AY64%20SVS: 0
2026-03-29 22:06:13 [bca.uk] INFO: Found listing with ID: BA15%20AFX
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BA15%2520AFX%27 HTTP/1.1" 200 None
2026-03-29 22:06:13 [bca.uk] INFO: Scrape type for BA15%20AFX: 0
2026-03-29 22:06:13 [bca.uk] INFO: Found listing with ID: DG15%20ONP
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG15%2520ONP%27 HTTP/1.1" 200 None
2026-03-29 22:06:13 [bca.uk] INFO: Scrape type for DG15%20ONP: 0
2026-03-29 22:06:13 [bca.uk] INFO: Found listing with ID: FL17%20BVP
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL17%2520BVP%27 HTTP/1.1" 200 None
2026-03-29 22:06:13 [bca.uk] INFO: Scrape type for FL17%20BVP: 0
2026-03-29 22:06:13 [bca.uk] INFO: Found listing with ID: KT15%20TFY
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT15%2520TFY%27 HTTP/1.1" 200 None
2026-03-29 22:06:13 [bca.uk] INFO: Scrape type for KT15%20TFY: 2
2026-03-29 22:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32e9bff7-981c-5c2d-bf83-e6a0ea8d0c25 with identifier: KT15%20TFY
2026-03-29 22:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32e9bff7-981c-5c2d-bf83-e6a0ea8d0c25 with scrape type 2
2026-03-29 22:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32e9bff7-981c-5c2d-bf83-e6a0ea8d0c25 with scrape type 2
2026-03-29 22:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 32e9bff7-981c-5c2d-bf83-e6a0ea8d0c25, identifier: KT15%20TFY
2026-03-29 22:06:14 [bca.uk] INFO: Found listing with ID: ST10%20NZU
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST10%2520NZU%27 HTTP/1.1" 200 None
2026-03-29 22:06:14 [bca.uk] INFO: Scrape type for ST10%20NZU: 2
2026-03-29 22:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 834b87d2-3e20-56eb-bc6c-24893d9eeecb with identifier: ST10%20NZU
2026-03-29 22:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 834b87d2-3e20-56eb-bc6c-24893d9eeecb with scrape type 2
2026-03-29 22:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 834b87d2-3e20-56eb-bc6c-24893d9eeecb with scrape type 2
2026-03-29 22:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 834b87d2-3e20-56eb-bc6c-24893d9eeecb, identifier: ST10%20NZU
2026-03-29 22:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 32e9bff7-981c-5c2d-bf83-e6a0ea8d0c25 with identifier: KT15%20TFY
2026-03-29 22:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 32e9bff7-981c-5c2d-bf83-e6a0ea8d0c25 with identifier: KT15%20TFY
2026-03-29 22:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 32e9bff7-981c-5c2d-bf83-e6a0ea8d0c25 with identifier: KT15%20TFY to the API
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 94,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KT15%20TFY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '32e9bff7-981c-5c2d-bf83-e6a0ea8d0c25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KT15 TFY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KT15%20TFY&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'PEUGEOT',
'model': '308',
'odometer': 88267,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.6 BLUEHDI 100 ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'BLUEHDI 100 ACTIVE',
'vin': 'VF3LBBHYBFS139228',
'year': 2015}
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT15%2520TFY%27 HTTP/1.1" 200 None
2026-03-29 22:06:14 [bca.uk] INFO: Saving data for KT15%20TFY: {'auction_closing_time': 1774864800.0, 'created_time': 1774621469.727066, 'last_price_update_time': 1774821974.483448}
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KT15%2520TFY') HTTP/1.1" 204 0
2026-03-29 22:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac632e4090>
2026-03-29 22:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP15SYH%252F699089057%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089057/600 saved to cache
2026-03-29 22:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7722f27f-140c-5241-909a-6e6aa692732b
2026-03-29 22:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456054/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ62YDS/42810080?sv=2020-08-04&st=2026-03-29T22%3A05%3A13Z&se=2026-03-29T22%3A30%3A13Z&sr=b&sp=r&sig=3uF2r926LhFkKPoPLSCohRVnNGX4IbgEWDcBb0D1E%2B8%3D)
2026-03-29 22:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH67HFC/42809726?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=aLVrPpUXrfB1VZ7O0yZYRHCjncC2Uv1YIx3J5LA4O1w%3D)
2026-03-29 22:06:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456018/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456018>
2026-03-29 22:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 834b87d2-3e20-56eb-bc6c-24893d9eeecb with identifier: ST10%20NZU
2026-03-29 22:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 834b87d2-3e20-56eb-bc6c-24893d9eeecb with identifier: ST10%20NZU
2026-03-29 22:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 834b87d2-3e20-56eb-bc6c-24893d9eeecb with identifier: ST10%20NZU to the API
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ST10%20NZU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '834b87d2-3e20-56eb-bc6c-24893d9eeecb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ST10 NZU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ST10%20NZU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'KUGA',
'odometer': 169276,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 2WD TITANIUM StationWagon',
'transmission': 'manual',
'trim': 'TDCI 2WD TITANIUM',
'vin': 'WF0RXXGCDRAT55060',
'year': 2010}
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST10%2520NZU%27 HTTP/1.1" 200 None
2026-03-29 22:06:14 [bca.uk] INFO: Saving data for ST10%20NZU: {'auction_closing_time': 1774864800.0, 'created_time': 1774621524.986112, 'last_price_update_time': 1774821974.928698}
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ST10%2520NZU') HTTP/1.1" 204 0
2026-03-29 22:06:14 [bca.uk] INFO: Found listing with ID: NC54%20LBO
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC54%2520LBO%27 HTTP/1.1" 200 None
2026-03-29 22:06:14 [bca.uk] INFO: Scrape type for NC54%20LBO: 2
2026-03-29 22:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8ebf215-e0de-522f-b9a1-9e723f5474a5 with identifier: NC54%20LBO
2026-03-29 22:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8ebf215-e0de-522f-b9a1-9e723f5474a5 with scrape type 2
2026-03-29 22:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8ebf215-e0de-522f-b9a1-9e723f5474a5 with scrape type 2
2026-03-29 22:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b8ebf215-e0de-522f-b9a1-9e723f5474a5, identifier: NC54%20LBO
2026-03-29 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456032/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN62HLC/42810081?sv=2020-08-04&st=2026-03-29T22%3A05%3A15Z&se=2026-03-29T22%3A30%3A15Z&sr=b&sp=r&sig=7S8WdQ3gHe92IypMlrTOVxGXU1Uqv27G6oYLRI%2FeI0k%3D)
2026-03-29 22:06:15 [bca.uk] INFO: Found listing with ID: PL70%20OLP
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL70%2520OLP%27 HTTP/1.1" 200 None
2026-03-29 22:06:15 [bca.uk] INFO: Scrape type for PL70%20OLP: 2
2026-03-29 22:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f7b21e0-59a7-5686-a122-ac8b5ae9229a with identifier: PL70%20OLP
2026-03-29 22:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f7b21e0-59a7-5686-a122-ac8b5ae9229a with scrape type 2
2026-03-29 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f7b21e0-59a7-5686-a122-ac8b5ae9229a with scrape type 2
2026-03-29 22:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3f7b21e0-59a7-5686-a122-ac8b5ae9229a, identifier: PL70%20OLP
2026-03-29 22:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b8ebf215-e0de-522f-b9a1-9e723f5474a5 with identifier: NC54%20LBO
2026-03-29 22:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b8ebf215-e0de-522f-b9a1-9e723f5474a5 with identifier: NC54%20LBO
2026-03-29 22:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b8ebf215-e0de-522f-b9a1-9e723f5474a5 with identifier: NC54%20LBO to the API
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 161,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NC54%20LBO-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b8ebf215-e0de-522f-b9a1-9e723f5474a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NC54 LBO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NC54%20LBO&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 74481,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 LX Hatchback',
'transmission': 'manual',
'trim': 'LX',
'vin': 'WF05XXGCD54T60198',
'year': 2005}
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC54%2520LBO%27 HTTP/1.1" 200 None
2026-03-29 22:06:15 [bca.uk] INFO: Saving data for NC54%20LBO: {'auction_closing_time': 1774864800.0, 'created_time': 1774535339.160858, 'last_price_update_time': 1774821975.547055}
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NC54%2520LBO') HTTP/1.1" 204 0
2026-03-29 22:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac621a15d0>
2026-03-29 22:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT66YMF%252F699414918%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414918/600 saved to cache
2026-03-29 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5cb9c1b-2fac-5aa0-89c7-e23c2249811e
2026-03-29 22:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6184e850>
2026-03-29 22:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH67HFC%252F699248711%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248711/600 saved to cache
2026-03-29 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6836e689-948e-59c9-ae88-0dac50e055fe
2026-03-29 22:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c687d0>
2026-03-29 22:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV68URC%252F699387062%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387062/600 saved to cache
2026-03-29 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c423af70-863f-544f-981f-966354022060
2026-03-29 22:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636b2050>
2026-03-29 22:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP15SYH%252F699089053%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089053/600 saved to cache
2026-03-29 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7722f27f-140c-5241-909a-6e6aa692732b
2026-03-29 22:06:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7722f27f-140c-5241-909a-6e6aa692732b, skipping ID generation
2026-03-29 22:06:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7722f27f-140c-5241-909a-6e6aa692732b sending to next pipeline
2026-03-29 22:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7722f27f-140c-5241-909a-6e6aa692732b, identifier: CP15%20SYH
2026-03-29 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387055/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV68URC/42811821?sv=2020-08-04&st=2026-03-29T22%3A05%3A23Z&se=2026-03-29T22%3A30%3A23Z&sr=b&sp=r&sig=UqKQThY1MQH5ObDZI1ey2MVklXRiFzm7WSFSP9Yo17U%3D)
2026-03-29 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414901/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT66YMF/42812098?sv=2020-08-04&st=2026-03-29T22%3A05%3A18Z&se=2026-03-29T22%3A30%3A18Z&sr=b&sp=r&sig=vvtbY7lfWyfzUXxJcw4PY0HqZZ37wGJm65zbIBo7KHs%3D)
2026-03-29 22:06:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456017/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456017>
2026-03-29 22:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456051/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ62YDS/42810080?sv=2020-08-04&st=2026-03-29T22%3A05%3A13Z&se=2026-03-29T22%3A30%3A13Z&sr=b&sp=r&sig=3uF2r926LhFkKPoPLSCohRVnNGX4IbgEWDcBb0D1E%2B8%3D)
2026-03-29 22:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3f7b21e0-59a7-5686-a122-ac8b5ae9229a with identifier: PL70%20OLP
2026-03-29 22:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3f7b21e0-59a7-5686-a122-ac8b5ae9229a with identifier: PL70%20OLP
2026-03-29 22:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3f7b21e0-59a7-5686-a122-ac8b5ae9229a with identifier: PL70%20OLP to the API
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PL70%20OLP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3f7b21e0-59a7-5686-a122-ac8b5ae9229a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PL70 OLP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PL70%20OLP&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'E220 D',
'odometer': 32611,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ E220 D 2.0 AMG LINE NIGHT ED.PREM.PLUS 9G Coupe',
'transmission': 'manual',
'trim': 'AMG LINE NIGHT ED.PREM.PLUS 9G',
'vin': 'W1K2383142F157960',
'year': 2021}
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL70%2520OLP%27 HTTP/1.1" 200 None
2026-03-29 22:06:16 [bca.uk] INFO: Saving data for PL70%20OLP: {'auction_closing_time': 1774951200.0, 'created_time': 1774735347.530796, 'last_price_update_time': 1774821976.11459}
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PL70%2520OLP') HTTP/1.1" 204 0
2026-03-29 22:06:16 [bca.uk] INFO: Found listing with ID: PO63%20ERY
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO63%2520ERY%27 HTTP/1.1" 200 None
2026-03-29 22:06:16 [bca.uk] INFO: Scrape type for PO63%20ERY: 0
2026-03-29 22:06:16 [bca.uk] INFO: Found listing with ID: SD61%20OMA
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD61%2520OMA%27 HTTP/1.1" 200 None
2026-03-29 22:06:16 [bca.uk] INFO: Scrape type for SD61%20OMA: 0
2026-03-29 22:06:16 [bca.uk] INFO: Found listing with ID: SK09%20KND
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK09%2520KND%27 HTTP/1.1" 200 None
2026-03-29 22:06:16 [bca.uk] INFO: Scrape type for SK09%20KND: 0
2026-03-29 22:06:16 [bca.uk] INFO: Found listing with ID: ST11%20EOH
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST11%2520EOH%27 HTTP/1.1" 200 None
2026-03-29 22:06:16 [bca.uk] INFO: Scrape type for ST11%20EOH: 0
2026-03-29 22:06:16 [bca.uk] INFO: Found listing with ID: SY59%20TZB
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY59%2520TZB%27 HTTP/1.1" 200 None
2026-03-29 22:06:16 [bca.uk] INFO: Scrape type for SY59%20TZB: 0
2026-03-29 22:06:16 [bca.uk] INFO: Found listing with ID: WK09%20UJC
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK09%2520UJC%27 HTTP/1.1" 200 None
2026-03-29 22:06:16 [bca.uk] INFO: Scrape type for WK09%20UJC: 0
2026-03-29 22:06:16 [bca.uk] INFO: Found listing with ID: YG14%20WCU
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG14%2520WCU%27 HTTP/1.1" 200 None
2026-03-29 22:06:16 [bca.uk] INFO: Scrape type for YG14%20WCU: 0
2026-03-29 22:06:16 [bca.uk] INFO: Found listing with ID: CE10%20VBJ
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE10%2520VBJ%27 HTTP/1.1" 200 None
2026-03-29 22:06:16 [bca.uk] INFO: Scrape type for CE10%20VBJ: 2
2026-03-29 22:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b4d9eb-4fd2-5ae8-9730-2b4c6e9f8e3e with identifier: CE10%20VBJ
2026-03-29 22:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b4d9eb-4fd2-5ae8-9730-2b4c6e9f8e3e with scrape type 2
2026-03-29 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38b4d9eb-4fd2-5ae8-9730-2b4c6e9f8e3e with scrape type 2
2026-03-29 22:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 38b4d9eb-4fd2-5ae8-9730-2b4c6e9f8e3e, identifier: CE10%20VBJ
2026-03-29 22:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7722f27f-140c-5241-909a-6e6aa692732b with identifier: CP15%20SYH
2026-03-29 22:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7722f27f-140c-5241-909a-6e6aa692732b with identifier: CP15%20SYH
2026-03-29 22:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7722f27f-140c-5241-909a-6e6aa692732b with identifier: CP15%20SYH to the API
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089053/600>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_expert_report_file_966127f9-f3fb-4b17-b97b-024cf9e59fae.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CP15%20SYH-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7722f27f-140c-5241-909a-6e6aa692732b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CP15 SYH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CP15%20SYH&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'BMW',
'model': '116D',
'odometer': 87407,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37317,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089053/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39548,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089057/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37291,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089061/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38767,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089063/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34794,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089066/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33258,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089069/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92474,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089077/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88591,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089085/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95964,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089093/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722f27f-140c-5241-909a-6e6aa692732b/7722f27f-140c-5241-909a-6e6aa692732b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92048,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP15SYH/699089099/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'BMW 116D 1.5 SPORT Hatchback',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WBA1V720305C19467',
'year': 2015}
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP15%2520SYH%27 HTTP/1.1" 200 None
2026-03-29 22:06:16 [bca.uk] INFO: Saving data for CP15%20SYH: {'created_time': 1774821976.735766, 'last_price_update_time': 1774821976.735776, 'auction_closing_time': 1775210400.0}
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CP15%2520SYH') HTTP/1.1" 204 0
2026-03-29 22:06:16 [bca.uk] INFO: Found listing with ID: EP18%20LGJ
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP18%2520LGJ%27 HTTP/1.1" 200 None
2026-03-29 22:06:16 [bca.uk] INFO: Scrape type for EP18%20LGJ: 0
2026-03-29 22:06:16 [bca.uk] INFO: Found listing with ID: GK68%20YWC
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK68%2520YWC%27 HTTP/1.1" 200 None
2026-03-29 22:06:16 [bca.uk] INFO: Scrape type for GK68%20YWC: 2
2026-03-29 22:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d139f5a-bacb-53a3-8c07-3e1ff555cc1c with identifier: GK68%20YWC
2026-03-29 22:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d139f5a-bacb-53a3-8c07-3e1ff555cc1c with scrape type 2
2026-03-29 22:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d139f5a-bacb-53a3-8c07-3e1ff555cc1c with scrape type 2
2026-03-29 22:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0d139f5a-bacb-53a3-8c07-3e1ff555cc1c, identifier: GK68%20YWC
2026-03-29 22:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 38b4d9eb-4fd2-5ae8-9730-2b4c6e9f8e3e with identifier: CE10%20VBJ
2026-03-29 22:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 38b4d9eb-4fd2-5ae8-9730-2b4c6e9f8e3e with identifier: CE10%20VBJ
2026-03-29 22:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 38b4d9eb-4fd2-5ae8-9730-2b4c6e9f8e3e with identifier: CE10%20VBJ to the API
2026-03-29 22:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CE10%20VBJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '38b4d9eb-4fd2-5ae8-9730-2b4c6e9f8e3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CE10 VBJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CE10%20VBJ&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 112800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 82 EDGE Hatchback',
'transmission': 'manual',
'trim': '82 EDGE',
'vin': 'WF0GXXGAJGAL62317',
'year': 2010}
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE10%2520VBJ%27 HTTP/1.1" 200 None
2026-03-29 22:06:17 [bca.uk] INFO: Saving data for CE10%20VBJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774447864.409656, 'last_price_update_time': 1774821977.21021}
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CE10%2520VBJ') HTTP/1.1" 204 0
2026-03-29 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c731d0>
2026-03-29 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ62YDS%252F699456054%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456054/600 saved to cache
2026-03-29 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e23ce11-f3f0-5635-b5b9-03f2e6272954
2026-03-29 22:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63331a10>
2026-03-29 22:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH67HFC%252F699248705%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248705/600 saved to cache
2026-03-29 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6836e689-948e-59c9-ae88-0dac50e055fe
2026-03-29 22:06:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6836e689-948e-59c9-ae88-0dac50e055fe, skipping ID generation
2026-03-29 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6836e689-948e-59c9-ae88-0dac50e055fe sending to next pipeline
2026-03-29 22:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6836e689-948e-59c9-ae88-0dac50e055fe, identifier: YH67%20HFC
2026-03-29 22:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414868/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT66YMF/42812098?sv=2020-08-04&st=2026-03-29T22%3A05%3A18Z&se=2026-03-29T22%3A30%3A18Z&sr=b&sp=r&sig=vvtbY7lfWyfzUXxJcw4PY0HqZZ37wGJm65zbIBo7KHs%3D)
2026-03-29 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455914/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455914>
2026-03-29 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456015/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699456015>
2026-03-29 22:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456043/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NJ62YDS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0d139f5a-bacb-53a3-8c07-3e1ff555cc1c with identifier: GK68%20YWC
2026-03-29 22:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0d139f5a-bacb-53a3-8c07-3e1ff555cc1c with identifier: GK68%20YWC
2026-03-29 22:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0d139f5a-bacb-53a3-8c07-3e1ff555cc1c with identifier: GK68%20YWC to the API
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK68%20YWC-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0d139f5a-bacb-53a3-8c07-3e1ff555cc1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK68 YWC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GK68%20YWC&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 81621,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.5 BLUEHDI 130 GT LINE PREM.EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'BLUEHDI 130 GT LINE PREM.EAT8',
'vin': 'VF3MCYHZRJS473475',
'year': 2018}
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK68%2520YWC%27 HTTP/1.1" 200 None
2026-03-29 22:06:17 [bca.uk] INFO: Saving data for GK68%20YWC: {'auction_closing_time': 1774864800.0, 'created_time': 1774621469.279467, 'last_price_update_time': 1774821977.806214}
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GK68%2520YWC') HTTP/1.1" 204 0
2026-03-29 22:06:17 [bca.uk] INFO: Found listing with ID: FE11%20RVF
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE11%2520RVF%27 HTTP/1.1" 200 None
2026-03-29 22:06:17 [bca.uk] INFO: Scrape type for FE11%20RVF: 2
2026-03-29 22:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f95195cb-7767-58a8-9d59-d1ff56b61526 with identifier: FE11%20RVF
2026-03-29 22:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f95195cb-7767-58a8-9d59-d1ff56b61526 with scrape type 2
2026-03-29 22:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f95195cb-7767-58a8-9d59-d1ff56b61526 with scrape type 2
2026-03-29 22:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f95195cb-7767-58a8-9d59-d1ff56b61526, identifier: FE11%20RVF
2026-03-29 22:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6836e689-948e-59c9-ae88-0dac50e055fe with identifier: YH67%20HFC
2026-03-29 22:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6836e689-948e-59c9-ae88-0dac50e055fe with identifier: YH67%20HFC
2026-03-29 22:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6836e689-948e-59c9-ae88-0dac50e055fe with identifier: YH67%20HFC to the API
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248705/600>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_expert_report_file_0c589fdc-2c36-426f-b585-b149f3ff37df.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH67%20HFC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6836e689-948e-59c9-ae88-0dac50e055fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH67 HFC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH67%20HFC&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 67963,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36679,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37511,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248711/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36678,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248718/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35849,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248725/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35010,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248731/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35104,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248736/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88509,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248749/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61228,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248758/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80618,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248774/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6836e689-948e-59c9-ae88-0dac50e055fe/6836e689-948e-59c9-ae88-0dac50e055fe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87093,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH67HFC/699248790/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.5 DCI N-CONNECTA Hatchback',
'transmission': 'manual',
'trim': 'DCI N-CONNECTA',
'vin': 'SJNFCAF15U7366285',
'year': 2017}
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH67%2520HFC%27 HTTP/1.1" 200 None
2026-03-29 22:06:18 [bca.uk] INFO: Saving data for YH67%20HFC: {'created_time': 1774821978.298795, 'last_price_update_time': 1774821978.298806, 'auction_closing_time': 1775210400.0}
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH67%2520HFC') HTTP/1.1" 204 0
2026-03-29 22:06:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:06:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:06:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6223c950>
2026-03-29 22:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN62HLC%252F699456032%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456032/600 saved to cache
2026-03-29 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38dd9604-9daa-5b5e-902e-c598576d19d6
2026-03-29 22:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456018/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN62HLC/42810081?sv=2020-08-04&st=2026-03-29T22%3A05%3A15Z&se=2026-03-29T22%3A30%3A15Z&sr=b&sp=r&sig=7S8WdQ3gHe92IypMlrTOVxGXU1Uqv27G6oYLRI%2FeI0k%3D)
2026-03-29 22:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456047/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ62YDS/42810080?sv=2020-08-04&st=2026-03-29T22%3A05%3A13Z&se=2026-03-29T22%3A30%3A13Z&sr=b&sp=r&sig=3uF2r926LhFkKPoPLSCohRVnNGX4IbgEWDcBb0D1E%2B8%3D)
2026-03-29 22:06:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455911/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699455911>
2026-03-29 22:06:18 [bca.uk] INFO: Found listing with ID: GN18%20FPD
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN18%2520FPD%27 HTTP/1.1" 200 None
2026-03-29 22:06:18 [bca.uk] INFO: Scrape type for GN18%20FPD: 0
2026-03-29 22:06:18 [bca.uk] INFO: Found listing with ID: RJ19%20XHK
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ19%2520XHK%27 HTTP/1.1" 200 None
2026-03-29 22:06:18 [bca.uk] INFO: Scrape type for RJ19%20XHK: 2
2026-03-29 22:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9045f606-46b1-5c59-968e-696f677e2c63 with identifier: RJ19%20XHK
2026-03-29 22:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9045f606-46b1-5c59-968e-696f677e2c63 with scrape type 2
2026-03-29 22:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9045f606-46b1-5c59-968e-696f677e2c63 with scrape type 2
2026-03-29 22:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9045f606-46b1-5c59-968e-696f677e2c63, identifier: RJ19%20XHK
2026-03-29 22:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f95195cb-7767-58a8-9d59-d1ff56b61526 with identifier: FE11%20RVF
2026-03-29 22:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f95195cb-7767-58a8-9d59-d1ff56b61526 with identifier: FE11%20RVF
2026-03-29 22:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f95195cb-7767-58a8-9d59-d1ff56b61526 with identifier: FE11%20RVF to the API
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE11%20RVF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f95195cb-7767-58a8-9d59-d1ff56b61526',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FE11 RVF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FE11%20RVF&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'VAUXHALL',
'model': 'ZAFIRA',
'odometer': 118581,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'VAUXHALL ZAFIRA 1.7 CDTI 110 E/F EXCLUSIV MPV',
'transmission': 'manual',
'trim': 'CDTI 110 E/F EXCLUSIV',
'vin': 'W0L0AHM75B2079751',
'year': 2011}
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE11%2520RVF%27 HTTP/1.1" 200 None
2026-03-29 22:06:18 [bca.uk] INFO: Saving data for FE11%20RVF: {'auction_closing_time': 1774864800.0, 'created_time': 1774621437.345064, 'last_price_update_time': 1774821978.779748}
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FE11%2520RVF') HTTP/1.1" 204 0
2026-03-29 22:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456028/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN62HLC/42810081?sv=2020-08-04&st=2026-03-29T22%3A05%3A15Z&se=2026-03-29T22%3A30%3A15Z&sr=b&sp=r&sig=7S8WdQ3gHe92IypMlrTOVxGXU1Uqv27G6oYLRI%2FeI0k%3D)
2026-03-29 22:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9045f606-46b1-5c59-968e-696f677e2c63 with identifier: RJ19%20XHK
2026-03-29 22:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9045f606-46b1-5c59-968e-696f677e2c63 with identifier: RJ19%20XHK
2026-03-29 22:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9045f606-46b1-5c59-968e-696f677e2c63 with identifier: RJ19%20XHK to the API
2026-03-29 22:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 121,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RJ19%20XHK-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9045f606-46b1-5c59-968e-696f677e2c63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RJ19 XHK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RJ19%20XHK&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FOCUS VIGNALE',
'odometer': 89725,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FOCUS VIGNALE 2.0 EBL 150 P/S Hatchback',
'transmission': 'automatic',
'trim': 'EBL 150 P/S',
'vin': 'WF0NXXGCHNJG14011',
'year': 2019}
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ19%2520XHK%27 HTTP/1.1" 200 None
2026-03-29 22:06:19 [bca.uk] INFO: Saving data for RJ19%20XHK: {'auction_closing_time': 1774864800.0, 'created_time': 1774389725.916148, 'last_price_update_time': 1774821979.179009}
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RJ19%2520XHK') HTTP/1.1" 204 0
2026-03-29 22:06:19 [bca.uk] INFO: Found listing with ID: FY59%20UVB
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY59%2520UVB%27 HTTP/1.1" 200 None
2026-03-29 22:06:19 [bca.uk] INFO: Scrape type for FY59%20UVB: 0
2026-03-29 22:06:19 [bca.uk] INFO: Found listing with ID: FY59%20ZGR
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY59%2520ZGR%27 HTTP/1.1" 200 None
2026-03-29 22:06:19 [bca.uk] INFO: Scrape type for FY59%20ZGR: 2
2026-03-29 22:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 994ee2aa-d7d8-57e5-82bc-bebcf132587c with identifier: FY59%20ZGR
2026-03-29 22:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 994ee2aa-d7d8-57e5-82bc-bebcf132587c with scrape type 2
2026-03-29 22:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 994ee2aa-d7d8-57e5-82bc-bebcf132587c with scrape type 2
2026-03-29 22:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 994ee2aa-d7d8-57e5-82bc-bebcf132587c, identifier: FY59%20ZGR
2026-03-29 22:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69ae4990>
2026-03-29 22:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV68URC%252F699387055%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387055/600 saved to cache
2026-03-29 22:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c423af70-863f-544f-981f-966354022060
2026-03-29 22:06:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c423af70-863f-544f-981f-966354022060, skipping ID generation
2026-03-29 22:06:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c423af70-863f-544f-981f-966354022060 sending to next pipeline
2026-03-29 22:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c423af70-863f-544f-981f-966354022060, identifier: MV68%20URC
2026-03-29 22:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6223e810>
2026-03-29 22:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT66YMF%252F699414901%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414901/600 saved to cache
2026-03-29 22:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5cb9c1b-2fac-5aa0-89c7-e23c2249811e
2026-03-29 22:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6156b610>
2026-03-29 22:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ62YDS%252F699456051%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456051/600 saved to cache
2026-03-29 22:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e23ce11-f3f0-5635-b5b9-03f2e6272954
2026-03-29 22:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456017/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN62HLC/42810081?sv=2020-08-04&st=2026-03-29T22%3A05%3A15Z&se=2026-03-29T22%3A30%3A15Z&sr=b&sp=r&sig=7S8WdQ3gHe92IypMlrTOVxGXU1Uqv27G6oYLRI%2FeI0k%3D)
2026-03-29 22:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456008/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LN62HLC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:06:19 [bca.uk] INFO: Found listing with ID: ML19%20YFV
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML19%2520YFV%27 HTTP/1.1" 200 None
2026-03-29 22:06:19 [bca.uk] INFO: Scrape type for ML19%20YFV: 2
2026-03-29 22:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82f1ca74-f3e3-557a-9800-72143e39903a with identifier: ML19%20YFV
2026-03-29 22:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82f1ca74-f3e3-557a-9800-72143e39903a with scrape type 2
2026-03-29 22:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82f1ca74-f3e3-557a-9800-72143e39903a with scrape type 2
2026-03-29 22:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 82f1ca74-f3e3-557a-9800-72143e39903a, identifier: ML19%20YFV
2026-03-29 22:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 994ee2aa-d7d8-57e5-82bc-bebcf132587c with identifier: FY59%20ZGR
2026-03-29 22:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 994ee2aa-d7d8-57e5-82bc-bebcf132587c with identifier: FY59%20ZGR
2026-03-29 22:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 994ee2aa-d7d8-57e5-82bc-bebcf132587c with identifier: FY59%20ZGR to the API
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 224,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY59%20ZGR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '994ee2aa-d7d8-57e5-82bc-bebcf132587c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY59 ZGR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FY59%20ZGR&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'VOLVO',
'model': 'XC90',
'odometer': 131970,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VOLVO XC90 2.4 D5 185 SE LUX PREMIUM G/T Estate',
'transmission': 'manual',
'trim': 'D5 185 SE LUX PREMIUM G/T',
'vin': 'YV1CZ7146A1544030',
'year': 2009}
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY59%2520ZGR%27 HTTP/1.1" 200 None
2026-03-29 22:06:19 [bca.uk] INFO: Saving data for FY59%20ZGR: {'auction_closing_time': 1774864800.0, 'created_time': 1774621431.194581, 'last_price_update_time': 1774821979.932631}
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FY59%2520ZGR') HTTP/1.1" 204 0
2026-03-29 22:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c423af70-863f-544f-981f-966354022060 with identifier: MV68%20URC
2026-03-29 22:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c423af70-863f-544f-981f-966354022060 with identifier: MV68%20URC
2026-03-29 22:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c423af70-863f-544f-981f-966354022060 with identifier: MV68%20URC to the API
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387055/600>
{'auction_title': '',
'c_o_2_emission_value': 102,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_expert_report_file_8c5e0b4a-daa3-40cf-817e-0c2effcae48b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MV68%20URC-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c423af70-863f-544f-981f-966354022060',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MV68 URC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MV68%20URC&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SEAT',
'model': 'MII',
'odometer': 35447,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36045,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387055/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36179,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387062/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35711,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387065/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36788,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387071/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35596,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387082/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34056,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387090/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86010,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387104/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63116,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387115/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81193,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387126/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c423af70-863f-544f-981f-966354022060/c423af70-863f-544f-981f-966354022060_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71059,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV68URC/699387138/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'SEAT MII 1.0 DESIGN MII Hatchback',
'transmission': 'manual',
'trim': 'DESIGN MII',
'vin': 'VSSZZZAAZJD311957',
'year': 2018}
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV68%2520URC%27 HTTP/1.1" 200 None
2026-03-29 22:06:20 [bca.uk] INFO: Saving data for MV68%20URC: {'created_time': 1774821980.372697, 'last_price_update_time': 1774821980.372707, 'auction_closing_time': 1775210400.0}
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MV68%2520URC') HTTP/1.1" 204 0
2026-03-29 22:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 82f1ca74-f3e3-557a-9800-72143e39903a with identifier: ML19%20YFV
2026-03-29 22:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 82f1ca74-f3e3-557a-9800-72143e39903a with identifier: ML19%20YFV
2026-03-29 22:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 82f1ca74-f3e3-557a-9800-72143e39903a with identifier: ML19%20YFV to the API
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML19%20YFV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '82f1ca74-f3e3-557a-9800-72143e39903a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML19 YFV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML19%20YFV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 16032,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 EVO 80 SE Hatchback',
'transmission': 'manual',
'trim': 'EVO 80 SE',
'vin': 'WVWZZZAWZKU049432',
'year': 2019}
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML19%2520YFV%27 HTTP/1.1" 200 None
2026-03-29 22:06:20 [bca.uk] INFO: Saving data for ML19%20YFV: {'auction_closing_time': 1774951200.0, 'created_time': 1774735318.410419, 'last_price_update_time': 1774821980.670854}
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML19%2520YFV') HTTP/1.1" 204 0
2026-03-29 22:06:20 [bca.uk] INFO: Found listing with ID: KU58%20EZM
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU58%2520EZM%27 HTTP/1.1" 200 None
2026-03-29 22:06:20 [bca.uk] INFO: Scrape type for KU58%20EZM: 0
2026-03-29 22:06:20 [bca.uk] INFO: Found listing with ID: NU15%20KYB
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU15%2520KYB%27 HTTP/1.1" 200 None
2026-03-29 22:06:20 [bca.uk] INFO: Scrape type for NU15%20KYB: 2
2026-03-29 22:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 369089c8-ce8b-5bd9-8bd3-48bf4792158c with identifier: NU15%20KYB
2026-03-29 22:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 369089c8-ce8b-5bd9-8bd3-48bf4792158c with scrape type 2
2026-03-29 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 369089c8-ce8b-5bd9-8bd3-48bf4792158c with scrape type 2
2026-03-29 22:06:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 369089c8-ce8b-5bd9-8bd3-48bf4792158c, identifier: NU15%20KYB
2026-03-29 22:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6104ee10>
2026-03-29 22:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT66YMF%252F699414868%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414868/600 saved to cache
2026-03-29 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5cb9c1b-2fac-5aa0-89c7-e23c2249811e
2026-03-29 22:06:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5cb9c1b-2fac-5aa0-89c7-e23c2249811e, skipping ID generation
2026-03-29 22:06:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5cb9c1b-2fac-5aa0-89c7-e23c2249811e sending to next pipeline
2026-03-29 22:06:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a5cb9c1b-2fac-5aa0-89c7-e23c2249811e, identifier: YT66%20YMF
2026-03-29 22:06:20 [bca.uk] INFO: Total items found: 100
2026-03-29 22:06:20 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded
2026-03-29 22:06:20 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:06:20 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c5c650>
2026-03-29 22:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN62HLC%252F699456018%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456018/600 saved to cache
2026-03-29 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38dd9604-9daa-5b5e-902e-c598576d19d6
2026-03-29 22:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac635f5350>
2026-03-29 22:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ62YDS%252F699456047%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456047/600 saved to cache
2026-03-29 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e23ce11-f3f0-5635-b5b9-03f2e6272954
2026-03-29 22:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456043/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ62YDS/42810080?sv=2020-08-04&st=2026-03-29T22%3A05%3A13Z&se=2026-03-29T22%3A30%3A13Z&sr=b&sp=r&sig=3uF2r926LhFkKPoPLSCohRVnNGX4IbgEWDcBb0D1E%2B8%3D)
2026-03-29 22:06:21 [bca.uk] INFO: Found listing with ID: AE20%20NXF
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE20%2520NXF%27 HTTP/1.1" 200 None
2026-03-29 22:06:21 [bca.uk] INFO: Scrape type for AE20%20NXF: 2
2026-03-29 22:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40869bfc-8bb4-569d-b730-83efe1f5fcf1 with identifier: AE20%20NXF
2026-03-29 22:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40869bfc-8bb4-569d-b730-83efe1f5fcf1 with scrape type 2
2026-03-29 22:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40869bfc-8bb4-569d-b730-83efe1f5fcf1 with scrape type 2
2026-03-29 22:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 40869bfc-8bb4-569d-b730-83efe1f5fcf1, identifier: AE20%20NXF
2026-03-29 22:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 369089c8-ce8b-5bd9-8bd3-48bf4792158c with identifier: NU15%20KYB
2026-03-29 22:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 369089c8-ce8b-5bd9-8bd3-48bf4792158c with identifier: NU15%20KYB
2026-03-29 22:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 369089c8-ce8b-5bd9-8bd3-48bf4792158c with identifier: NU15%20KYB to the API
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NU15%20KYB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '369089c8-ce8b-5bd9-8bd3-48bf4792158c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NU15 KYB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NU15%20KYB&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 58116,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.2 ACENTA Hatchback',
'transmission': 'manual',
'trim': 'ACENTA',
'vin': 'MDHFBUK13U0800409',
'year': 2015}
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU15%2520KYB%27 HTTP/1.1" 200 None
2026-03-29 22:06:21 [bca.uk] INFO: Saving data for NU15%20KYB: {'auction_closing_time': 1774864800.0, 'created_time': 1774620769.323915, 'last_price_update_time': 1774821981.536863}
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NU15%2520KYB') HTTP/1.1" 204 0
2026-03-29 22:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a5cb9c1b-2fac-5aa0-89c7-e23c2249811e with identifier: YT66%20YMF
2026-03-29 22:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a5cb9c1b-2fac-5aa0-89c7-e23c2249811e with identifier: YT66%20YMF
2026-03-29 22:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a5cb9c1b-2fac-5aa0-89c7-e23c2249811e with identifier: YT66%20YMF to the API
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414868/600>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_expert_report_file_839d07dd-43de-410b-bc32-c59e9e66624c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YT66%20YMF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a5cb9c1b-2fac-5aa0-89c7-e23c2249811e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YT66 YMF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YT66%20YMF&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'ADAM',
'odometer': 47130,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38456,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414847/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37869,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414868/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38150,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414882/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38776,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414901/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34070,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414918/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33120,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414945/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100553,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699414993/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67949,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699415019/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94393,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699415047/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5cb9c1b-2fac-5aa0-89c7-e23c2249811e/a5cb9c1b-2fac-5aa0-89c7-e23c2249811e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94634,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT66YMF/699415080/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL ADAM 1.2 VVT 70 ENERGISED Hatchback',
'transmission': 'manual',
'trim': 'VVT 70 ENERGISED',
'vin': 'W0L0MAP08G6098746',
'year': 2016}
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT66%2520YMF%27 HTTP/1.1" 200 None
2026-03-29 22:06:21 [bca.uk] INFO: Saving data for YT66%20YMF: {'created_time': 1774821981.98109, 'last_price_update_time': 1774821981.981103, 'auction_closing_time': 1775210400.0}
2026-03-29 22:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YT66%2520YMF') HTTP/1.1" 204 0
2026-03-29 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61bc4690>
2026-03-29 22:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN62HLC%252F699456028%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456028/600 saved to cache
2026-03-29 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38dd9604-9daa-5b5e-902e-c598576d19d6
2026-03-29 22:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456015/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN62HLC/42810081?sv=2020-08-04&st=2026-03-29T22%3A05%3A15Z&se=2026-03-29T22%3A30%3A15Z&sr=b&sp=r&sig=7S8WdQ3gHe92IypMlrTOVxGXU1Uqv27G6oYLRI%2FeI0k%3D)
2026-03-29 22:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 40869bfc-8bb4-569d-b730-83efe1f5fcf1 with identifier: AE20%20NXF
2026-03-29 22:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 40869bfc-8bb4-569d-b730-83efe1f5fcf1 with identifier: AE20%20NXF
2026-03-29 22:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 40869bfc-8bb4-569d-b730-83efe1f5fcf1 with identifier: AE20%20NXF to the API
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 182,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE20%20NXF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '40869bfc-8bb4-569d-b730-83efe1f5fcf1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE20 NXF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AE20%20NXF&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'JAGUAR',
'model': 'F-PACE',
'odometer': 50746,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'JAGUAR F-PACE 2.0 D 180 AWD R SPORT StationWagon',
'transmission': 'automatic',
'trim': 'D 180 AWD R SPORT',
'vin': 'SADCA2AN2LA654520',
'year': 2020}
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE20%2520NXF%27 HTTP/1.1" 200 None
2026-03-29 22:06:22 [bca.uk] INFO: Saving data for AE20%20NXF: {'auction_closing_time': 1774951200.0, 'created_time': 1774735350.788818, 'last_price_update_time': 1774821982.362549}
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AE20%2520NXF') HTTP/1.1" 204 0
2026-03-29 22:06:22 [bca.uk] INFO: Found listing with ID: SD62%20CKY
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD62%2520CKY%27 HTTP/1.1" 200 None
2026-03-29 22:06:22 [bca.uk] INFO: Scrape type for SD62%20CKY: 2
2026-03-29 22:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76787fe3-4391-5024-a08c-71c8eb6f7576 with identifier: SD62%20CKY
2026-03-29 22:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76787fe3-4391-5024-a08c-71c8eb6f7576 with scrape type 2
2026-03-29 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76787fe3-4391-5024-a08c-71c8eb6f7576 with scrape type 2
2026-03-29 22:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 76787fe3-4391-5024-a08c-71c8eb6f7576, identifier: SD62%20CKY
2026-03-29 22:06:22 [bca.uk] INFO: Found listing with ID: MK63%20AXR
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK63%2520AXR%27 HTTP/1.1" 200 None
2026-03-29 22:06:22 [bca.uk] INFO: Scrape type for MK63%20AXR: 0
2026-03-29 22:06:22 [bca.uk] INFO: Found listing with ID: MV06%20EOF
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV06%2520EOF%27 HTTP/1.1" 200 None
2026-03-29 22:06:22 [bca.uk] INFO: Scrape type for MV06%20EOF: 0
2026-03-29 22:06:22 [bca.uk] INFO: Found listing with ID: RO60%20MKV
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO60%2520MKV%27 HTTP/1.1" 200 None
2026-03-29 22:06:22 [bca.uk] INFO: Scrape type for RO60%20MKV: 0
2026-03-29 22:06:22 [bca.uk] INFO: Found listing with ID: OU10%20XUH
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU10%2520XUH%27 HTTP/1.1" 200 None
2026-03-29 22:06:22 [bca.uk] INFO: Scrape type for OU10%20XUH: 0
2026-03-29 22:06:22 [bca.uk] INFO: Found listing with ID: PN13%20GPF
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN13%2520GPF%27 HTTP/1.1" 200 None
2026-03-29 22:06:22 [bca.uk] INFO: Scrape type for PN13%20GPF: 0
2026-03-29 22:06:22 [bca.uk] INFO: Found listing with ID: RJ14%20CFF
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ14%2520CFF%27 HTTP/1.1" 200 None
2026-03-29 22:06:22 [bca.uk] INFO: Scrape type for RJ14%20CFF: 0
2026-03-29 22:06:22 [bca.uk] INFO: Found listing with ID: RJ61%20OHF
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ61%2520OHF%27 HTTP/1.1" 200 None
2026-03-29 22:06:22 [bca.uk] INFO: Scrape type for RJ61%20OHF: 0
2026-03-29 22:06:22 [bca.uk] INFO: Found listing with ID: RV59%20FHW
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV59%2520FHW%27 HTTP/1.1" 200 None
2026-03-29 22:06:22 [bca.uk] INFO: Scrape type for RV59%20FHW: 0
2026-03-29 22:06:22 [bca.uk] INFO: Found listing with ID: SH59%20HJU
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH59%2520HJU%27 HTTP/1.1" 200 None
2026-03-29 22:06:22 [bca.uk] INFO: Scrape type for SH59%20HJU: 0
2026-03-29 22:06:22 [bca.uk] INFO: Found listing with ID: VF14%20EFD
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF14%2520EFD%27 HTTP/1.1" 200 None
2026-03-29 22:06:22 [bca.uk] INFO: Scrape type for VF14%20EFD: 2
2026-03-29 22:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 388c926a-00d1-58d1-bc40-16691468694a with identifier: VF14%20EFD
2026-03-29 22:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 388c926a-00d1-58d1-bc40-16691468694a with scrape type 2
2026-03-29 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 388c926a-00d1-58d1-bc40-16691468694a with scrape type 2
2026-03-29 22:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 388c926a-00d1-58d1-bc40-16691468694a, identifier: VF14%20EFD
2026-03-29 22:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455914/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE14PLV/42810074?sv=2020-08-04&st=2026-03-29T22%3A05%3A09Z&se=2026-03-29T22%3A30%3A09Z&sr=b&sp=r&sig=541MdBEqN2lGTdrVQerWTQ4Lv%2BWExd94C%2FkstcmEUVg%3D)
2026-03-29 22:06:22 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:06:22 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:06:22 [bca.uk] INFO: Found listing with ID: GJ21%20YWB
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ21%2520YWB%27 HTTP/1.1" 200 None
2026-03-29 22:06:22 [bca.uk] INFO: Scrape type for GJ21%20YWB: 2
2026-03-29 22:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02c9a210-8239-5652-942c-af89b324b768 with identifier: GJ21%20YWB
2026-03-29 22:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02c9a210-8239-5652-942c-af89b324b768 with scrape type 2
2026-03-29 22:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02c9a210-8239-5652-942c-af89b324b768 with scrape type 2
2026-03-29 22:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 02c9a210-8239-5652-942c-af89b324b768, identifier: GJ21%20YWB
2026-03-29 22:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 76787fe3-4391-5024-a08c-71c8eb6f7576 with identifier: SD62%20CKY
2026-03-29 22:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 76787fe3-4391-5024-a08c-71c8eb6f7576 with identifier: SD62%20CKY
2026-03-29 22:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 76787fe3-4391-5024-a08c-71c8eb6f7576 with identifier: SD62%20CKY to the API
2026-03-29 22:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD62%20CKY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '76787fe3-4391-5024-a08c-71c8eb6f7576',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SD62 CKY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SD62%20CKY&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 106616,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 16V 115 ACTIVE Hatchback',
'transmission': 'manual',
'trim': '16V 115 ACTIVE',
'vin': 'W0LPC6ED7CG131716',
'year': 2012}
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD62%2520CKY%27 HTTP/1.1" 200 None
2026-03-29 22:06:23 [bca.uk] INFO: Saving data for SD62%20CKY: {'auction_closing_time': 1774864800.0, 'created_time': 1774621444.460149, 'last_price_update_time': 1774821983.179369}
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SD62%2520CKY') HTTP/1.1" 204 0
2026-03-29 22:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 388c926a-00d1-58d1-bc40-16691468694a with identifier: VF14%20EFD
2026-03-29 22:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 388c926a-00d1-58d1-bc40-16691468694a with identifier: VF14%20EFD
2026-03-29 22:06:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 388c926a-00d1-58d1-bc40-16691468694a with identifier: VF14%20EFD to the API
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VF14%20EFD-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '388c926a-00d1-58d1-bc40-16691468694a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VF14 EFD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VF14%20EFD&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MAZDA',
'model': '6 TOURER',
'odometer': 133647,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MAZDA 6 TOURER 2.2 D 175 SPORT Estate',
'transmission': 'automatic',
'trim': 'D 175 SPORT',
'vin': 'JMZGJ692821156990',
'year': 2014}
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF14%2520EFD%27 HTTP/1.1" 200 None
2026-03-29 22:06:23 [bca.uk] INFO: Saving data for VF14%20EFD: {'auction_closing_time': 1774864800.0, 'created_time': 1774476442.061866, 'last_price_update_time': 1774821983.614981}
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VF14%2520EFD') HTTP/1.1" 204 0
2026-03-29 22:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636633d0>
2026-03-29 22:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN62HLC%252F699456017%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456017/600 saved to cache
2026-03-29 22:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38dd9604-9daa-5b5e-902e-c598576d19d6
2026-03-29 22:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 02c9a210-8239-5652-942c-af89b324b768 with identifier: GJ21%20YWB
2026-03-29 22:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 02c9a210-8239-5652-942c-af89b324b768 with identifier: GJ21%20YWB
2026-03-29 22:06:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 02c9a210-8239-5652-942c-af89b324b768 with identifier: GJ21%20YWB to the API
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ21%20YWB-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '02c9a210-8239-5652-942c-af89b324b768',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ21 YWB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ21%20YWB&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 44935,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'AUDI A3 SPORTBACK 1.5 35 TFSI S LINE S-T Hatchback',
'transmission': 'automatic',
'trim': '35 TFSI S LINE S-T',
'vin': 'WAUZZZGY0MA077493',
'year': 2021}
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ21%2520YWB%27 HTTP/1.1" 200 None
2026-03-29 22:06:23 [bca.uk] INFO: Saving data for GJ21%20YWB: {'auction_closing_time': 1774951200.0, 'created_time': 1774735352.104015, 'last_price_update_time': 1774821983.950497}
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ21%2520YWB') HTTP/1.1" 204 0
2026-03-29 22:06:23 [bca.uk] INFO: Found listing with ID: SG14%20FMC
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG14%2520FMC%27 HTTP/1.1" 200 None
2026-03-29 22:06:23 [bca.uk] INFO: Scrape type for SG14%20FMC: 0
2026-03-29 22:06:23 [bca.uk] INFO: Found listing with ID: YC58%20WGE
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC58%2520WGE%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for YC58%20WGE: 2
2026-03-29 22:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36d656cb-ff36-5e8a-91e4-308d635ca004 with identifier: YC58%20WGE
2026-03-29 22:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36d656cb-ff36-5e8a-91e4-308d635ca004 with scrape type 2
2026-03-29 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36d656cb-ff36-5e8a-91e4-308d635ca004 with scrape type 2
2026-03-29 22:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 36d656cb-ff36-5e8a-91e4-308d635ca004, identifier: YC58%20WGE
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: VN62%20UST
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN62%2520UST%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for VN62%20UST: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: VO14%20ZHE
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO14%2520ZHE%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for VO14%20ZHE: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: WJ13%20VRX
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ13%2520VRX%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for WJ13%20VRX: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: YE62%20YPM
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE62%2520YPM%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for YE62%20YPM: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: YH61%20VSP
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH61%2520VSP%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for YH61%20VSP: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: YJ13%20VUC
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ13%2520VUC%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for YJ13%20VUC: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: YR58%20XNT
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR58%2520XNT%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for YR58%20XNT: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: HV09%20PXZ
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV09%2520PXZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for HV09%20PXZ: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: HV60%20FGZ
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV60%2520FGZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for HV60%20FGZ: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: HV62%20ZWC
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV62%2520ZWC%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for HV62%20ZWC: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: HW13%20FAK
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW13%2520FAK%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for HW13%20FAK: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: KM59%20UED
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM59%2520UED%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for KM59%20UED: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: KN56%20JYW
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN56%2520JYW%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for KN56%20JYW: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: KR09%20EXE
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR09%2520EXE%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for KR09%20EXE: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: LD54%20JZA
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD54%2520JZA%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for LD54%20JZA: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: LG13%20JHF
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG13%2520JHF%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for LG13%20JHF: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: LL10%20FPD
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL10%2520FPD%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for LL10%20FPD: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: LL10%20HMK
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL10%2520HMK%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for LL10%20HMK: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: LL13%20WXE
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL13%2520WXE%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for LL13%20WXE: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: LS14%20LGU
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS14%2520LGU%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for LS14%20LGU: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: MX59%20URP
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX59%2520URP%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for MX59%20URP: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: NX12%20WBL
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX12%2520WBL%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for NX12%20WBL: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: CV62%20BUH
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV62%2520BUH%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for CV62%20BUH: 0
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: DA09%20SGZ
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA09%2520SGZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for DA09%20SGZ: 2
2026-03-29 22:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03375cec-ae52-50a5-bbcf-84ad8ff3430a with identifier: DA09%20SGZ
2026-03-29 22:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03375cec-ae52-50a5-bbcf-84ad8ff3430a with scrape type 2
2026-03-29 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03375cec-ae52-50a5-bbcf-84ad8ff3430a with scrape type 2
2026-03-29 22:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 03375cec-ae52-50a5-bbcf-84ad8ff3430a, identifier: DA09%20SGZ
2026-03-29 22:06:24 [bca.uk] INFO: Found listing with ID: RO22%20KPT
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO22%2520KPT%27 HTTP/1.1" 200 None
2026-03-29 22:06:24 [bca.uk] INFO: Scrape type for RO22%20KPT: 2
2026-03-29 22:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7f8a9fc-307f-5fd9-9f57-53be64230a5a with identifier: RO22%20KPT
2026-03-29 22:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7f8a9fc-307f-5fd9-9f57-53be64230a5a with scrape type 2
2026-03-29 22:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7f8a9fc-307f-5fd9-9f57-53be64230a5a with scrape type 2
2026-03-29 22:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a7f8a9fc-307f-5fd9-9f57-53be64230a5a, identifier: RO22%20KPT
2026-03-29 22:06:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 36d656cb-ff36-5e8a-91e4-308d635ca004 with identifier: YC58%20WGE
2026-03-29 22:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 36d656cb-ff36-5e8a-91e4-308d635ca004 with identifier: YC58%20WGE
2026-03-29 22:06:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 36d656cb-ff36-5e8a-91e4-308d635ca004 with identifier: YC58%20WGE to the API
2026-03-29 22:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC58%20WGE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '36d656cb-ff36-5e8a-91e4-308d635ca004',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC58 WGE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC58%20WGE&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 124817,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 2.2 I-CTDI EX Hatchback',
'transmission': 'manual',
'trim': 'I-CTDI EX',
'vin': 'SHHFK37608U015471',
'year': 2008}
2026-03-29 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC58%2520WGE%27 HTTP/1.1" 200 None
2026-03-29 22:06:25 [bca.uk] INFO: Saving data for YC58%20WGE: {'auction_closing_time': 1774864800.0, 'created_time': 1774621443.590912, 'last_price_update_time': 1774821985.726107}
2026-03-29 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC58%2520WGE') HTTP/1.1" 204 0
2026-03-29 22:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 03375cec-ae52-50a5-bbcf-84ad8ff3430a with identifier: DA09%20SGZ
2026-03-29 22:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 03375cec-ae52-50a5-bbcf-84ad8ff3430a with identifier: DA09%20SGZ
2026-03-29 22:06:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 03375cec-ae52-50a5-bbcf-84ad8ff3430a with identifier: DA09%20SGZ to the API
2026-03-29 22:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA09%20SGZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '03375cec-ae52-50a5-bbcf-84ad8ff3430a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DA09 SGZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DA09%20SGZ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'A170',
'odometer': 65548,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A170 1.7 B/E AVANTGARDE SE Hatchback',
'transmission': 'manual',
'trim': 'B/E AVANTGARDE SE',
'vin': 'WDD1690322J724216',
'year': 2009}
2026-03-29 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA09%2520SGZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:26 [bca.uk] INFO: Saving data for DA09%20SGZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774304103.476787, 'last_price_update_time': 1774821986.830277}
2026-03-29 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DA09%2520SGZ') HTTP/1.1" 204 0
2026-03-29 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61658790>
2026-03-29 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ62YDS%252F699456043%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456043/600 saved to cache
2026-03-29 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e23ce11-f3f0-5635-b5b9-03f2e6272954
2026-03-29 22:06:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e23ce11-f3f0-5635-b5b9-03f2e6272954, skipping ID generation
2026-03-29 22:06:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e23ce11-f3f0-5635-b5b9-03f2e6272954 sending to next pipeline
2026-03-29 22:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9e23ce11-f3f0-5635-b5b9-03f2e6272954, identifier: NJ62%20YDS
2026-03-29 22:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616ad190>
2026-03-29 22:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN62HLC%252F699456015%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456015/600 saved to cache
2026-03-29 22:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38dd9604-9daa-5b5e-902e-c598576d19d6
2026-03-29 22:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a7f8a9fc-307f-5fd9-9f57-53be64230a5a with identifier: RO22%20KPT
2026-03-29 22:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a7f8a9fc-307f-5fd9-9f57-53be64230a5a with identifier: RO22%20KPT
2026-03-29 22:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a7f8a9fc-307f-5fd9-9f57-53be64230a5a with identifier: RO22%20KPT to the API
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO22%20KPT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a7f8a9fc-307f-5fd9-9f57-53be64230a5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RO22 KPT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RO22%20KPT&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'CITROEN',
'model': 'C3',
'odometer': 29444,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'CITROEN C3 1.2 P/T 83 C-SERIES Hatchback',
'transmission': 'manual',
'trim': 'P/T 83 C-SERIES',
'vin': 'VF7SXHMRVNT542533',
'year': 2022}
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO22%2520KPT%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Saving data for RO22%20KPT: {'auction_closing_time': 1774951200.0, 'created_time': 1774735353.359843, 'last_price_update_time': 1774821987.30033}
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RO22%2520KPT') HTTP/1.1" 204 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: YH11%20WZW
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH11%2520WZW%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for YH11%20WZW: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: YP12%20HGG
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP12%2520HGG%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for YP12%20HGG: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: YR60%20FLD
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR60%2520FLD%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for YR60%20FLD: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: YX10%20UNJ
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX10%2520UNJ%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for YX10%20UNJ: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: EN64%20OCP
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN64%2520OCP%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for EN64%20OCP: 2
2026-03-29 22:06:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f0b4346-8a5d-5d78-8080-a2a59518ad3b with identifier: EN64%20OCP
2026-03-29 22:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f0b4346-8a5d-5d78-8080-a2a59518ad3b with scrape type 2
2026-03-29 22:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f0b4346-8a5d-5d78-8080-a2a59518ad3b with scrape type 2
2026-03-29 22:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7f0b4346-8a5d-5d78-8080-a2a59518ad3b, identifier: EN64%20OCP
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: DF10%20BUE
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF10%2520BUE%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for DF10%20BUE: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: EA11%20GDV
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA11%2520GDV%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for EA11%20GDV: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: EA66%20VAF
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA66%2520VAF%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for EA66%20VAF: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: EK61%20OLT
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK61%2520OLT%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for EK61%20OLT: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: EO58%20HTE
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO58%2520HTE%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for EO58%20HTE: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: ET12%20MKU
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET12%2520MKU%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for ET12%20MKU: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: EY10%20WXW
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY10%2520WXW%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for EY10%20WXW: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: FT11%20MSY
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT11%2520MSY%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for FT11%20MSY: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: GF13%20GUG
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF13%2520GUG%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for GF13%20GUG: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: GF61%20DZW
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF61%2520DZW%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for GF61%20DZW: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: GJ60%20HVY
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ60%2520HVY%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for GJ60%20HVY: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: GL08%20TLY
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL08%2520TLY%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for GL08%20TLY: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: HN11%20WRZ
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN11%2520WRZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for HN11%20WRZ: 0
2026-03-29 22:06:27 [bca.uk] INFO: Found listing with ID: HN62%20FLK
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN62%2520FLK%27 HTTP/1.1" 200 None
2026-03-29 22:06:27 [bca.uk] INFO: Scrape type for HN62%20FLK: 2
2026-03-29 22:06:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66a406df-6e58-58e7-8ae0-869245f5a5c5 with identifier: HN62%20FLK
2026-03-29 22:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66a406df-6e58-58e7-8ae0-869245f5a5c5 with scrape type 2
2026-03-29 22:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66a406df-6e58-58e7-8ae0-869245f5a5c5 with scrape type 2
2026-03-29 22:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 66a406df-6e58-58e7-8ae0-869245f5a5c5, identifier: HN62%20FLK
2026-03-29 22:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9e23ce11-f3f0-5635-b5b9-03f2e6272954 with identifier: NJ62%20YDS
2026-03-29 22:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9e23ce11-f3f0-5635-b5b9-03f2e6272954 with identifier: NJ62%20YDS
2026-03-29 22:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9e23ce11-f3f0-5635-b5b9-03f2e6272954 with identifier: NJ62%20YDS to the API
2026-03-29 22:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456043/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_expert_report_file_2b480fa5-f8b1-47cf-89f7-f191d1faf8c9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NJ62%20YDS-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9e23ce11-f3f0-5635-b5b9-03f2e6272954',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NJ62 YDS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NJ62%20YDS&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 96194,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41984,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456043/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40793,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456046/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39751,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456047/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40134,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456049/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38898,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456051/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38371,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456054/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80799,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456055/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66245,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456057/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75859,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456060/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e23ce11-f3f0-5635-b5b9-03f2e6272954/9e23ce11-f3f0-5635-b5b9-03f2e6272954_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87005,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ62YDS/699456064/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 ZETEC',
'vin': 'WF0KXXGCBKCE00482',
'year': 2012}
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ62%2520YDS%27 HTTP/1.1" 200 None
2026-03-29 22:06:28 [bca.uk] INFO: Saving data for NJ62%20YDS: {'created_time': 1774821988.175464, 'last_price_update_time': 1774821988.175474, 'auction_closing_time': 1775210400.0}
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NJ62%2520YDS') HTTP/1.1" 204 0
2026-03-29 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac614b93d0>
2026-03-29 22:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE14PLV%252F699455914%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455914/600 saved to cache
2026-03-29 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1944c0b-6133-542d-8b41-67a9ddd47893
2026-03-29 22:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AP12HDL/42809882?sv=2020-08-04&st=2026-03-29T22%3A06%3A24Z&se=2026-03-29T22%3A31%3A24Z&sr=b&sp=r&sig=DviGem8rLk3txiS7kcWiSVUINF67ojRtTzL1ranpKKA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AP12%20HDL-GB>
2026-03-29 22:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455911/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE14PLV/42810074?sv=2020-08-04&st=2026-03-29T22%3A05%3A09Z&se=2026-03-29T22%3A30%3A09Z&sr=b&sp=r&sig=541MdBEqN2lGTdrVQerWTQ4Lv%2BWExd94C%2FkstcmEUVg%3D)
2026-03-29 22:06:28 [bca.uk] INFO: Found listing with ID: EU05%20FSN
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU05%2520FSN%27 HTTP/1.1" 200 None
2026-03-29 22:06:28 [bca.uk] INFO: Scrape type for EU05%20FSN: 2
2026-03-29 22:06:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60dbac76-bcbf-5733-bcb6-c737b1fd8a76 with identifier: EU05%20FSN
2026-03-29 22:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60dbac76-bcbf-5733-bcb6-c737b1fd8a76 with scrape type 2
2026-03-29 22:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60dbac76-bcbf-5733-bcb6-c737b1fd8a76 with scrape type 2
2026-03-29 22:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 60dbac76-bcbf-5733-bcb6-c737b1fd8a76, identifier: EU05%20FSN
2026-03-29 22:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7f0b4346-8a5d-5d78-8080-a2a59518ad3b with identifier: EN64%20OCP
2026-03-29 22:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7f0b4346-8a5d-5d78-8080-a2a59518ad3b with identifier: EN64%20OCP
2026-03-29 22:06:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7f0b4346-8a5d-5d78-8080-a2a59518ad3b with identifier: EN64%20OCP to the API
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN64%20OCP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7f0b4346-8a5d-5d78-8080-a2a59518ad3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN64 OCP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN64%20OCP&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'HYUNDAI',
'model': 'I30',
'odometer': 80133,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'HYUNDAI I30 1.4 ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'ACTIVE',
'vin': 'TMAD251ALEJ233087',
'year': 2015}
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN64%2520OCP%27 HTTP/1.1" 200 None
2026-03-29 22:06:28 [bca.uk] INFO: Saving data for EN64%20OCP: {'auction_closing_time': 1774864800.0, 'created_time': 1774621392.272524, 'last_price_update_time': 1774821988.712931}
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN64%2520OCP') HTTP/1.1" 204 0
2026-03-29 22:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 66a406df-6e58-58e7-8ae0-869245f5a5c5 with identifier: HN62%20FLK
2026-03-29 22:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 66a406df-6e58-58e7-8ae0-869245f5a5c5 with identifier: HN62%20FLK
2026-03-29 22:06:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 66a406df-6e58-58e7-8ae0-869245f5a5c5 with identifier: HN62%20FLK to the API
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HN62%20FLK-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '66a406df-6e58-58e7-8ae0-869245f5a5c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HN62 FLK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HN62%20FLK&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 71625,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF0KXXGCBKCL29680',
'year': 2012}
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN62%2520FLK%27 HTTP/1.1" 200 None
2026-03-29 22:06:29 [bca.uk] INFO: Saving data for HN62%20FLK: {'auction_closing_time': 1774864800.0, 'created_time': 1774476486.240099, 'last_price_update_time': 1774821989.059857}
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HN62%2520FLK') HTTP/1.1" 204 0
2026-03-29 22:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 60dbac76-bcbf-5733-bcb6-c737b1fd8a76 with identifier: EU05%20FSN
2026-03-29 22:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 60dbac76-bcbf-5733-bcb6-c737b1fd8a76 with identifier: EU05%20FSN
2026-03-29 22:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 60dbac76-bcbf-5733-bcb6-c737b1fd8a76 with identifier: EU05%20FSN to the API
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 435,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EU05%20FSN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '4.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '60dbac76-bcbf-5733-bcb6-c737b1fd8a76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EU05 FSN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EU05%20FSN&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MASERATI',
'model': 'GRANSPORT',
'odometer': 50182,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'MASERATI GRANSPORT 4.2 V8 Coupe',
'transmission': 'automatic',
'trim': 'V8',
'vin': 'ZAMEC38C000017728',
'year': 2005}
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU05%2520FSN%27 HTTP/1.1" 200 None
2026-03-29 22:06:29 [bca.uk] INFO: Saving data for EU05%20FSN: {'auction_closing_time': 1774951200.0, 'created_time': 1774735317.989663, 'last_price_update_time': 1774821989.350627}
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EU05%2520FSN') HTTP/1.1" 204 0
2026-03-29 22:06:29 [bca.uk] INFO: Found listing with ID: LC11%20ZGK
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC11%2520ZGK%27 HTTP/1.1" 200 None
2026-03-29 22:06:29 [bca.uk] INFO: Scrape type for LC11%20ZGK: 2
2026-03-29 22:06:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfcd0d49-94d4-593f-90f6-ffbf103060af with identifier: LC11%20ZGK
2026-03-29 22:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfcd0d49-94d4-593f-90f6-ffbf103060af with scrape type 2
2026-03-29 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfcd0d49-94d4-593f-90f6-ffbf103060af with scrape type 2
2026-03-29 22:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bfcd0d49-94d4-593f-90f6-ffbf103060af, identifier: LC11%20ZGK
2026-03-29 22:06:29 [bca.uk] INFO: Found listing with ID: HV08%20FJE
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV08%2520FJE%27 HTTP/1.1" 200 None
2026-03-29 22:06:29 [bca.uk] INFO: Scrape type for HV08%20FJE: 0
2026-03-29 22:06:29 [bca.uk] INFO: Found listing with ID: AE19%20YAD
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE19%2520YAD%27 HTTP/1.1" 200 None
2026-03-29 22:06:29 [bca.uk] INFO: Scrape type for AE19%20YAD: 0
2026-03-29 22:06:29 [bca.uk] INFO: Found listing with ID: AU10%20YNF
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU10%2520YNF%27 HTTP/1.1" 200 None
2026-03-29 22:06:29 [bca.uk] INFO: Scrape type for AU10%20YNF: 2
2026-03-29 22:06:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df6ca507-d2ba-5bce-9edb-25586e26c86c with identifier: AU10%20YNF
2026-03-29 22:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df6ca507-d2ba-5bce-9edb-25586e26c86c with scrape type 2
2026-03-29 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df6ca507-d2ba-5bce-9edb-25586e26c86c with scrape type 2
2026-03-29 22:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: df6ca507-d2ba-5bce-9edb-25586e26c86c, identifier: AU10%20YNF
2026-03-29 22:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE56AOD/42812125?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=jYNw1fNPOU4PCeqA8yT%2FgW%2F2lYqFTt1ML7YNy%2BQkkpE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE56%20AOD-GB>
2026-03-29 22:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM09CVU/42809722?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=IVQHrCG530q4ZNE7GeniJ3%2F1vLzKHgZru4jgYYDb%2BSY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM09%20CVU-GB>
2026-03-29 22:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP66PGE/42809943?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=WoZ%2FTTd8%2FUTJlWN%2B%2FNq0hoqMOCTHwgwo3OayCCjYYF0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP66%20PGE-GB>
2026-03-29 22:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR60HNV/42810656?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=iTeyX7WgAxvLftpE%2F2dkTmhR4Qwoz4r3xCUieQTYJOM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WR60%20HNV-GB>
2026-03-29 22:06:29 [bca.uk] INFO: Found listing with ID: AF13%20XPW
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF13%2520XPW%27 HTTP/1.1" 200 None
2026-03-29 22:06:29 [bca.uk] INFO: Scrape type for AF13%20XPW: 2
2026-03-29 22:06:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c23f5d21-755d-59bb-a7da-864dc76d3107 with identifier: AF13%20XPW
2026-03-29 22:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c23f5d21-755d-59bb-a7da-864dc76d3107 with scrape type 2
2026-03-29 22:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c23f5d21-755d-59bb-a7da-864dc76d3107 with scrape type 2
2026-03-29 22:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c23f5d21-755d-59bb-a7da-864dc76d3107, identifier: AF13%20XPW
2026-03-29 22:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bfcd0d49-94d4-593f-90f6-ffbf103060af with identifier: LC11%20ZGK
2026-03-29 22:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bfcd0d49-94d4-593f-90f6-ffbf103060af with identifier: LC11%20ZGK
2026-03-29 22:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bfcd0d49-94d4-593f-90f6-ffbf103060af with identifier: LC11%20ZGK to the API
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC11%20ZGK-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bfcd0d49-94d4-593f-90f6-ffbf103060af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC11 ZGK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LC11%20ZGK&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'KIA',
'model': 'RIO',
'odometer': 59715,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'KIA RIO 1.4 2 Hatchback',
'transmission': 'manual',
'trim': '2',
'vin': 'KNADH511LB6805252',
'year': 2011}
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC11%2520ZGK%27 HTTP/1.1" 200 None
2026-03-29 22:06:30 [bca.uk] INFO: Saving data for LC11%20ZGK: {'auction_closing_time': 1774864800.0, 'created_time': 1773933032.204483, 'last_price_update_time': 1774821990.059662}
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LC11%2520ZGK') HTTP/1.1" 204 0
2026-03-29 22:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: df6ca507-d2ba-5bce-9edb-25586e26c86c with identifier: AU10%20YNF
2026-03-29 22:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: df6ca507-d2ba-5bce-9edb-25586e26c86c with identifier: AU10%20YNF
2026-03-29 22:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: df6ca507-d2ba-5bce-9edb-25586e26c86c with identifier: AU10%20YNF to the API
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AU10%20YNF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'df6ca507-d2ba-5bce-9edb-25586e26c86c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AU10 YNF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AU10%20YNF&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 72316,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'TITANIUM',
'vin': 'WF0PXXWPDPAL83514',
'year': 2010}
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU10%2520YNF%27 HTTP/1.1" 200 None
2026-03-29 22:06:30 [bca.uk] INFO: Saving data for AU10%20YNF: {'auction_closing_time': 1774864800.0, 'created_time': 1774216986.428712, 'last_price_update_time': 1774821990.431}
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AU10%2520YNF') HTTP/1.1" 204 0
2026-03-29 22:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ08SVR/42812103?sv=2020-08-04&st=2026-03-29T22%3A06%3A29Z&se=2026-03-29T22%3A31%3A29Z&sr=b&sp=r&sig=MlBD76Nciq6xfGWS8ogzePQWya6I7akYbscBXB2PpJI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ08%20SVR-GB>
2026-03-29 22:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c23f5d21-755d-59bb-a7da-864dc76d3107 with identifier: AF13%20XPW
2026-03-29 22:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c23f5d21-755d-59bb-a7da-864dc76d3107 with identifier: AF13%20XPW
2026-03-29 22:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c23f5d21-755d-59bb-a7da-864dc76d3107 with identifier: AF13%20XPW to the API
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF13%20XPW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c23f5d21-755d-59bb-a7da-864dc76d3107',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF13 XPW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF13%20XPW&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'PEUGEOT',
'model': '308',
'odometer': 42026,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.6 HDI 92 ACCESS Hatchback',
'transmission': 'manual',
'trim': 'HDI 92 ACCESS',
'vin': 'VF34C9HP0DS030256',
'year': 2013}
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF13%2520XPW%27 HTTP/1.1" 200 None
2026-03-29 22:06:30 [bca.uk] INFO: Saving data for AF13%20XPW: {'auction_closing_time': 1774951200.0, 'created_time': 1774735328.378224, 'last_price_update_time': 1774821990.730989}
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF13%2520XPW') HTTP/1.1" 204 0
2026-03-29 22:06:30 [bca.uk] INFO: Found listing with ID: LX58%20WKD
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX58%2520WKD%27 HTTP/1.1" 200 None
2026-03-29 22:06:30 [bca.uk] INFO: Scrape type for LX58%20WKD: 0
2026-03-29 22:06:30 [bca.uk] INFO: Found listing with ID: SJ58%20VYU
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ58%2520VYU%27 HTTP/1.1" 200 None
2026-03-29 22:06:30 [bca.uk] INFO: Scrape type for SJ58%20VYU: 0
2026-03-29 22:06:30 [bca.uk] INFO: Found listing with ID: YK12%20LUP
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK12%2520LUP%27 HTTP/1.1" 200 None
2026-03-29 22:06:30 [bca.uk] INFO: Scrape type for YK12%20LUP: 2
2026-03-29 22:06:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 927dcf7c-8068-5099-8312-bf23933749d3 with identifier: YK12%20LUP
2026-03-29 22:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 927dcf7c-8068-5099-8312-bf23933749d3 with scrape type 2
2026-03-29 22:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 927dcf7c-8068-5099-8312-bf23933749d3 with scrape type 2
2026-03-29 22:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 927dcf7c-8068-5099-8312-bf23933749d3, identifier: YK12%20LUP
2026-03-29 22:06:30 [bca.uk] INFO: Found listing with ID: BJ13%20MVC
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ13%2520MVC%27 HTTP/1.1" 200 None
2026-03-29 22:06:30 [bca.uk] INFO: Scrape type for BJ13%20MVC: 0
2026-03-29 22:06:30 [bca.uk] INFO: Found listing with ID: CP07%20ABX
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP07%2520ABX%27 HTTP/1.1" 200 None
2026-03-29 22:06:30 [bca.uk] INFO: Scrape type for CP07%20ABX: 0
2026-03-29 22:06:30 [bca.uk] INFO: Found listing with ID: CP11%20VEU
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP11%2520VEU%27 HTTP/1.1" 200 None
2026-03-29 22:06:30 [bca.uk] INFO: Scrape type for CP11%20VEU: 0
2026-03-29 22:06:30 [bca.uk] INFO: Found listing with ID: KP23%20AGZ
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP23%2520AGZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:30 [bca.uk] INFO: Scrape type for KP23%20AGZ: 0
2026-03-29 22:06:30 [bca.uk] INFO: Found listing with ID: KM16%20UUA
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM16%2520UUA%27 HTTP/1.1" 200 None
2026-03-29 22:06:30 [bca.uk] INFO: Scrape type for KM16%20UUA: 0
2026-03-29 22:06:30 [bca.uk] INFO: Found listing with ID: LY64%20DTU
2026-03-29 22:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY64%2520DTU%27 HTTP/1.1" 200 None
2026-03-29 22:06:31 [bca.uk] INFO: Scrape type for LY64%20DTU: 2
2026-03-29 22:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 782aa18e-a0c9-5c10-9106-d797127b5b2a with identifier: LY64%20DTU
2026-03-29 22:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 782aa18e-a0c9-5c10-9106-d797127b5b2a with scrape type 2
2026-03-29 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 782aa18e-a0c9-5c10-9106-d797127b5b2a with scrape type 2
2026-03-29 22:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 782aa18e-a0c9-5c10-9106-d797127b5b2a, identifier: LY64%20DTU
2026-03-29 22:06:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:06:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61c70a90>
2026-03-29 22:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE14PLV%252F699455911%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455911/600 saved to cache
2026-03-29 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1944c0b-6133-542d-8b41-67a9ddd47893
2026-03-29 22:06:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1944c0b-6133-542d-8b41-67a9ddd47893, skipping ID generation
2026-03-29 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1944c0b-6133-542d-8b41-67a9ddd47893 sending to next pipeline
2026-03-29 22:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a1944c0b-6133-542d-8b41-67a9ddd47893, identifier: AE14%20PLV
2026-03-29 22:06:31 [bca.uk] INFO: Found listing with ID: LD64%20FZX
2026-03-29 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD64%2520FZX%27 HTTP/1.1" 200 None
2026-03-29 22:06:31 [bca.uk] INFO: Scrape type for LD64%20FZX: 2
2026-03-29 22:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 534d9bbb-c0a6-50f4-bc13-9009bdc08d59 with identifier: LD64%20FZX
2026-03-29 22:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 534d9bbb-c0a6-50f4-bc13-9009bdc08d59 with scrape type 2
2026-03-29 22:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 534d9bbb-c0a6-50f4-bc13-9009bdc08d59 with scrape type 2
2026-03-29 22:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 534d9bbb-c0a6-50f4-bc13-9009bdc08d59, identifier: LD64%20FZX
2026-03-29 22:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 927dcf7c-8068-5099-8312-bf23933749d3 with identifier: YK12%20LUP
2026-03-29 22:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 927dcf7c-8068-5099-8312-bf23933749d3 with identifier: YK12%20LUP
2026-03-29 22:06:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 927dcf7c-8068-5099-8312-bf23933749d3 with identifier: YK12%20LUP to the API
2026-03-29 22:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 122,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK12%20LUP-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '927dcf7c-8068-5099-8312-bf23933749d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK12 LUP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK12%20LUP&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'BMW',
'model': '120D',
'odometer': 106828,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'BMW 120D 2.0 URBAN Hatchback',
'transmission': 'manual',
'trim': 'URBAN',
'vin': 'WBA1C32000E643880',
'year': 2012}
2026-03-29 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK12%2520LUP%27 HTTP/1.1" 200 None
2026-03-29 22:06:31 [bca.uk] INFO: Saving data for YK12%20LUP: {'auction_closing_time': 1774864800.0, 'created_time': 1774735350.413073, 'last_price_update_time': 1774821991.92785}
2026-03-29 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK12%2520LUP') HTTP/1.1" 204 0
2026-03-29 22:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 782aa18e-a0c9-5c10-9106-d797127b5b2a with identifier: LY64%20DTU
2026-03-29 22:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 782aa18e-a0c9-5c10-9106-d797127b5b2a with identifier: LY64%20DTU
2026-03-29 22:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 782aa18e-a0c9-5c10-9106-d797127b5b2a with identifier: LY64%20DTU to the API
2026-03-29 22:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LY64%20DTU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': '782aa18e-a0c9-5c10-9106-d797127b5b2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LY64 DTU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LY64%20DTU&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'LEAF',
'odometer': 60547,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'NISSAN LEAF ACENTA Hatchback',
'transmission': 'automatic',
'trim': 'ACENTA',
'vin': 'SJNFAAZE0U6025533',
'year': 2015}
2026-03-29 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY64%2520DTU%27 HTTP/1.1" 200 None
2026-03-29 22:06:32 [bca.uk] INFO: Saving data for LY64%20DTU: {'auction_closing_time': 1774864800.0, 'created_time': 1774735490.834261, 'last_price_update_time': 1774821992.32066}
2026-03-29 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LY64%2520DTU') HTTP/1.1" 204 0
2026-03-29 22:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a1944c0b-6133-542d-8b41-67a9ddd47893 with identifier: AE14%20PLV
2026-03-29 22:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a1944c0b-6133-542d-8b41-67a9ddd47893 with identifier: AE14%20PLV
2026-03-29 22:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a1944c0b-6133-542d-8b41-67a9ddd47893 with identifier: AE14%20PLV to the API
2026-03-29 22:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455911/600>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_expert_report_file_af75aaa1-2789-494e-b6f7-9ab888b31635.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE14%20PLV-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a1944c0b-6133-542d-8b41-67a9ddd47893',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE14 PLV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AE14%20PLV&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 60082,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55814,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455889/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51256,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455892/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47052,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455895/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50221,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455896/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43383,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455899/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41760,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455900/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87928,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455903/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75386,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455907/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95755,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455911/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1944c0b-6133-542d-8b41-67a9ddd47893/a1944c0b-6133-542d-8b41-67a9ddd47893_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88192,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE14PLV/699455914/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 100 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 ZETEC',
'vin': 'WF0KXXGCBKEL70264',
'year': 2014}
2026-03-29 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE14%2520PLV%27 HTTP/1.1" 200 None
2026-03-29 22:06:32 [bca.uk] INFO: Saving data for AE14%20PLV: {'created_time': 1774821992.713821, 'last_price_update_time': 1774821992.713833, 'auction_closing_time': 1775210400.0}
2026-03-29 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AE14%2520PLV') HTTP/1.1" 204 0
2026-03-29 22:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456008/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LN62HLC/42810081?sv=2020-08-04&st=2026-03-29T22%3A05%3A15Z&se=2026-03-29T22%3A30%3A15Z&sr=b&sp=r&sig=7S8WdQ3gHe92IypMlrTOVxGXU1Uqv27G6oYLRI%2FeI0k%3D)
2026-03-29 22:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PE64HPL/42811907?sv=2020-08-04&st=2026-03-29T22%3A06%3A30Z&se=2026-03-29T22%3A31%3A30Z&sr=b&sp=r&sig=yUL2tjI7FzYjzwTuONvzrvPk31LzZqbGSIyloacYQ9Y%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PE64%20HPL-GB>
2026-03-29 22:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58WVS/42812353?sv=2020-08-04&st=2026-03-29T22%3A06%3A30Z&se=2026-03-29T22%3A31%3A30Z&sr=b&sp=r&sig=pWZ2N0bWTMObAoRbjP9TWlNuhjPjd0jIDle60DPXnFk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MK58%20WVS-GB>
2026-03-29 22:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ME19TFO/42812113?sv=2020-08-04&st=2026-03-29T22%3A06%3A30Z&se=2026-03-29T22%3A31%3A30Z&sr=b&sp=r&sig=qo4Qv0j7A0gY5%2BISw9ChmHumEdIfhGU1Jg2%2Bx25YoDY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ME19%20TFO-GB>
2026-03-29 22:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YO18AYK/42812082?sv=2020-08-04&st=2026-03-29T22%3A06%3A30Z&se=2026-03-29T22%3A31%3A30Z&sr=b&sp=r&sig=mW%2BZyHfYk%2BniOhkqrg7TU8smE93hcHYG75y4iFRpnRE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YO18%20AYK-GB>
2026-03-29 22:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 534d9bbb-c0a6-50f4-bc13-9009bdc08d59 with identifier: LD64%20FZX
2026-03-29 22:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 534d9bbb-c0a6-50f4-bc13-9009bdc08d59 with identifier: LD64%20FZX
2026-03-29 22:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 534d9bbb-c0a6-50f4-bc13-9009bdc08d59 with identifier: LD64%20FZX to the API
2026-03-29 22:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD64%20FZX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '534d9bbb-c0a6-50f4-bc13-9009bdc08d59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD64 FZX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD64%20FZX&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 49641,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.2 TSI 90 SE Hatchback',
'transmission': 'manual',
'trim': 'TSI 90 SE',
'vin': 'WVWZZZ6RZFY147536',
'year': 2014}
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD64%2520FZX%27 HTTP/1.1" 200 None
2026-03-29 22:06:33 [bca.uk] INFO: Saving data for LD64%20FZX: {'auction_closing_time': 1774951200.0, 'created_time': 1774735329.124199, 'last_price_update_time': 1774821993.02547}
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD64%2520FZX') HTTP/1.1" 204 0
2026-03-29 22:06:33 [bca.uk] INFO: Found listing with ID: HJ15%20MKL
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ15%2520MKL%27 HTTP/1.1" 200 None
2026-03-29 22:06:33 [bca.uk] INFO: Scrape type for HJ15%20MKL: 0
2026-03-29 22:06:33 [bca.uk] INFO: Found listing with ID: BG13%20FKD
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG13%2520FKD%27 HTTP/1.1" 200 None
2026-03-29 22:06:33 [bca.uk] INFO: Scrape type for BG13%20FKD: 2
2026-03-29 22:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43f7303a-a2f6-5f86-b81e-26af26f2b888 with identifier: BG13%20FKD
2026-03-29 22:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43f7303a-a2f6-5f86-b81e-26af26f2b888 with scrape type 2
2026-03-29 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43f7303a-a2f6-5f86-b81e-26af26f2b888 with scrape type 2
2026-03-29 22:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 43f7303a-a2f6-5f86-b81e-26af26f2b888, identifier: BG13%20FKD
2026-03-29 22:06:33 [bca.uk] INFO: Found listing with ID: DV14%20VNO
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV14%2520VNO%27 HTTP/1.1" 200 None
2026-03-29 22:06:33 [bca.uk] INFO: Scrape type for DV14%20VNO: 2
2026-03-29 22:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef7b6294-9845-5eb5-8c1d-a1f98760f95e with identifier: DV14%20VNO
2026-03-29 22:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef7b6294-9845-5eb5-8c1d-a1f98760f95e with scrape type 2
2026-03-29 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef7b6294-9845-5eb5-8c1d-a1f98760f95e with scrape type 2
2026-03-29 22:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ef7b6294-9845-5eb5-8c1d-a1f98760f95e, identifier: DV14%20VNO
2026-03-29 22:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX16TWC/42812114?sv=2020-08-04&st=2026-03-29T22%3A06%3A31Z&se=2026-03-29T22%3A31%3A31Z&sr=b&sp=r&sig=8dDQS0bgfhZpjJYewlEoDmja0GKeRZ0n3hJ6pAmfL1w%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PX16%20TWC-GB>
2026-03-29 22:06:33 [bca.uk] INFO: Found listing with ID: YM63%20ETA
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM63%2520ETA%27 HTTP/1.1" 200 None
2026-03-29 22:06:33 [bca.uk] INFO: Scrape type for YM63%20ETA: 2
2026-03-29 22:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 595887ba-7187-5162-8a50-188caa6efdd9 with identifier: YM63%20ETA
2026-03-29 22:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 595887ba-7187-5162-8a50-188caa6efdd9 with scrape type 2
2026-03-29 22:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 595887ba-7187-5162-8a50-188caa6efdd9 with scrape type 2
2026-03-29 22:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 595887ba-7187-5162-8a50-188caa6efdd9, identifier: YM63%20ETA
2026-03-29 22:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 43f7303a-a2f6-5f86-b81e-26af26f2b888 with identifier: BG13%20FKD
2026-03-29 22:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 43f7303a-a2f6-5f86-b81e-26af26f2b888 with identifier: BG13%20FKD
2026-03-29 22:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 43f7303a-a2f6-5f86-b81e-26af26f2b888 with identifier: BG13%20FKD to the API
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG13%20FKD-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '43f7303a-a2f6-5f86-b81e-26af26f2b888',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG13 FKD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BG13%20FKD&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 57560,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 16V SXI Hatchback',
'transmission': 'manual',
'trim': '16V SXI',
'vin': 'W0L0SDL68D4215875',
'year': 2013}
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG13%2520FKD%27 HTTP/1.1" 200 None
2026-03-29 22:06:33 [bca.uk] INFO: Saving data for BG13%20FKD: {'auction_closing_time': 1774864800.0, 'created_time': 1774735352.68995, 'last_price_update_time': 1774821993.695591}
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BG13%2520FKD') HTTP/1.1" 204 0
2026-03-29 22:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ef7b6294-9845-5eb5-8c1d-a1f98760f95e with identifier: DV14%20VNO
2026-03-29 22:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ef7b6294-9845-5eb5-8c1d-a1f98760f95e with identifier: DV14%20VNO
2026-03-29 22:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ef7b6294-9845-5eb5-8c1d-a1f98760f95e with identifier: DV14%20VNO to the API
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DV14%20VNO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ef7b6294-9845-5eb5-8c1d-a1f98760f95e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DV14 VNO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DV14%20VNO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'KA',
'odometer': 75831,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD KA 1.2 METAL S/S Hatchback',
'transmission': 'manual',
'trim': 'METAL S/S',
'vin': 'WF0UXXLTRUEL57243',
'year': 2014}
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV14%2520VNO%27 HTTP/1.1" 200 None
2026-03-29 22:06:33 [bca.uk] INFO: Saving data for DV14%20VNO: {'auction_closing_time': 1774951200.0, 'created_time': 1774735498.076667, 'last_price_update_time': 1774821993.986384}
2026-03-29 22:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DV14%2520VNO') HTTP/1.1" 204 0
2026-03-29 22:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ58SFX/42812168?sv=2020-08-04&st=2026-03-29T22%3A06%3A32Z&se=2026-03-29T22%3A31%3A32Z&sr=b&sp=r&sig=qiTgzjDZ%2FB1Y9Jc9LI61o7EdjHjaU8RNz%2BEzvH34f2o%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NJ58%20SFX-GB>
2026-03-29 22:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 595887ba-7187-5162-8a50-188caa6efdd9 with identifier: YM63%20ETA
2026-03-29 22:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 595887ba-7187-5162-8a50-188caa6efdd9 with identifier: YM63%20ETA
2026-03-29 22:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 595887ba-7187-5162-8a50-188caa6efdd9 with identifier: YM63%20ETA to the API
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM63%20ETA-GB',
'category': 'Car',
'color': 'gold',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '595887ba-7187-5162-8a50-188caa6efdd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YM63 ETA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YM63%20ETA&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLVO',
'model': 'XC70',
'odometer': 39272,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLVO XC70 2.4 D5 215 AWD SE LUX G/T Estate',
'transmission': 'manual',
'trim': 'D5 215 AWD SE LUX G/T',
'vin': 'YV1BZ8256E1187921',
'year': 2014}
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM63%2520ETA%27 HTTP/1.1" 200 None
2026-03-29 22:06:34 [bca.uk] INFO: Saving data for YM63%20ETA: {'auction_closing_time': 1774951200.0, 'created_time': 1774735331.380096, 'last_price_update_time': 1774821994.290249}
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YM63%2520ETA') HTTP/1.1" 204 0
2026-03-29 22:06:34 [bca.uk] INFO: Found listing with ID: DY13%20XDF
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY13%2520XDF%27 HTTP/1.1" 200 None
2026-03-29 22:06:34 [bca.uk] INFO: Scrape type for DY13%20XDF: 2
2026-03-29 22:06:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c155e91-825b-5797-9727-36735366f7f9 with identifier: DY13%20XDF
2026-03-29 22:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c155e91-825b-5797-9727-36735366f7f9 with scrape type 2
2026-03-29 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c155e91-825b-5797-9727-36735366f7f9 with scrape type 2
2026-03-29 22:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6c155e91-825b-5797-9727-36735366f7f9, identifier: DY13%20XDF
2026-03-29 22:06:34 [bca.uk] INFO: Found listing with ID: LM61%20DYD
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM61%2520DYD%27 HTTP/1.1" 200 None
2026-03-29 22:06:34 [bca.uk] INFO: Scrape type for LM61%20DYD: 2
2026-03-29 22:06:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a59b1b92-68f6-5af6-ad88-8517ad8fae07 with identifier: LM61%20DYD
2026-03-29 22:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a59b1b92-68f6-5af6-ad88-8517ad8fae07 with scrape type 2
2026-03-29 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a59b1b92-68f6-5af6-ad88-8517ad8fae07 with scrape type 2
2026-03-29 22:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a59b1b92-68f6-5af6-ad88-8517ad8fae07, identifier: LM61%20DYD
2026-03-29 22:06:34 [bca.uk] INFO: Found listing with ID: CA57%20YVV
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA57%2520YVV%27 HTTP/1.1" 200 None
2026-03-29 22:06:34 [bca.uk] INFO: Scrape type for CA57%20YVV: 2
2026-03-29 22:06:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02 with identifier: CA57%20YVV
2026-03-29 22:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02 with scrape type 2
2026-03-29 22:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02 with scrape type 2
2026-03-29 22:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02, identifier: CA57%20YVV
2026-03-29 22:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6c155e91-825b-5797-9727-36735366f7f9 with identifier: DY13%20XDF
2026-03-29 22:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6c155e91-825b-5797-9727-36735366f7f9 with identifier: DY13%20XDF
2026-03-29 22:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6c155e91-825b-5797-9727-36735366f7f9 with identifier: DY13%20XDF to the API
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DY13%20XDF-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6c155e91-825b-5797-9727-36735366f7f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DY13 XDF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DY13%20XDF&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 114843,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.4 T 16V 140 SRI Hatchback',
'transmission': 'manual',
'trim': 'T 16V 140 SRI',
'vin': 'W0LPF6EC7D8043064',
'year': 2013}
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY13%2520XDF%27 HTTP/1.1" 200 None
2026-03-29 22:06:34 [bca.uk] INFO: Saving data for DY13%20XDF: {'auction_closing_time': 1774864800.0, 'created_time': 1774735326.369403, 'last_price_update_time': 1774821994.945479}
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DY13%2520XDF') HTTP/1.1" 204 0
2026-03-29 22:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a59b1b92-68f6-5af6-ad88-8517ad8fae07 with identifier: LM61%20DYD
2026-03-29 22:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a59b1b92-68f6-5af6-ad88-8517ad8fae07 with identifier: LM61%20DYD
2026-03-29 22:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a59b1b92-68f6-5af6-ad88-8517ad8fae07 with identifier: LM61%20DYD to the API
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM61%20DYD-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a59b1b92-68f6-5af6-ad88-8517ad8fae07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM61 DYD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM61%20DYD&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'S-MAX',
'odometer': 110561,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'FORD S-MAX 1.6 TDCI 115 TITANIUM S/S MPV',
'transmission': 'manual',
'trim': 'TDCI 115 TITANIUM S/S',
'vin': 'WF0SXXGBWSBS47186',
'year': 2011}
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM61%2520DYD%27 HTTP/1.1" 200 None
2026-03-29 22:06:35 [bca.uk] INFO: Saving data for LM61%20DYD: {'auction_closing_time': 1774951200.0, 'created_time': 1774735492.853763, 'last_price_update_time': 1774821995.243681}
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM61%2520DYD') HTTP/1.1" 204 0
2026-03-29 22:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6a61d490>
2026-03-29 22:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLN62HLC%252F699456008%252F600') HTTP/1.1" 204 0
2026-03-29 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456008/600 saved to cache
2026-03-29 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38dd9604-9daa-5b5e-902e-c598576d19d6
2026-03-29 22:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38dd9604-9daa-5b5e-902e-c598576d19d6, skipping ID generation
2026-03-29 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38dd9604-9daa-5b5e-902e-c598576d19d6 sending to next pipeline
2026-03-29 22:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 38dd9604-9daa-5b5e-902e-c598576d19d6, identifier: LN62%20HLC
2026-03-29 22:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02 with identifier: CA57%20YVV
2026-03-29 22:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02 with identifier: CA57%20YVV
2026-03-29 22:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 088c09e3-d7eb-592d-ab1c-79cc7e5bdf02 with identifier: CA57%20YVV to the API
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CA57%20YVV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '088c09e3-d7eb-592d-ab1c-79cc7e5bdf02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CA57 YVV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CA57%20YVV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'PEUGEOT',
'model': '308',
'odometer': 69939,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.6 VTI SPORT Hatchback',
'transmission': 'manual',
'trim': 'VTI SPORT',
'vin': 'VF34C5FWC55030079',
'year': 2008}
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA57%2520YVV%27 HTTP/1.1" 200 None
2026-03-29 22:06:35 [bca.uk] INFO: Saving data for CA57%20YVV: {'auction_closing_time': 1774864800.0, 'created_time': 1774735332.356792, 'last_price_update_time': 1774821995.66031}
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CA57%2520YVV') HTTP/1.1" 204 0
2026-03-29 22:06:35 [bca.uk] INFO: Found listing with ID: SP59%20FDN
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP59%2520FDN%27 HTTP/1.1" 200 None
2026-03-29 22:06:35 [bca.uk] INFO: Scrape type for SP59%20FDN: 2
2026-03-29 22:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3459172-6804-5615-b390-f6fc4febd79c with identifier: SP59%20FDN
2026-03-29 22:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3459172-6804-5615-b390-f6fc4febd79c with scrape type 2
2026-03-29 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3459172-6804-5615-b390-f6fc4febd79c with scrape type 2
2026-03-29 22:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f3459172-6804-5615-b390-f6fc4febd79c, identifier: SP59%20FDN
2026-03-29 22:06:35 [bca.uk] INFO: Found listing with ID: YK11%20VUF
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK11%2520VUF%27 HTTP/1.1" 200 None
2026-03-29 22:06:35 [bca.uk] INFO: Scrape type for YK11%20VUF: 2
2026-03-29 22:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db8298e-1099-5db2-81d1-5141138419a2 with identifier: YK11%20VUF
2026-03-29 22:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db8298e-1099-5db2-81d1-5141138419a2 with scrape type 2
2026-03-29 22:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3db8298e-1099-5db2-81d1-5141138419a2 with scrape type 2
2026-03-29 22:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3db8298e-1099-5db2-81d1-5141138419a2, identifier: YK11%20VUF
2026-03-29 22:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 38dd9604-9daa-5b5e-902e-c598576d19d6 with identifier: LN62%20HLC
2026-03-29 22:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 38dd9604-9daa-5b5e-902e-c598576d19d6 with identifier: LN62%20HLC
2026-03-29 22:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 38dd9604-9daa-5b5e-902e-c598576d19d6 with identifier: LN62%20HLC to the API
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456008/600>
{'auction_title': '',
'c_o_2_emission_value': 168,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_expert_report_file_682dfc28-ff84-41e6-a6a9-1231a097f0b5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LN62%20HLC-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': '38dd9604-9daa-5b5e-902e-c598576d19d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LN62 HLC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LN62%20HLC&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MINI',
'model': 'COUNTRYMAN',
'odometer': 69017,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42013,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456008/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40652,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456010/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36517,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456013/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36741,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456015/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38621,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456017/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37467,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456018/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87885,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456023/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68837,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456028/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87131,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456032/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38dd9604-9daa-5b5e-902e-c598576d19d6/38dd9604-9daa-5b5e-902e-c598576d19d6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89092,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LN62HLC/699456037/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'MINI COUNTRYMAN 1.6 COOPER Hatchback',
'transmission': 'automatic',
'trim': 'COOPER',
'vin': 'WMWZB32090WL94575',
'year': 2012}
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN62%2520HLC%27 HTTP/1.1" 200 None
2026-03-29 22:06:36 [bca.uk] INFO: Saving data for LN62%20HLC: {'created_time': 1774821996.215188, 'last_price_update_time': 1774821996.215197, 'auction_closing_time': 1775210400.0}
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LN62%2520HLC') HTTP/1.1" 204 0
2026-03-29 22:06:36 [bca.uk] INFO: Found listing with ID: EO59%20HAX
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO59%2520HAX%27 HTTP/1.1" 200 None
2026-03-29 22:06:36 [bca.uk] INFO: Scrape type for EO59%20HAX: 2
2026-03-29 22:06:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e935e7df-c51b-5719-9d53-d1e5a270ea84 with identifier: EO59%20HAX
2026-03-29 22:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e935e7df-c51b-5719-9d53-d1e5a270ea84 with scrape type 2
2026-03-29 22:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e935e7df-c51b-5719-9d53-d1e5a270ea84 with scrape type 2
2026-03-29 22:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e935e7df-c51b-5719-9d53-d1e5a270ea84, identifier: EO59%20HAX
2026-03-29 22:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f3459172-6804-5615-b390-f6fc4febd79c with identifier: SP59%20FDN
2026-03-29 22:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f3459172-6804-5615-b390-f6fc4febd79c with identifier: SP59%20FDN
2026-03-29 22:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f3459172-6804-5615-b390-f6fc4febd79c with identifier: SP59%20FDN to the API
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP59%20FDN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f3459172-6804-5615-b390-f6fc4febd79c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP59 FDN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP59%20FDN&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 58928,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'AUDI A3 SPORTBACK 1.8 TFSI SPORT S-T Hatchback',
'transmission': 'automatic',
'trim': 'TFSI SPORT S-T',
'vin': 'WAUZZZ8PXAA044194',
'year': 2009}
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP59%2520FDN%27 HTTP/1.1" 200 None
2026-03-29 22:06:36 [bca.uk] INFO: Saving data for SP59%20FDN: {'auction_closing_time': 1774864800.0, 'created_time': 1774735327.575228, 'last_price_update_time': 1774821996.610913}
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP59%2520FDN') HTTP/1.1" 204 0
2026-03-29 22:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3db8298e-1099-5db2-81d1-5141138419a2 with identifier: YK11%20VUF
2026-03-29 22:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3db8298e-1099-5db2-81d1-5141138419a2 with identifier: YK11%20VUF
2026-03-29 22:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3db8298e-1099-5db2-81d1-5141138419a2 with identifier: YK11%20VUF to the API
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 263,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK11%20VUF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '4.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3db8298e-1099-5db2-81d1-5141138419a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK11 VUF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK11%20VUF&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': 'M3',
'odometer': 80126,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'BMW M3 4.0 V8 DCT Coupe',
'transmission': 'automatic',
'trim': 'V8 DCT',
'vin': 'WBSKG92080E697645',
'year': 2011}
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK11%2520VUF%27 HTTP/1.1" 200 None
2026-03-29 22:06:36 [bca.uk] INFO: Saving data for YK11%20VUF: {'auction_closing_time': 1774951200.0, 'created_time': 1774735499.09047, 'last_price_update_time': 1774821996.905514}
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK11%2520VUF') HTTP/1.1" 204 0
2026-03-29 22:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN54OAL/42812105?sv=2020-08-04&st=2026-03-29T22%3A06%3A35Z&se=2026-03-29T22%3A31%3A35Z&sr=b&sp=r&sig=CpsdY98fGCavULJkQHQto8V8aZbuqGHKZKpSKa85zXE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PN54%20OAL-GB>
2026-03-29 22:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e935e7df-c51b-5719-9d53-d1e5a270ea84 with identifier: EO59%20HAX
2026-03-29 22:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e935e7df-c51b-5719-9d53-d1e5a270ea84 with identifier: EO59%20HAX
2026-03-29 22:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e935e7df-c51b-5719-9d53-d1e5a270ea84 with identifier: EO59%20HAX to the API
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO59%20HAX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e935e7df-c51b-5719-9d53-d1e5a270ea84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EO59 HAX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EO59%20HAX&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MINI',
'model': 'FIRST',
'odometer': 106810,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'MINI FIRST 1.4 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWME32040TM63191',
'year': 2009}
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO59%2520HAX%27 HTTP/1.1" 200 None
2026-03-29 22:06:37 [bca.uk] INFO: Saving data for EO59%20HAX: {'auction_closing_time': 1774864800.0, 'created_time': 1774735311.068083, 'last_price_update_time': 1774821997.195389}
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EO59%2520HAX') HTTP/1.1" 204 0
2026-03-29 22:06:37 [bca.uk] INFO: Found listing with ID: HS19%20GYN
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HS19%2520GYN%27 HTTP/1.1" 200 None
2026-03-29 22:06:37 [bca.uk] INFO: Scrape type for HS19%20GYN: 2
2026-03-29 22:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 546eaaae-2d78-532a-abb1-eac4aea0023f with identifier: HS19%20GYN
2026-03-29 22:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 546eaaae-2d78-532a-abb1-eac4aea0023f with scrape type 2
2026-03-29 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 546eaaae-2d78-532a-abb1-eac4aea0023f with scrape type 2
2026-03-29 22:06:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 546eaaae-2d78-532a-abb1-eac4aea0023f, identifier: HS19%20GYN
2026-03-29 22:06:37 [bca.uk] INFO: Found listing with ID: RK12%20WBW
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK12%2520WBW%27 HTTP/1.1" 200 None
2026-03-29 22:06:37 [bca.uk] INFO: Scrape type for RK12%20WBW: 2
2026-03-29 22:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5057cc2-c58a-5e78-ab90-b97e6edb6582 with identifier: RK12%20WBW
2026-03-29 22:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5057cc2-c58a-5e78-ab90-b97e6edb6582 with scrape type 2
2026-03-29 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5057cc2-c58a-5e78-ab90-b97e6edb6582 with scrape type 2
2026-03-29 22:06:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c5057cc2-c58a-5e78-ab90-b97e6edb6582, identifier: RK12%20WBW
2026-03-29 22:06:37 [bca.uk] INFO: Found listing with ID: GF52%20OWM
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF52%2520OWM%27 HTTP/1.1" 200 None
2026-03-29 22:06:37 [bca.uk] INFO: Scrape type for GF52%20OWM: 2
2026-03-29 22:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fe63328-a7f9-5445-857a-b37d1386e94b with identifier: GF52%20OWM
2026-03-29 22:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fe63328-a7f9-5445-857a-b37d1386e94b with scrape type 2
2026-03-29 22:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fe63328-a7f9-5445-857a-b37d1386e94b with scrape type 2
2026-03-29 22:06:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2fe63328-a7f9-5445-857a-b37d1386e94b, identifier: GF52%20OWM
2026-03-29 22:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 546eaaae-2d78-532a-abb1-eac4aea0023f with identifier: HS19%20GYN
2026-03-29 22:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 546eaaae-2d78-532a-abb1-eac4aea0023f with identifier: HS19%20GYN
2026-03-29 22:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 546eaaae-2d78-532a-abb1-eac4aea0023f with identifier: HS19%20GYN to the API
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HS19%20GYN-GB',
'category': 'Car',
'color': 'multicoloured',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '546eaaae-2d78-532a-abb1-eac4aea0023f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HS19 GYN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HS19%20GYN&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 46565,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'RENAULT CAPTUR 1.5 DCI 90 ICONIC Hatchback',
'transmission': 'manual',
'trim': 'DCI 90 ICONIC',
'vin': 'VF1R8700663051596',
'year': 2019}
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HS19%2520GYN%27 HTTP/1.1" 200 None
2026-03-29 22:06:37 [bca.uk] INFO: Saving data for HS19%20GYN: {'auction_closing_time': 1774951200.0, 'created_time': 1774735330.823671, 'last_price_update_time': 1774821997.824719}
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HS19%2520GYN') HTTP/1.1" 204 0
2026-03-29 22:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c5057cc2-c58a-5e78-ab90-b97e6edb6582 with identifier: RK12%20WBW
2026-03-29 22:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c5057cc2-c58a-5e78-ab90-b97e6edb6582 with identifier: RK12%20WBW
2026-03-29 22:06:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c5057cc2-c58a-5e78-ab90-b97e6edb6582 with identifier: RK12%20WBW to the API
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RK12%20WBW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c5057cc2-c58a-5e78-ab90-b97e6edb6582',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RK12 WBW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RK12%20WBW&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MINI',
'model': 'COUNTRYMAN',
'odometer': 125648,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'MINI COUNTRYMAN 2.0 COOPER D ALL4 Hatchback',
'transmission': 'automatic',
'trim': 'COOPER D ALL4',
'vin': 'WMWXD52070WK79275',
'year': 2012}
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK12%2520WBW%27 HTTP/1.1" 200 None
2026-03-29 22:06:38 [bca.uk] INFO: Saving data for RK12%20WBW: {'auction_closing_time': 1774864800.0, 'created_time': 1774735487.428394, 'last_price_update_time': 1774821998.213272}
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RK12%2520WBW') HTTP/1.1" 204 0
2026-03-29 22:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2fe63328-a7f9-5445-857a-b37d1386e94b with identifier: GF52%20OWM
2026-03-29 22:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2fe63328-a7f9-5445-857a-b37d1386e94b with identifier: GF52%20OWM
2026-03-29 22:06:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2fe63328-a7f9-5445-857a-b37d1386e94b with identifier: GF52%20OWM to the API
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF52%20OWM-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2fe63328-a7f9-5445-857a-b37d1386e94b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF52 OWM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF52%20OWM&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 107222,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.2 E 55 Hatchback',
'transmission': 'manual',
'trim': 'E 55',
'vin': 'WVWZZZ9NZ3Y112597',
'year': 2002}
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF52%2520OWM%27 HTTP/1.1" 200 None
2026-03-29 22:06:38 [bca.uk] INFO: Saving data for GF52%20OWM: {'auction_closing_time': 1774864800.0, 'created_time': 1774735314.757791, 'last_price_update_time': 1774821998.507752}
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF52%2520OWM') HTTP/1.1" 204 0
2026-03-29 22:06:38 [bca.uk] INFO: Found listing with ID: CA21%20OVG
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA21%2520OVG%27 HTTP/1.1" 200 None
2026-03-29 22:06:38 [bca.uk] INFO: Scrape type for CA21%20OVG: 2
2026-03-29 22:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87d1c14a-d5f3-5567-89ad-8d86774c1313 with identifier: CA21%20OVG
2026-03-29 22:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87d1c14a-d5f3-5567-89ad-8d86774c1313 with scrape type 2
2026-03-29 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87d1c14a-d5f3-5567-89ad-8d86774c1313 with scrape type 2
2026-03-29 22:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 87d1c14a-d5f3-5567-89ad-8d86774c1313, identifier: CA21%20OVG
2026-03-29 22:06:38 [bca.uk] INFO: Found listing with ID: SL62%20VWY
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL62%2520VWY%27 HTTP/1.1" 200 None
2026-03-29 22:06:38 [bca.uk] INFO: Scrape type for SL62%20VWY: 2
2026-03-29 22:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de1b1d7c-0af9-5140-a37d-505dea797715 with identifier: SL62%20VWY
2026-03-29 22:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de1b1d7c-0af9-5140-a37d-505dea797715 with scrape type 2
2026-03-29 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de1b1d7c-0af9-5140-a37d-505dea797715 with scrape type 2
2026-03-29 22:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: de1b1d7c-0af9-5140-a37d-505dea797715, identifier: SL62%20VWY
2026-03-29 22:06:38 [bca.uk] INFO: Found listing with ID: GV07%20WHR
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV07%2520WHR%27 HTTP/1.1" 200 None
2026-03-29 22:06:38 [bca.uk] INFO: Scrape type for GV07%20WHR: 2
2026-03-29 22:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec5f1ff9-26e6-53be-a244-e62a265b9a04 with identifier: GV07%20WHR
2026-03-29 22:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec5f1ff9-26e6-53be-a244-e62a265b9a04 with scrape type 2
2026-03-29 22:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec5f1ff9-26e6-53be-a244-e62a265b9a04 with scrape type 2
2026-03-29 22:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ec5f1ff9-26e6-53be-a244-e62a265b9a04, identifier: GV07%20WHR
2026-03-29 22:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 87d1c14a-d5f3-5567-89ad-8d86774c1313 with identifier: CA21%20OVG
2026-03-29 22:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 87d1c14a-d5f3-5567-89ad-8d86774c1313 with identifier: CA21%20OVG
2026-03-29 22:06:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 87d1c14a-d5f3-5567-89ad-8d86774c1313 with identifier: CA21%20OVG to the API
2026-03-29 22:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CA21%20OVG-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '87d1c14a-d5f3-5567-89ad-8d86774c1313',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CA21 OVG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CA21%20OVG&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VAUXHALL',
'model': 'GRANDLAND X',
'odometer': 53553,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VAUXHALL GRANDLAND X 1.2 T 130 ELITE Hatchback',
'transmission': 'manual',
'trim': 'T 130 ELITE',
'vin': 'W0VZRHNS7M6817996',
'year': 2021}
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA21%2520OVG%27 HTTP/1.1" 200 None
2026-03-29 22:06:39 [bca.uk] INFO: Saving data for CA21%20OVG: {'auction_closing_time': 1774951200.0, 'created_time': 1774735330.261545, 'last_price_update_time': 1774821999.14791}
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CA21%2520OVG') HTTP/1.1" 204 0
2026-03-29 22:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: de1b1d7c-0af9-5140-a37d-505dea797715 with identifier: SL62%20VWY
2026-03-29 22:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: de1b1d7c-0af9-5140-a37d-505dea797715 with identifier: SL62%20VWY
2026-03-29 22:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: de1b1d7c-0af9-5140-a37d-505dea797715 with identifier: SL62%20VWY to the API
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL62%20VWY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'de1b1d7c-0af9-5140-a37d-505dea797715',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SL62 VWY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SL62%20VWY&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'KIA',
'model': 'RIO',
'odometer': 57076,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'KIA RIO 1.2 1 Hatchback',
'transmission': 'manual',
'trim': '1',
'vin': 'KNADM511LD6162634',
'year': 2012}
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL62%2520VWY%27 HTTP/1.1" 200 None
2026-03-29 22:06:39 [bca.uk] INFO: Saving data for SL62%20VWY: {'auction_closing_time': 1774864800.0, 'created_time': 1774735482.819571, 'last_price_update_time': 1774821999.443547}
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SL62%2520VWY') HTTP/1.1" 204 0
2026-03-29 22:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ec5f1ff9-26e6-53be-a244-e62a265b9a04 with identifier: GV07%20WHR
2026-03-29 22:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ec5f1ff9-26e6-53be-a244-e62a265b9a04 with identifier: GV07%20WHR
2026-03-29 22:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ec5f1ff9-26e6-53be-a244-e62a265b9a04 with identifier: GV07%20WHR to the API
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 167,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GV07%20WHR-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ec5f1ff9-26e6-53be-a244-e62a265b9a04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GV07 WHR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GV07%20WHR&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'TOYOTA',
'model': 'COROLLA VERSO',
'odometer': 238617,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'TOYOTA COROLLA VERSO 2.2 D-4D T3 MPV',
'transmission': 'manual',
'trim': 'D-4D T3',
'vin': 'NMTEA16R90R086435',
'year': 2007}
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV07%2520WHR%27 HTTP/1.1" 200 None
2026-03-29 22:06:39 [bca.uk] INFO: Saving data for GV07%20WHR: {'auction_closing_time': 1774864800.0, 'created_time': 1774735315.539081, 'last_price_update_time': 1774821999.746059}
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GV07%2520WHR') HTTP/1.1" 204 0
2026-03-29 22:06:39 [bca.uk] INFO: Found listing with ID: CN69%20YVF
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN69%2520YVF%27 HTTP/1.1" 200 None
2026-03-29 22:06:39 [bca.uk] INFO: Scrape type for CN69%20YVF: 2
2026-03-29 22:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0d2c8c1-587d-52a8-bac1-4dade51bc1df with identifier: CN69%20YVF
2026-03-29 22:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0d2c8c1-587d-52a8-bac1-4dade51bc1df with scrape type 2
2026-03-29 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0d2c8c1-587d-52a8-bac1-4dade51bc1df with scrape type 2
2026-03-29 22:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b0d2c8c1-587d-52a8-bac1-4dade51bc1df, identifier: CN69%20YVF
2026-03-29 22:06:39 [bca.uk] INFO: Found listing with ID: YE63%20EHG
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE63%2520EHG%27 HTTP/1.1" 200 None
2026-03-29 22:06:39 [bca.uk] INFO: Scrape type for YE63%20EHG: 0
2026-03-29 22:06:39 [bca.uk] INFO: Found listing with ID: CU63%20NGZ
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU63%2520NGZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:39 [bca.uk] INFO: Scrape type for CU63%20NGZ: 0
2026-03-29 22:06:39 [bca.uk] INFO: Found listing with ID: CV55%20OPY
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV55%2520OPY%27 HTTP/1.1" 200 None
2026-03-29 22:06:39 [bca.uk] INFO: Scrape type for CV55%20OPY: 0
2026-03-29 22:06:39 [bca.uk] INFO: Found listing with ID: EJ63%20EXO
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ63%2520EXO%27 HTTP/1.1" 200 None
2026-03-29 22:06:39 [bca.uk] INFO: Scrape type for EJ63%20EXO: 2
2026-03-29 22:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac2cb512-acf6-577f-a0f2-2fe21a625645 with identifier: EJ63%20EXO
2026-03-29 22:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac2cb512-acf6-577f-a0f2-2fe21a625645 with scrape type 2
2026-03-29 22:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac2cb512-acf6-577f-a0f2-2fe21a625645 with scrape type 2
2026-03-29 22:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ac2cb512-acf6-577f-a0f2-2fe21a625645, identifier: EJ63%20EXO
2026-03-29 22:06:40 [bca.uk] INFO: Found listing with ID: SV57%20URE
2026-03-29 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV57%2520URE%27 HTTP/1.1" 200 None
2026-03-29 22:06:40 [bca.uk] INFO: Scrape type for SV57%20URE: 2
2026-03-29 22:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc8ad810-ee96-5691-85b6-151e0c412b22 with identifier: SV57%20URE
2026-03-29 22:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc8ad810-ee96-5691-85b6-151e0c412b22 with scrape type 2
2026-03-29 22:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc8ad810-ee96-5691-85b6-151e0c412b22 with scrape type 2
2026-03-29 22:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dc8ad810-ee96-5691-85b6-151e0c412b22, identifier: SV57%20URE
2026-03-29 22:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b0d2c8c1-587d-52a8-bac1-4dade51bc1df with identifier: CN69%20YVF
2026-03-29 22:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b0d2c8c1-587d-52a8-bac1-4dade51bc1df with identifier: CN69%20YVF
2026-03-29 22:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b0d2c8c1-587d-52a8-bac1-4dade51bc1df with identifier: CN69%20YVF to the API
2026-03-29 22:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CN69%20YVF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b0d2c8c1-587d-52a8-bac1-4dade51bc1df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CN69 YVF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CN69%20YVF&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MG MOTOR UK',
'model': 'MG3',
'odometer': 44980,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MG MOTOR UK MG3 1.5 VTI-TECH EXCLUSIVE Hatchback',
'transmission': 'manual',
'trim': 'VTI-TECH EXCLUSIVE',
'vin': 'SDPZ1CBDAKS067971',
'year': 2019}
2026-03-29 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN69%2520YVF%27 HTTP/1.1" 200 None
2026-03-29 22:06:40 [bca.uk] INFO: Saving data for CN69%20YVF: {'auction_closing_time': 1774951200.0, 'created_time': 1774735335.278249, 'last_price_update_time': 1774822000.4436}
2026-03-29 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CN69%2520YVF') HTTP/1.1" 204 0
2026-03-29 22:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ac2cb512-acf6-577f-a0f2-2fe21a625645 with identifier: EJ63%20EXO
2026-03-29 22:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ac2cb512-acf6-577f-a0f2-2fe21a625645 with identifier: EJ63%20EXO
2026-03-29 22:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ac2cb512-acf6-577f-a0f2-2fe21a625645 with identifier: EJ63%20EXO to the API
2026-03-29 22:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ63%20EXO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ac2cb512-acf6-577f-a0f2-2fe21a625645',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EJ63 EXO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EJ63%20EXO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 53652,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 82 ZETEC Hatchback',
'transmission': 'manual',
'trim': '82 ZETEC',
'vin': 'WF0DXXGAKDEL88377',
'year': 2014}
2026-03-29 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ63%2520EXO%27 HTTP/1.1" 200 None
2026-03-29 22:06:40 [bca.uk] INFO: Saving data for EJ63%20EXO: {'auction_closing_time': 1774864800.0, 'created_time': 1774735485.061207, 'last_price_update_time': 1774822000.729185}
2026-03-29 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EJ63%2520EXO') HTTP/1.1" 204 0
2026-03-29 22:06:40 [crawlers.middlewares.report_download_middleware] WARNING: Failed to download report for item ac1f6057-b0f6-50a4-86b8-79ddb8bcda18 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8003 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 22:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ac1f6057-b0f6-50a4-86b8-79ddb8bcda18 with identifier: PX16%20TWC
2026-03-29 22:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ac1f6057-b0f6-50a4-86b8-79ddb8bcda18 with identifier: PX16%20TWC
2026-03-29 22:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ac1f6057-b0f6-50a4-86b8-79ddb8bcda18 with identifier: PX16%20TWC to the API
2026-03-29 22:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:41 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8003 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 156,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PX16%20TWC-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ac1f6057-b0f6-50a4-86b8-79ddb8bcda18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PX16 TWC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PX16%20TWC&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SEAT',
'model': 'LEON',
'odometer': 94846,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PX16TWC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430116',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430156',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430180',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430198',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430219',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430245',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430272',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430293',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430316',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430333'],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'SEAT LEON 2.0 TSI 290 CUPRA Hatchback',
'transmission': 'manual',
'trim': 'TSI 290 CUPRA',
'vin': 'VSSZZZ5FZGR092010',
'year': 2016}
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX16%2520TWC%27 HTTP/1.1" 200 None
2026-03-29 22:06:41 [bca.uk] INFO: Saving data for PX16%20TWC: {'created_time': 1774822001.106111, 'last_price_update_time': 1774822001.106121, 'auction_closing_time': 1774951200.0}
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PX16%2520TWC') HTTP/1.1" 204 0
2026-03-29 22:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dc8ad810-ee96-5691-85b6-151e0c412b22 with identifier: SV57%20URE
2026-03-29 22:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dc8ad810-ee96-5691-85b6-151e0c412b22 with identifier: SV57%20URE
2026-03-29 22:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dc8ad810-ee96-5691-85b6-151e0c412b22 with identifier: SV57%20URE to the API
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV57%20URE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'dc8ad810-ee96-5691-85b6-151e0c412b22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV57 URE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV57%20URE&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'PEUGEOT',
'model': '206',
'odometer': 95350,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'PEUGEOT 206 1.4 HDI LOOK Hatchback',
'transmission': 'manual',
'trim': 'HDI LOOK',
'vin': 'VF32C8HZA47745260',
'year': 2007}
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV57%2520URE%27 HTTP/1.1" 200 None
2026-03-29 22:06:41 [bca.uk] INFO: Saving data for SV57%20URE: {'auction_closing_time': 1774864800.0, 'created_time': 1774735313.842023, 'last_price_update_time': 1774822001.427675}
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV57%2520URE') HTTP/1.1" 204 0
2026-03-29 22:06:41 [bca.uk] INFO: Found listing with ID: DH74%20NTG
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DH74%2520NTG%27 HTTP/1.1" 200 None
2026-03-29 22:06:41 [bca.uk] INFO: Scrape type for DH74%20NTG: 2
2026-03-29 22:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0257875d-c974-59e6-9d6f-29ede1e17434 with identifier: DH74%20NTG
2026-03-29 22:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0257875d-c974-59e6-9d6f-29ede1e17434 with scrape type 2
2026-03-29 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0257875d-c974-59e6-9d6f-29ede1e17434 with scrape type 2
2026-03-29 22:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0257875d-c974-59e6-9d6f-29ede1e17434, identifier: DH74%20NTG
2026-03-29 22:06:41 [bca.uk] INFO: Found listing with ID: EY14%20HKC
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY14%2520HKC%27 HTTP/1.1" 200 None
2026-03-29 22:06:41 [bca.uk] INFO: Scrape type for EY14%20HKC: 2
2026-03-29 22:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4878bd96-ecc6-5172-b9f4-32abbb9ae940 with identifier: EY14%20HKC
2026-03-29 22:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4878bd96-ecc6-5172-b9f4-32abbb9ae940 with scrape type 2
2026-03-29 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4878bd96-ecc6-5172-b9f4-32abbb9ae940 with scrape type 2
2026-03-29 22:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4878bd96-ecc6-5172-b9f4-32abbb9ae940, identifier: EY14%20HKC
2026-03-29 22:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:06:41 [bca.uk] INFO: Found listing with ID: LX67%20JRZ
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX67%2520JRZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:41 [bca.uk] INFO: Scrape type for LX67%20JRZ: 2
2026-03-29 22:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f32681d-db41-5392-826f-9b7e9d934be6 with identifier: LX67%20JRZ
2026-03-29 22:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f32681d-db41-5392-826f-9b7e9d934be6 with scrape type 2
2026-03-29 22:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f32681d-db41-5392-826f-9b7e9d934be6 with scrape type 2
2026-03-29 22:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0f32681d-db41-5392-826f-9b7e9d934be6, identifier: LX67%20JRZ
2026-03-29 22:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0257875d-c974-59e6-9d6f-29ede1e17434 with identifier: DH74%20NTG
2026-03-29 22:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0257875d-c974-59e6-9d6f-29ede1e17434 with identifier: DH74%20NTG
2026-03-29 22:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0257875d-c974-59e6-9d6f-29ede1e17434 with identifier: DH74%20NTG to the API
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 126,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DH74%20NTG-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0257875d-c974-59e6-9d6f-29ede1e17434',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DH74 NTG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DH74%20NTG&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'SKODA',
'model': 'KAMIQ',
'odometer': 2947,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-01',
'seller_name': None,
'title': 'SKODA KAMIQ 1.0 TSI 115 SE L ED. Hatchback',
'transmission': 'manual',
'trim': 'TSI 115 SE L ED.',
'vin': 'TMBHR6NW6S3018089',
'year': 2025}
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DH74%2520NTG%27 HTTP/1.1" 200 None
2026-03-29 22:06:42 [bca.uk] INFO: Saving data for DH74%20NTG: {'auction_closing_time': 1774951200.0, 'created_time': 1774735316.255614, 'last_price_update_time': 1774822002.065807}
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DH74%2520NTG') HTTP/1.1" 204 0
2026-03-29 22:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4878bd96-ecc6-5172-b9f4-32abbb9ae940 with identifier: EY14%20HKC
2026-03-29 22:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4878bd96-ecc6-5172-b9f4-32abbb9ae940 with identifier: EY14%20HKC
2026-03-29 22:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4878bd96-ecc6-5172-b9f4-32abbb9ae940 with identifier: EY14%20HKC to the API
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY14%20HKC-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4878bd96-ecc6-5172-b9f4-32abbb9ae940',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY14 HKC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EY14%20HKC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 58304,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.6 E-HDI ALLURE EGC MPV',
'transmission': 'automatic',
'trim': 'E-HDI ALLURE EGC',
'vin': 'VF3CU9HP8EY018378',
'year': 2014}
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY14%2520HKC%27 HTTP/1.1" 200 None
2026-03-29 22:06:42 [bca.uk] INFO: Saving data for EY14%20HKC: {'auction_closing_time': 1774864800.0, 'created_time': 1774735486.577863, 'last_price_update_time': 1774822002.445667}
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EY14%2520HKC') HTTP/1.1" 204 0
2026-03-29 22:06:42 [crawlers.middlewares.report_download_middleware] WARNING: Failed to download report for item a7392bcd-4395-5c1c-82dd-efb0c72988e0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8003 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 22:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a7392bcd-4395-5c1c-82dd-efb0c72988e0 with identifier: YO18%20AYK
2026-03-29 22:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a7392bcd-4395-5c1c-82dd-efb0c72988e0 with identifier: YO18%20AYK
2026-03-29 22:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a7392bcd-4395-5c1c-82dd-efb0c72988e0 with identifier: YO18%20AYK to the API
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:42 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8003 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YO18%20AYK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a7392bcd-4395-5c1c-82dd-efb0c72988e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YO18 AYK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YO18%20AYK&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'VIVA',
'odometer': 9192,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YO18AYK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411727',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411738',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411749',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411769',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411780',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411794',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411805',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411818',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411839',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411852'],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VAUXHALL VIVA 1.0 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'W0VDD6E70JC438022',
'year': 2018}
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YO18%2520AYK%27 HTTP/1.1" 200 None
2026-03-29 22:06:42 [bca.uk] INFO: Saving data for YO18%20AYK: {'created_time': 1774822002.829194, 'last_price_update_time': 1774822002.829205, 'auction_closing_time': 1774951200.0}
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YO18%2520AYK') HTTP/1.1" 204 0
2026-03-29 22:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0f32681d-db41-5392-826f-9b7e9d934be6 with identifier: LX67%20JRZ
2026-03-29 22:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0f32681d-db41-5392-826f-9b7e9d934be6 with identifier: LX67%20JRZ
2026-03-29 22:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0f32681d-db41-5392-826f-9b7e9d934be6 with identifier: LX67%20JRZ to the API
2026-03-29 22:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX67%20JRZ-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0f32681d-db41-5392-826f-9b7e9d934be6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LX67 JRZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LX67%20JRZ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 99118,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'HONDA CR-V 1.6 I-DTEC 160 EX 4WD StationWagon',
'transmission': 'automatic',
'trim': 'I-DTEC 160 EX 4WD',
'vin': 'SHSRE6890HU001969',
'year': 2017}
2026-03-29 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX67%2520JRZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:43 [bca.uk] INFO: Saving data for LX67%20JRZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774735313.450086, 'last_price_update_time': 1774822003.123807}
2026-03-29 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LX67%2520JRZ') HTTP/1.1" 204 0
2026-03-29 22:06:43 [bca.uk] INFO: Found listing with ID: FR19%20MWZ
2026-03-29 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR19%2520MWZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:43 [bca.uk] INFO: Scrape type for FR19%20MWZ: 2
2026-03-29 22:06:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb with identifier: FR19%20MWZ
2026-03-29 22:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb with scrape type 2
2026-03-29 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb with scrape type 2
2026-03-29 22:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb, identifier: FR19%20MWZ
2026-03-29 22:06:43 [bca.uk] INFO: Found listing with ID: HY10%20UJL
2026-03-29 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY10%2520UJL%27 HTTP/1.1" 200 None
2026-03-29 22:06:43 [bca.uk] INFO: Scrape type for HY10%20UJL: 2
2026-03-29 22:06:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04bf4189-3c99-5b46-aae5-ab7282fc1531 with identifier: HY10%20UJL
2026-03-29 22:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04bf4189-3c99-5b46-aae5-ab7282fc1531 with scrape type 2
2026-03-29 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04bf4189-3c99-5b46-aae5-ab7282fc1531 with scrape type 2
2026-03-29 22:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 04bf4189-3c99-5b46-aae5-ab7282fc1531, identifier: HY10%20UJL
2026-03-29 22:06:43 [bca.uk] INFO: Found listing with ID: FY65%20OSN
2026-03-29 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY65%2520OSN%27 HTTP/1.1" 200 None
2026-03-29 22:06:43 [bca.uk] INFO: Scrape type for FY65%20OSN: 2
2026-03-29 22:06:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4c536c8-20b9-5eb5-bd31-426ff92c052b with identifier: FY65%20OSN
2026-03-29 22:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4c536c8-20b9-5eb5-bd31-426ff92c052b with scrape type 2
2026-03-29 22:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4c536c8-20b9-5eb5-bd31-426ff92c052b with scrape type 2
2026-03-29 22:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d4c536c8-20b9-5eb5-bd31-426ff92c052b, identifier: FY65%20OSN
2026-03-29 22:06:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb with identifier: FR19%20MWZ
2026-03-29 22:06:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb with identifier: FR19%20MWZ
2026-03-29 22:06:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb with identifier: FR19%20MWZ to the API
2026-03-29 22:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FR19%20MWZ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8a1bdba9-ab9f-54e2-9fc2-fa51b8a924eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FR19 MWZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FR19%20MWZ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLKSWAGEN',
'model': 'UP!',
'odometer': 27979,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN UP! 1.0 GTI 115 Hatchback',
'transmission': 'manual',
'trim': 'GTI 115',
'vin': 'WVWZZZAAZKD173690',
'year': 2019}
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR19%2520MWZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:44 [bca.uk] INFO: Saving data for FR19%20MWZ: {'auction_closing_time': 1774951200.0, 'created_time': 1774735315.143412, 'last_price_update_time': 1774822004.015241}
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FR19%2520MWZ') HTTP/1.1" 204 0
2026-03-29 22:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 04bf4189-3c99-5b46-aae5-ab7282fc1531 with identifier: HY10%20UJL
2026-03-29 22:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 04bf4189-3c99-5b46-aae5-ab7282fc1531 with identifier: HY10%20UJL
2026-03-29 22:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 04bf4189-3c99-5b46-aae5-ab7282fc1531 with identifier: HY10%20UJL to the API
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY10%20UJL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '04bf4189-3c99-5b46-aae5-ab7282fc1531',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY10 UJL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HY10%20UJL&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FIAT',
'model': '500C',
'odometer': 52880,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FIAT 500C 1.4 LOUNGE S/S Convertible',
'transmission': 'manual',
'trim': 'LOUNGE S/S',
'vin': 'ZFA31200000498077',
'year': 2010}
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY10%2520UJL%27 HTTP/1.1" 200 None
2026-03-29 22:06:44 [bca.uk] INFO: Saving data for HY10%20UJL: {'auction_closing_time': 1774864800.0, 'created_time': 1774476413.179886, 'last_price_update_time': 1774822004.369451}
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HY10%2520UJL') HTTP/1.1" 204 0
2026-03-29 22:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d4c536c8-20b9-5eb5-bd31-426ff92c052b with identifier: FY65%20OSN
2026-03-29 22:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d4c536c8-20b9-5eb5-bd31-426ff92c052b with identifier: FY65%20OSN
2026-03-29 22:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d4c536c8-20b9-5eb5-bd31-426ff92c052b with identifier: FY65%20OSN to the API
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 89,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY65%20OSN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd4c536c8-20b9-5eb5-bd31-426ff92c052b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY65 OSN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FY65%20OSN&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'BMW',
'model': '116D',
'odometer': 52417,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'BMW 116D 1.5 EFD PLUS Hatchback',
'transmission': 'manual',
'trim': 'EFD PLUS',
'vin': 'WBA1V920805D11413',
'year': 2015}
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY65%2520OSN%27 HTTP/1.1" 200 None
2026-03-29 22:06:44 [bca.uk] INFO: Saving data for FY65%20OSN: {'auction_closing_time': 1774864800.0, 'created_time': 1774735335.674584, 'last_price_update_time': 1774822004.67249}
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FY65%2520OSN') HTTP/1.1" 204 0
2026-03-29 22:06:44 [bca.uk] INFO: Found listing with ID: MT71%20NEN
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT71%2520NEN%27 HTTP/1.1" 200 None
2026-03-29 22:06:44 [bca.uk] INFO: Scrape type for MT71%20NEN: 2
2026-03-29 22:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5421d270-4706-56d4-861e-d213204bb57b with identifier: MT71%20NEN
2026-03-29 22:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5421d270-4706-56d4-861e-d213204bb57b with scrape type 2
2026-03-29 22:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5421d270-4706-56d4-861e-d213204bb57b with scrape type 2
2026-03-29 22:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5421d270-4706-56d4-861e-d213204bb57b, identifier: MT71%20NEN
2026-03-29 22:06:44 [bca.uk] INFO: Found listing with ID: HY58%20NPG
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY58%2520NPG%27 HTTP/1.1" 200 None
2026-03-29 22:06:44 [bca.uk] INFO: Scrape type for HY58%20NPG: 2
2026-03-29 22:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65 with identifier: HY58%20NPG
2026-03-29 22:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65 with scrape type 2
2026-03-29 22:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65 with scrape type 2
2026-03-29 22:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65, identifier: HY58%20NPG
2026-03-29 22:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AP12HDL/42809882?sv=2020-08-04&st=2026-03-29T22%3A06%3A24Z&se=2026-03-29T22%3A31%3A24Z&sr=b&sp=r&sig=DviGem8rLk3txiS7kcWiSVUINF67ojRtTzL1ranpKKA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:06:44 [bca.uk] INFO: Found listing with ID: GC65%20ULU
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GC65%2520ULU%27 HTTP/1.1" 200 None
2026-03-29 22:06:44 [bca.uk] INFO: Scrape type for GC65%20ULU: 0
2026-03-29 22:06:44 [bca.uk] INFO: Found listing with ID: GN15%20TXC
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN15%2520TXC%27 HTTP/1.1" 200 None
2026-03-29 22:06:44 [bca.uk] INFO: Scrape type for GN15%20TXC: 0
2026-03-29 22:06:44 [bca.uk] INFO: Found listing with ID: DY15%20MXL
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY15%2520MXL%27 HTTP/1.1" 200 None
2026-03-29 22:06:44 [bca.uk] INFO: Scrape type for DY15%20MXL: 0
2026-03-29 22:06:44 [bca.uk] INFO: Found listing with ID: VA57%20MMV
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA57%2520MMV%27 HTTP/1.1" 200 None
2026-03-29 22:06:44 [bca.uk] INFO: Scrape type for VA57%20MMV: 2
2026-03-29 22:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04f0d7cf-f3c1-57e5-aa5b-17da875086d9 with identifier: VA57%20MMV
2026-03-29 22:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04f0d7cf-f3c1-57e5-aa5b-17da875086d9 with scrape type 2
2026-03-29 22:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04f0d7cf-f3c1-57e5-aa5b-17da875086d9 with scrape type 2
2026-03-29 22:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 04f0d7cf-f3c1-57e5-aa5b-17da875086d9, identifier: VA57%20MMV
2026-03-29 22:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5421d270-4706-56d4-861e-d213204bb57b with identifier: MT71%20NEN
2026-03-29 22:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5421d270-4706-56d4-861e-d213204bb57b with identifier: MT71%20NEN
2026-03-29 22:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5421d270-4706-56d4-861e-d213204bb57b with identifier: MT71%20NEN to the API
2026-03-29 22:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT71%20NEN-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5421d270-4706-56d4-861e-d213204bb57b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT71 NEN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT71%20NEN&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'KIA',
'model': 'XCEED',
'odometer': 30110,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'KIA XCEED 1.6 CRDI 48V 115 3 ISG Hatchback',
'transmission': 'manual',
'trim': 'CRDI 48V 115 3 ISG',
'vin': 'U5YH5F19LML077195',
'year': 2021}
2026-03-29 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT71%2520NEN%27 HTTP/1.1" 200 None
2026-03-29 22:06:45 [bca.uk] INFO: Saving data for MT71%20NEN: {'auction_closing_time': 1774951200.0, 'created_time': 1774735337.054301, 'last_price_update_time': 1774822005.367096}
2026-03-29 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT71%2520NEN') HTTP/1.1" 204 0
2026-03-29 22:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65 with identifier: HY58%20NPG
2026-03-29 22:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65 with identifier: HY58%20NPG
2026-03-29 22:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 96f4e7fc-b83e-5062-87d7-e0a26a3eaa65 with identifier: HY58%20NPG to the API
2026-03-29 22:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY58%20NPG-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '96f4e7fc-b83e-5062-87d7-e0a26a3eaa65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY58 NPG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HY58%20NPG&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 140520,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.6 ACENTA S Hatchback',
'transmission': 'automatic',
'trim': 'ACENTA S',
'vin': 'SJNFCAE11U1305326',
'year': 2008}
2026-03-29 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY58%2520NPG%27 HTTP/1.1" 200 None
2026-03-29 22:06:45 [bca.uk] INFO: Saving data for HY58%20NPG: {'auction_closing_time': 1774864800.0, 'created_time': 1774735486.209775, 'last_price_update_time': 1774822005.740113}
2026-03-29 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HY58%2520NPG') HTTP/1.1" 204 0
2026-03-29 22:06:45 [bca.uk] INFO: Total items found: 100
2026-03-29 22:06:45 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded
2026-03-29 22:06:45 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:06:45 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE56AOD/42812125?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=jYNw1fNPOU4PCeqA8yT%2FgW%2F2lYqFTt1ML7YNy%2BQkkpE%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP66PGE/42809943?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=WoZ%2FTTd8%2FUTJlWN%2B%2FNq0hoqMOCTHwgwo3OayCCjYYF0%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:06:45 [crawlers.middlewares.report_download_middleware] WARNING: Failed to download report for item 53e8a45e-28a5-5ca8-b6f8-84adabb0f290 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8003 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 22:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 53e8a45e-28a5-5ca8-b6f8-84adabb0f290 with identifier: ME19%20TFO
2026-03-29 22:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 53e8a45e-28a5-5ca8-b6f8-84adabb0f290 with identifier: ME19%20TFO
2026-03-29 22:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 53e8a45e-28a5-5ca8-b6f8-84adabb0f290 with identifier: ME19%20TFO to the API
2026-03-29 22:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:46 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8003 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ME19%20TFO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '53e8a45e-28a5-5ca8-b6f8-84adabb0f290',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ME19 TFO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ME19%20TFO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '208',
'odometer': 38455,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ME19TFO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430123',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430133',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430164',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430183',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430207',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430235',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430257',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430286',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430301',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430317'],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'PEUGEOT 208 1.2 P/T 82 TECH EDITION Hatchback',
'transmission': 'manual',
'trim': 'P/T 82 TECH EDITION',
'vin': 'VF3CCHMRPKW036363',
'year': 2019}
2026-03-29 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ME19%2520TFO%27 HTTP/1.1" 200 None
2026-03-29 22:06:46 [bca.uk] INFO: Saving data for ME19%20TFO: {'created_time': 1774822006.250465, 'last_price_update_time': 1774822006.250477, 'auction_closing_time': 1774951200.0}
2026-03-29 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ME19%2520TFO') HTTP/1.1" 204 0
2026-03-29 22:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 04f0d7cf-f3c1-57e5-aa5b-17da875086d9 with identifier: VA57%20MMV
2026-03-29 22:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 04f0d7cf-f3c1-57e5-aa5b-17da875086d9 with identifier: VA57%20MMV
2026-03-29 22:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 04f0d7cf-f3c1-57e5-aa5b-17da875086d9 with identifier: VA57%20MMV to the API
2026-03-29 22:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VA57%20MMV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '04f0d7cf-f3c1-57e5-aa5b-17da875086d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VA57 MMV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VA57%20MMV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 120211,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.4 TSI 170 GT SPORT DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI 170 GT SPORT DSG',
'vin': 'WVWZZZ1KZ8W158019',
'year': 2007}
2026-03-29 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA57%2520MMV%27 HTTP/1.1" 200 None
2026-03-29 22:06:46 [bca.uk] INFO: Saving data for VA57%20MMV: {'auction_closing_time': 1774951200.0, 'created_time': 1774610845.093, 'last_price_update_time': 1774822006.533888}
2026-03-29 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VA57%2520MMV') HTTP/1.1" 204 0
2026-03-29 22:06:46 [bca.uk] INFO: Found listing with ID: WT69%20BHA
2026-03-29 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT69%2520BHA%27 HTTP/1.1" 200 None
2026-03-29 22:06:46 [bca.uk] INFO: Scrape type for WT69%20BHA: 2
2026-03-29 22:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc68cc3e-7955-57eb-86ee-c32f3b153341 with identifier: WT69%20BHA
2026-03-29 22:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc68cc3e-7955-57eb-86ee-c32f3b153341 with scrape type 2
2026-03-29 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc68cc3e-7955-57eb-86ee-c32f3b153341 with scrape type 2
2026-03-29 22:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fc68cc3e-7955-57eb-86ee-c32f3b153341, identifier: WT69%20BHA
2026-03-29 22:06:46 [bca.uk] INFO: Found listing with ID: YF07%20CJE
2026-03-29 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF07%2520CJE%27 HTTP/1.1" 200 None
2026-03-29 22:06:46 [bca.uk] INFO: Scrape type for YF07%20CJE: 2
2026-03-29 22:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56b77897-c825-556b-ba96-284dc5a81572 with identifier: YF07%20CJE
2026-03-29 22:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56b77897-c825-556b-ba96-284dc5a81572 with scrape type 2
2026-03-29 22:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56b77897-c825-556b-ba96-284dc5a81572 with scrape type 2
2026-03-29 22:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 56b77897-c825-556b-ba96-284dc5a81572, identifier: YF07%20CJE
2026-03-29 22:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ08SVR/42812103?sv=2020-08-04&st=2026-03-29T22%3A06%3A29Z&se=2026-03-29T22%3A31%3A29Z&sr=b&sp=r&sig=MlBD76Nciq6xfGWS8ogzePQWya6I7akYbscBXB2PpJI%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:06:46 [crawlers.middlewares.report_download_middleware] WARNING: Failed to download report for item f445e0d5-837d-52c8-8f48-046533da8751 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8003 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 22:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f445e0d5-837d-52c8-8f48-046533da8751 with identifier: MK58%20WVS
2026-03-29 22:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f445e0d5-837d-52c8-8f48-046533da8751 with identifier: MK58%20WVS
2026-03-29 22:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f445e0d5-837d-52c8-8f48-046533da8751 with identifier: MK58%20WVS to the API
2026-03-29 22:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:47 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8003 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MK58%20WVS-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f445e0d5-837d-52c8-8f48-046533da8751',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MK58 WVS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MK58%20WVS&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '207',
'odometer': 77691,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MK58WVS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699431517',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699431519',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699431520',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699431521',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699431522',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699431524',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699431525',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699431526'],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'PEUGEOT 207 1.4 95 VTI CIELO Hatchback',
'transmission': 'manual',
'trim': '95 VTI CIELO',
'vin': 'VF3WCKFVC34510511',
'year': 2008}
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK58%2520WVS%27 HTTP/1.1" 200 None
2026-03-29 22:06:47 [bca.uk] INFO: Saving data for MK58%20WVS: {'created_time': 1774822007.147647, 'last_price_update_time': 1774822007.147657, 'auction_closing_time': 1774951200.0}
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MK58%2520WVS') HTTP/1.1" 204 0
2026-03-29 22:06:47 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:06:47 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:06:47 [bca.uk] INFO: Found listing with ID: AV03%20RSZ
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV03%2520RSZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:47 [bca.uk] INFO: Scrape type for AV03%20RSZ: 2
2026-03-29 22:06:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8076e5d-cb8b-5578-9e3b-020e67e6d8b5 with identifier: AV03%20RSZ
2026-03-29 22:06:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8076e5d-cb8b-5578-9e3b-020e67e6d8b5 with scrape type 2
2026-03-29 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8076e5d-cb8b-5578-9e3b-020e67e6d8b5 with scrape type 2
2026-03-29 22:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d8076e5d-cb8b-5578-9e3b-020e67e6d8b5, identifier: AV03%20RSZ
2026-03-29 22:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fc68cc3e-7955-57eb-86ee-c32f3b153341 with identifier: WT69%20BHA
2026-03-29 22:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fc68cc3e-7955-57eb-86ee-c32f3b153341 with identifier: WT69%20BHA
2026-03-29 22:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fc68cc3e-7955-57eb-86ee-c32f3b153341 with identifier: WT69%20BHA to the API
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WT69%20BHA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fc68cc3e-7955-57eb-86ee-c32f3b153341',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WT69 BHA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WT69%20BHA&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLKSWAGEN',
'model': 'TIGUAN ALLSPACE',
'odometer': 38418,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN ALLSPACE 1.5 TSI EVO 150 2WD MATCH DSG '
'StationWagon',
'transmission': 'automatic',
'trim': 'TSI EVO 150 2WD MATCH DSG',
'vin': 'WVGZZZ5NZLM078782',
'year': 2020}
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT69%2520BHA%27 HTTP/1.1" 200 None
2026-03-29 22:06:47 [bca.uk] INFO: Saving data for WT69%20BHA: {'auction_closing_time': 1774951200.0, 'created_time': 1774735312.506408, 'last_price_update_time': 1774822007.634161}
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WT69%2520BHA') HTTP/1.1" 204 0
2026-03-29 22:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 56b77897-c825-556b-ba96-284dc5a81572 with identifier: YF07%20CJE
2026-03-29 22:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 56b77897-c825-556b-ba96-284dc5a81572 with identifier: YF07%20CJE
2026-03-29 22:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 56b77897-c825-556b-ba96-284dc5a81572 with identifier: YF07%20CJE to the API
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 239,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF07%20CJE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '56b77897-c825-556b-ba96-284dc5a81572',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF07 CJE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF07%20CJE&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLVO',
'model': 'XC90',
'odometer': 119982,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VOLVO XC90 2.4 D5 185 SE LUX G/T Estate',
'transmission': 'manual',
'trim': 'D5 185 SE LUX G/T',
'vin': 'YV1CZ714671400964',
'year': 2007}
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF07%2520CJE%27 HTTP/1.1" 200 None
2026-03-29 22:06:47 [bca.uk] INFO: Saving data for YF07%20CJE: {'auction_closing_time': 1774864800.0, 'created_time': 1774735483.888312, 'last_price_update_time': 1774822007.932458}
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF07%2520CJE') HTTP/1.1" 204 0
2026-03-29 22:06:47 [bca.uk] INFO: Found listing with ID: KN68%20YYB
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN68%2520YYB%27 HTTP/1.1" 200 None
2026-03-29 22:06:47 [bca.uk] INFO: Scrape type for KN68%20YYB: 2
2026-03-29 22:06:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37980901-da86-559d-83e6-c8f73f7f2265 with identifier: KN68%20YYB
2026-03-29 22:06:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37980901-da86-559d-83e6-c8f73f7f2265 with scrape type 2
2026-03-29 22:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37980901-da86-559d-83e6-c8f73f7f2265 with scrape type 2
2026-03-29 22:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 37980901-da86-559d-83e6-c8f73f7f2265, identifier: KN68%20YYB
2026-03-29 22:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d8076e5d-cb8b-5578-9e3b-020e67e6d8b5 with identifier: AV03%20RSZ
2026-03-29 22:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d8076e5d-cb8b-5578-9e3b-020e67e6d8b5 with identifier: AV03%20RSZ
2026-03-29 22:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d8076e5d-cb8b-5578-9e3b-020e67e6d8b5 with identifier: AV03%20RSZ to the API
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 350,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV03%20RSZ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '4.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd8076e5d-cb8b-5578-9e3b-020e67e6d8b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV03 RSZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV03%20RSZ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'AUDI',
'model': 'RS6 AVANT',
'odometer': 109172,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-01-01',
'seller_name': None,
'title': 'AUDI RS6 AVANT 4.2 QUATTRO TIPTRONIC Estate',
'transmission': 'manual',
'trim': 'QUATTRO TIPTRONIC',
'vin': 'WUAZZZ4B93N903030',
'year': 2003}
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV03%2520RSZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:48 [bca.uk] INFO: Saving data for AV03%20RSZ: {'auction_closing_time': 1774951200.0, 'created_time': 1774735383.506329, 'last_price_update_time': 1774822008.340058}
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV03%2520RSZ') HTTP/1.1" 204 0
2026-03-29 22:06:48 [bca.uk] INFO: Found listing with ID: BV70%20UZS
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV70%2520UZS%27 HTTP/1.1" 200 None
2026-03-29 22:06:48 [bca.uk] INFO: Scrape type for BV70%20UZS: 2
2026-03-29 22:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c249da5-1d51-5bc9-a40c-4417dbaa5b62 with identifier: BV70%20UZS
2026-03-29 22:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c249da5-1d51-5bc9-a40c-4417dbaa5b62 with scrape type 2
2026-03-29 22:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c249da5-1d51-5bc9-a40c-4417dbaa5b62 with scrape type 2
2026-03-29 22:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9c249da5-1d51-5bc9-a40c-4417dbaa5b62, identifier: BV70%20UZS
2026-03-29 22:06:48 [bca.uk] INFO: Found listing with ID: DS61%20FOF
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS61%2520FOF%27 HTTP/1.1" 200 None
2026-03-29 22:06:48 [bca.uk] INFO: Scrape type for DS61%20FOF: 2
2026-03-29 22:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6 with identifier: DS61%20FOF
2026-03-29 22:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6 with scrape type 2
2026-03-29 22:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6 with scrape type 2
2026-03-29 22:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6, identifier: DS61%20FOF
2026-03-29 22:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 37980901-da86-559d-83e6-c8f73f7f2265 with identifier: KN68%20YYB
2026-03-29 22:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 37980901-da86-559d-83e6-c8f73f7f2265 with identifier: KN68%20YYB
2026-03-29 22:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 37980901-da86-559d-83e6-c8f73f7f2265 with identifier: KN68%20YYB to the API
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 106,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN68%20YYB-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '37980901-da86-559d-83e6-c8f73f7f2265',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN68 YYB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KN68%20YYB&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 32964,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'KIA PICANTO 1.2 GT-LINE S Hatchback',
'transmission': 'manual',
'trim': 'GT-LINE S',
'vin': 'KNAB3512LJT302467',
'year': 2018}
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN68%2520YYB%27 HTTP/1.1" 200 None
2026-03-29 22:06:48 [bca.uk] INFO: Saving data for KN68%20YYB: {'auction_closing_time': 1774951200.0, 'created_time': 1774735457.281008, 'last_price_update_time': 1774822008.84919}
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KN68%2520YYB') HTTP/1.1" 204 0
2026-03-29 22:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616702d0>
2026-03-29 22:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_expert_report_file_f47a1264-67a3-4d55-b88b-7d3b12df3f95.pdf HTTP/1.1" 201 0
2026-03-29 22:06:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 21e79e5d-2d1b-56fe-b8fb-2067f25370f7
2026-03-29 22:06:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21e79e5d-2d1b-56fe-b8fb-2067f25370f7, skipping ID generation
2026-03-29 22:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21e79e5d-2d1b-56fe-b8fb-2067f25370f7
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAP12HDL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AP12HDL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ58SFX/42812168?sv=2020-08-04&st=2026-03-29T22%3A06%3A32Z&se=2026-03-29T22%3A31%3A32Z&sr=b&sp=r&sig=qiTgzjDZ%2FB1Y9Jc9LI61o7EdjHjaU8RNz%2BEzvH34f2o%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:06:48 [bca.uk] INFO: Found listing with ID: GC14%20BYZ
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GC14%2520BYZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:48 [bca.uk] INFO: Scrape type for GC14%20BYZ: 2
2026-03-29 22:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcd8052e-f089-5d60-ac6b-712aed7f241e with identifier: GC14%20BYZ
2026-03-29 22:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcd8052e-f089-5d60-ac6b-712aed7f241e with scrape type 2
2026-03-29 22:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcd8052e-f089-5d60-ac6b-712aed7f241e with scrape type 2
2026-03-29 22:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fcd8052e-f089-5d60-ac6b-712aed7f241e, identifier: GC14%20BYZ
2026-03-29 22:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9c249da5-1d51-5bc9-a40c-4417dbaa5b62 with identifier: BV70%20UZS
2026-03-29 22:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9c249da5-1d51-5bc9-a40c-4417dbaa5b62 with identifier: BV70%20UZS
2026-03-29 22:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9c249da5-1d51-5bc9-a40c-4417dbaa5b62 with identifier: BV70%20UZS to the API
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV70%20UZS-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9c249da5-1d51-5bc9-a40c-4417dbaa5b62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BV70 UZS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BV70%20UZS&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'KIA',
'model': 'STONIC',
'odometer': 19252,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'KIA STONIC 1.0 T GDI 100 2 Hatchback',
'transmission': 'manual',
'trim': 'T GDI 100 2',
'vin': 'KNAD6817LM6473686',
'year': 2021}
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV70%2520UZS%27 HTTP/1.1" 200 None
2026-03-29 22:06:49 [bca.uk] INFO: Saving data for BV70%20UZS: {'auction_closing_time': 1774951200.0, 'created_time': 1774735336.641995, 'last_price_update_time': 1774822009.312145}
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BV70%2520UZS') HTTP/1.1" 204 0
2026-03-29 22:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6 with identifier: DS61%20FOF
2026-03-29 22:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6 with identifier: DS61%20FOF
2026-03-29 22:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5c3dd07d-5304-5ac0-80dc-e30cb298b7d6 with identifier: DS61%20FOF to the API
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DS61%20FOF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5c3dd07d-5304-5ac0-80dc-e30cb298b7d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DS61 FOF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DS61%20FOF&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 74718,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'RENAULT CLIO 1.2 TCE DYNAMIQUE TOM TOM Estate',
'transmission': 'manual',
'trim': 'TCE DYNAMIQUE TOM TOM',
'vin': 'VF1KRC40H46881690',
'year': 2012}
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS61%2520FOF%27 HTTP/1.1" 200 None
2026-03-29 22:06:49 [bca.uk] INFO: Saving data for DS61%20FOF: {'auction_closing_time': 1774864800.0, 'created_time': 1774735481.899983, 'last_price_update_time': 1774822009.599139}
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DS61%2520FOF') HTTP/1.1" 204 0
2026-03-29 22:06:49 [bca.uk] INFO: Found listing with ID: AU02%20VYG
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU02%2520VYG%27 HTTP/1.1" 200 None
2026-03-29 22:06:49 [bca.uk] INFO: Scrape type for AU02%20VYG: 2
2026-03-29 22:06:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f00ae92-c3a1-5f36-b822-faa77c54fc81 with identifier: AU02%20VYG
2026-03-29 22:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f00ae92-c3a1-5f36-b822-faa77c54fc81 with scrape type 2
2026-03-29 22:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f00ae92-c3a1-5f36-b822-faa77c54fc81 with scrape type 2
2026-03-29 22:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1f00ae92-c3a1-5f36-b822-faa77c54fc81, identifier: AU02%20VYG
2026-03-29 22:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM09CVU/42809722?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=IVQHrCG530q4ZNE7GeniJ3%2F1vLzKHgZru4jgYYDb%2BSY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fcd8052e-f089-5d60-ac6b-712aed7f241e with identifier: GC14%20BYZ
2026-03-29 22:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fcd8052e-f089-5d60-ac6b-712aed7f241e with identifier: GC14%20BYZ
2026-03-29 22:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fcd8052e-f089-5d60-ac6b-712aed7f241e with identifier: GC14%20BYZ to the API
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GC14%20BYZ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fcd8052e-f089-5d60-ac6b-712aed7f241e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GC14 BYZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GC14%20BYZ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 31958,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 2.0 T E/B 250 ST-2 Hatchback',
'transmission': 'manual',
'trim': 'T E/B 250 ST-2',
'vin': 'WF0KXXGCBKEM32085',
'year': 2014}
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GC14%2520BYZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:49 [bca.uk] INFO: Saving data for GC14%20BYZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774621670.131004, 'last_price_update_time': 1774822009.997512}
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GC14%2520BYZ') HTTP/1.1" 204 0
2026-03-29 22:06:50 [bca.uk] INFO: Found listing with ID: DG14%20YNA
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG14%2520YNA%27 HTTP/1.1" 200 None
2026-03-29 22:06:50 [bca.uk] INFO: Scrape type for DG14%20YNA: 2
2026-03-29 22:06:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 238a280e-8233-56ab-b3e9-1e6814e8a2fb with identifier: DG14%20YNA
2026-03-29 22:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 238a280e-8233-56ab-b3e9-1e6814e8a2fb with scrape type 2
2026-03-29 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 238a280e-8233-56ab-b3e9-1e6814e8a2fb with scrape type 2
2026-03-29 22:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 238a280e-8233-56ab-b3e9-1e6814e8a2fb, identifier: DG14%20YNA
2026-03-29 22:06:50 [bca.uk] INFO: Found listing with ID: LT64%20JYY
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT64%2520JYY%27 HTTP/1.1" 200 None
2026-03-29 22:06:50 [bca.uk] INFO: Scrape type for LT64%20JYY: 2
2026-03-29 22:06:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e23659de-a271-571f-ad29-745e3ce94452 with identifier: LT64%20JYY
2026-03-29 22:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e23659de-a271-571f-ad29-745e3ce94452 with scrape type 2
2026-03-29 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e23659de-a271-571f-ad29-745e3ce94452 with scrape type 2
2026-03-29 22:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e23659de-a271-571f-ad29-745e3ce94452, identifier: LT64%20JYY
2026-03-29 22:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1f00ae92-c3a1-5f36-b822-faa77c54fc81 with identifier: AU02%20VYG
2026-03-29 22:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1f00ae92-c3a1-5f36-b822-faa77c54fc81 with identifier: AU02%20VYG
2026-03-29 22:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1f00ae92-c3a1-5f36-b822-faa77c54fc81 with identifier: AU02%20VYG to the API
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 181,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AU02%20VYG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1f00ae92-c3a1-5f36-b822-faa77c54fc81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AU02 VYG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AU02%20VYG&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'TOYOTA',
'model': 'COROLLA VERSO',
'odometer': 109191,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-01-01',
'seller_name': None,
'title': 'TOYOTA COROLLA VERSO 1.8 VVTI T SPIRIT MPV',
'transmission': 'manual',
'trim': 'VVTI T SPIRIT',
'vin': 'JTDER28E903032385',
'year': 2002}
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU02%2520VYG%27 HTTP/1.1" 200 None
2026-03-29 22:06:50 [bca.uk] INFO: Saving data for AU02%20VYG: {'auction_closing_time': 1774864800.0, 'created_time': 1774735467.03251, 'last_price_update_time': 1774822010.499586}
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AU02%2520VYG') HTTP/1.1" 204 0
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699103824%27 HTTP/1.1" 200 None
2026-03-29 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103824 not downloaded yet
2026-03-29 22:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac612d1510>
2026-03-29 22:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_expert_report_file_c429b8da-da45-4adc-87ad-bc8404376fbf.pdf HTTP/1.1" 201 0
2026-03-29 22:06:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5674dd98-879a-5bc0-92a6-049abdc5f932
2026-03-29 22:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5674dd98-879a-5bc0-92a6-049abdc5f932, skipping ID generation
2026-03-29 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5674dd98-879a-5bc0-92a6-049abdc5f932
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDE56AOD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DE56AOD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac60f41a90>
2026-03-29 22:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_expert_report_file_3920aafd-0ba9-48bf-b19a-6a01605b856d.pdf HTTP/1.1" 201 0
2026-03-29 22:06:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 49025c6e-c82c-5ad9-a984-dc586f875105
2026-03-29 22:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49025c6e-c82c-5ad9-a984-dc586f875105, skipping ID generation
2026-03-29 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49025c6e-c82c-5ad9-a984-dc586f875105
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWP66PGE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WP66PGE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac60f49a90>
2026-03-29 22:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_expert_report_file_da286475-434b-4545-8f8b-dd494f2a9a0b.pdf HTTP/1.1" 201 0
2026-03-29 22:06:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4de1def5-9fea-59aa-8472-dafc14cac3a1
2026-03-29 22:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4de1def5-9fea-59aa-8472-dafc14cac3a1, skipping ID generation
2026-03-29 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4de1def5-9fea-59aa-8472-dafc14cac3a1
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPJ08SVR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PJ08SVR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR60HNV/42810656?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=iTeyX7WgAxvLftpE%2F2dkTmhR4Qwoz4r3xCUieQTYJOM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 22:06:50 [crawlers.middlewares.report_download_middleware] WARNING: Failed to download report for item 8381a489-d71d-5bac-8258-1ea17ff7795d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8003 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 22:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8381a489-d71d-5bac-8258-1ea17ff7795d with identifier: PE64%20HPL
2026-03-29 22:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8381a489-d71d-5bac-8258-1ea17ff7795d with identifier: PE64%20HPL
2026-03-29 22:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8381a489-d71d-5bac-8258-1ea17ff7795d with identifier: PE64%20HPL to the API
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:51 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8003 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PE64%20HPL-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8381a489-d71d-5bac-8258-1ea17ff7795d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PE64 HPL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PE64%20HPL&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MAZDA',
'model': 'CX-5',
'odometer': 87534,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PE64HPL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427732',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427745',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427762',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427777',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427794',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427800',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427820',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427849',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427862',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427881'],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MAZDA CX-5 2.2 D 150 SE-L AWD StationWagon',
'transmission': 'automatic',
'trim': 'D 150 SE-L AWD',
'vin': 'JMZKEN91800171367',
'year': 2014}
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE64%2520HPL%27 HTTP/1.1" 200 None
2026-03-29 22:06:51 [bca.uk] INFO: Saving data for PE64%20HPL: {'created_time': 1774822011.106566, 'last_price_update_time': 1774822011.106581, 'auction_closing_time': 1774951200.0}
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PE64%2520HPL') HTTP/1.1" 204 0
2026-03-29 22:06:51 [bca.uk] INFO: Found listing with ID: GJ09%20KHA
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ09%2520KHA%27 HTTP/1.1" 200 None
2026-03-29 22:06:51 [bca.uk] INFO: Scrape type for GJ09%20KHA: 2
2026-03-29 22:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4b8e4ec-0fff-5766-bf2c-1dd6848b6a5f with identifier: GJ09%20KHA
2026-03-29 22:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4b8e4ec-0fff-5766-bf2c-1dd6848b6a5f with scrape type 2
2026-03-29 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4b8e4ec-0fff-5766-bf2c-1dd6848b6a5f with scrape type 2
2026-03-29 22:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f4b8e4ec-0fff-5766-bf2c-1dd6848b6a5f, identifier: GJ09%20KHA
2026-03-29 22:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 238a280e-8233-56ab-b3e9-1e6814e8a2fb with identifier: DG14%20YNA
2026-03-29 22:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 238a280e-8233-56ab-b3e9-1e6814e8a2fb with identifier: DG14%20YNA
2026-03-29 22:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 238a280e-8233-56ab-b3e9-1e6814e8a2fb with identifier: DG14%20YNA to the API
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DG14%20YNA-GB',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '238a280e-8233-56ab-b3e9-1e6814e8a2fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DG14 YNA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DG14%20YNA&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VAUXHALL',
'model': 'ADAM',
'odometer': 51603,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL ADAM 1.4 VVT 100 SLAM Hatchback',
'transmission': 'manual',
'trim': 'VVT 100 SLAM',
'vin': 'W0L0MAP08E6040602',
'year': 2014}
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG14%2520YNA%27 HTTP/1.1" 200 None
2026-03-29 22:06:51 [bca.uk] INFO: Saving data for DG14%20YNA: {'auction_closing_time': 1774951200.0, 'created_time': 1774735336.207233, 'last_price_update_time': 1774822011.589076}
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DG14%2520YNA') HTTP/1.1" 204 0
2026-03-29 22:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e23659de-a271-571f-ad29-745e3ce94452 with identifier: LT64%20JYY
2026-03-29 22:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e23659de-a271-571f-ad29-745e3ce94452 with identifier: LT64%20JYY
2026-03-29 22:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e23659de-a271-571f-ad29-745e3ce94452 with identifier: LT64%20JYY to the API
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT64%20JYY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e23659de-a271-571f-ad29-745e3ce94452',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT64 JYY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT64%20JYY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SUZUKI',
'model': 'ALTO',
'odometer': 68003,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'SUZUKI ALTO 1.0 SZ Hatchback',
'transmission': 'manual',
'trim': 'SZ',
'vin': 'MA3GFC31S00741356',
'year': 2014}
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT64%2520JYY%27 HTTP/1.1" 200 None
2026-03-29 22:06:51 [bca.uk] INFO: Saving data for LT64%20JYY: {'auction_closing_time': 1774864800.0, 'created_time': 1774735481.496694, 'last_price_update_time': 1774822011.868204}
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT64%2520JYY') HTTP/1.1" 204 0
2026-03-29 22:06:51 [bca.uk] INFO: Found listing with ID: BF18%20GZO
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF18%2520GZO%27 HTTP/1.1" 200 None
2026-03-29 22:06:51 [bca.uk] INFO: Scrape type for BF18%20GZO: 0
2026-03-29 22:06:51 [bca.uk] INFO: Found listing with ID: RF61%20EUB
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF61%2520EUB%27 HTTP/1.1" 200 None
2026-03-29 22:06:51 [bca.uk] INFO: Scrape type for RF61%20EUB: 0
2026-03-29 22:06:51 [bca.uk] INFO: Found listing with ID: FE68%20XBZ
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE68%2520XBZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:51 [bca.uk] INFO: Scrape type for FE68%20XBZ: 0
2026-03-29 22:06:51 [bca.uk] INFO: Found listing with ID: SP15%20VFV
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP15%2520VFV%27 HTTP/1.1" 200 None
2026-03-29 22:06:51 [bca.uk] INFO: Scrape type for SP15%20VFV: 2
2026-03-29 22:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74bb0eb2-42f3-5cb2-b21b-580137f2554b with identifier: SP15%20VFV
2026-03-29 22:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74bb0eb2-42f3-5cb2-b21b-580137f2554b with scrape type 2
2026-03-29 22:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74bb0eb2-42f3-5cb2-b21b-580137f2554b with scrape type 2
2026-03-29 22:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 74bb0eb2-42f3-5cb2-b21b-580137f2554b, identifier: SP15%20VFV
2026-03-29 22:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f4b8e4ec-0fff-5766-bf2c-1dd6848b6a5f with identifier: GJ09%20KHA
2026-03-29 22:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f4b8e4ec-0fff-5766-bf2c-1dd6848b6a5f with identifier: GJ09%20KHA
2026-03-29 22:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f4b8e4ec-0fff-5766-bf2c-1dd6848b6a5f with identifier: GJ09%20KHA to the API
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ09%20KHA-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f4b8e4ec-0fff-5766-bf2c-1dd6848b6a5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ09 KHA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ09%20KHA&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'CITROEN',
'model': 'C4 PICASSO',
'odometer': 56631,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'CITROEN C4 PICASSO 1.6 HDI 110 VTR+ EGS MPV',
'transmission': 'automatic',
'trim': 'HDI 110 VTR+ EGS',
'vin': 'VF7UD9HZH45398350',
'year': 2009}
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ09%2520KHA%27 HTTP/1.1" 200 None
2026-03-29 22:06:52 [bca.uk] INFO: Saving data for GJ09%20KHA: {'auction_closing_time': 1774864800.0, 'created_time': 1774620808.47365, 'last_price_update_time': 1774822012.34806}
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ09%2520KHA') HTTP/1.1" 204 0
2026-03-29 22:06:52 [bca.uk] INFO: Found listing with ID: LN07%20YUR
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN07%2520YUR%27 HTTP/1.1" 200 None
2026-03-29 22:06:52 [bca.uk] INFO: Scrape type for LN07%20YUR: 2
2026-03-29 22:06:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20c106fd-0836-5717-a42b-17b79fbe25e4 with identifier: LN07%20YUR
2026-03-29 22:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20c106fd-0836-5717-a42b-17b79fbe25e4 with scrape type 2
2026-03-29 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20c106fd-0836-5717-a42b-17b79fbe25e4 with scrape type 2
2026-03-29 22:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 20c106fd-0836-5717-a42b-17b79fbe25e4, identifier: LN07%20YUR
2026-03-29 22:06:52 [bca.uk] INFO: Found listing with ID: MA61%20BFY
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA61%2520BFY%27 HTTP/1.1" 200 None
2026-03-29 22:06:52 [bca.uk] INFO: Scrape type for MA61%20BFY: 2
2026-03-29 22:06:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a with identifier: MA61%20BFY
2026-03-29 22:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a with scrape type 2
2026-03-29 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a with scrape type 2
2026-03-29 22:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a, identifier: MA61%20BFY
2026-03-29 22:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 74bb0eb2-42f3-5cb2-b21b-580137f2554b with identifier: SP15%20VFV
2026-03-29 22:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 74bb0eb2-42f3-5cb2-b21b-580137f2554b with identifier: SP15%20VFV
2026-03-29 22:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 74bb0eb2-42f3-5cb2-b21b-580137f2554b with identifier: SP15%20VFV to the API
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': None,
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '74bb0eb2-42f3-5cb2-b21b-580137f2554b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP15 VFV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP15%20VFV&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 71501,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 2.0 TDI 184 GTD Hatchback',
'transmission': 'manual',
'trim': 'TDI 184 GTD',
'vin': 'WVWZZZAUZFW131334',
'year': 2015}
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP15%2520VFV%27 HTTP/1.1" 200 None
2026-03-29 22:06:52 [bca.uk] INFO: Saving data for SP15%20VFV: {'auction_closing_time': 1775037600.0, 'created_time': 1774735462.340921, 'last_price_update_time': 1774822012.943434}
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP15%2520VFV') HTTP/1.1" 204 0
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699103826%27 HTTP/1.1" 200 None
2026-03-29 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103826 not downloaded yet
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430105%27 HTTP/1.1" 200 None
2026-03-29 22:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430105 not downloaded yet
2026-03-29 22:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699139508%27 HTTP/1.1" 200 None
2026-03-29 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139508 not downloaded yet
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430095%27 HTTP/1.1" 200 None
2026-03-29 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430095 not downloaded yet
2026-03-29 22:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620d6910>
2026-03-29 22:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_expert_report_file_8bfdc0c0-3c3b-495e-b0e7-235ac7cd5b0b.pdf HTTP/1.1" 201 0
2026-03-29 22:06:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5063d79c-4147-5ce9-b414-8b0ccabfea0d
2026-03-29 22:06:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5063d79c-4147-5ce9-b414-8b0ccabfea0d, skipping ID generation
2026-03-29 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5063d79c-4147-5ce9-b414-8b0ccabfea0d
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNJ58SFX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NJ58SFX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:06:53 [crawlers.middlewares.report_download_middleware] WARNING: Failed to download report for item 640919bc-7e76-59be-ab2e-d1156d9a5725 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8003 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 22:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 640919bc-7e76-59be-ab2e-d1156d9a5725 with identifier: PN54%20OAL
2026-03-29 22:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 640919bc-7e76-59be-ab2e-d1156d9a5725 with identifier: PN54%20OAL
2026-03-29 22:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 640919bc-7e76-59be-ab2e-d1156d9a5725 with identifier: PN54%20OAL to the API
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:53 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8003 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 160,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PN54%20OAL-GB',
'category': 'Car',
'color': 'gold',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '640919bc-7e76-59be-ab2e-d1156d9a5725',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PN54 OAL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PN54%20OAL&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'ALMERA',
'odometer': 101142,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PN54OAL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430127',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430139',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430145',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430158',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430179',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430203',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430244',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430274',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430299',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430315'],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'NISSAN ALMERA 1.5 SVE Hatchback',
'transmission': 'manual',
'trim': 'SVE',
'vin': 'SJNFAAN16U0545868',
'year': 2005}
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN54%2520OAL%27 HTTP/1.1" 200 None
2026-03-29 22:06:53 [bca.uk] INFO: Saving data for PN54%20OAL: {'created_time': 1774822013.443561, 'last_price_update_time': 1774822013.443571, 'auction_closing_time': 1774951200.0}
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PN54%2520OAL') HTTP/1.1" 204 0
2026-03-29 22:06:53 [bca.uk] INFO: Found listing with ID: GK60%20ZSE
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK60%2520ZSE%27 HTTP/1.1" 200 None
2026-03-29 22:06:53 [bca.uk] INFO: Scrape type for GK60%20ZSE: 0
2026-03-29 22:06:53 [bca.uk] INFO: Found listing with ID: LO10%20GWV
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO10%2520GWV%27 HTTP/1.1" 200 None
2026-03-29 22:06:53 [bca.uk] INFO: Scrape type for LO10%20GWV: 2
2026-03-29 22:06:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0f5e6c9-06ba-5b09-9ec6-f7043019979d with identifier: LO10%20GWV
2026-03-29 22:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0f5e6c9-06ba-5b09-9ec6-f7043019979d with scrape type 2
2026-03-29 22:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0f5e6c9-06ba-5b09-9ec6-f7043019979d with scrape type 2
2026-03-29 22:06:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a0f5e6c9-06ba-5b09-9ec6-f7043019979d, identifier: LO10%20GWV
2026-03-29 22:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 20c106fd-0836-5717-a42b-17b79fbe25e4 with identifier: LN07%20YUR
2026-03-29 22:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 20c106fd-0836-5717-a42b-17b79fbe25e4 with identifier: LN07%20YUR
2026-03-29 22:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 20c106fd-0836-5717-a42b-17b79fbe25e4 with identifier: LN07%20YUR to the API
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LN07%20YUR-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '20c106fd-0836-5717-a42b-17b79fbe25e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LN07 YUR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LN07%20YUR&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 44068,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.4 I-DSI SE I-SHIFT Hatchback',
'transmission': 'automatic',
'trim': 'I-DSI SE I-SHIFT',
'vin': 'SHHFK18407U008788',
'year': 2007}
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN07%2520YUR%27 HTTP/1.1" 200 None
2026-03-29 22:06:53 [bca.uk] INFO: Saving data for LN07%20YUR: {'auction_closing_time': 1774951200.0, 'created_time': 1774735396.675031, 'last_price_update_time': 1774822013.89727}
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LN07%2520YUR') HTTP/1.1" 204 0
2026-03-29 22:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a with identifier: MA61%20BFY
2026-03-29 22:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a with identifier: MA61%20BFY
2026-03-29 22:06:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4baa05ed-fc6d-5ddf-8f83-9a745e89a05a with identifier: MA61%20BFY to the API
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA61%20BFY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4baa05ed-fc6d-5ddf-8f83-9a745e89a05a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA61 BFY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MA61%20BFY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 116145,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'FORD MONDEO 1.6 TDCI ECO ZETEC S/S Hatchback',
'transmission': 'manual',
'trim': 'TDCI ECO ZETEC S/S',
'vin': 'WF0EXXGBBEBT63753',
'year': 2011}
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA61%2520BFY%27 HTTP/1.1" 200 None
2026-03-29 22:06:54 [bca.uk] INFO: Saving data for MA61%20BFY: {'auction_closing_time': 1774864800.0, 'created_time': 1774735480.64757, 'last_price_update_time': 1774822014.1963}
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MA61%2520BFY') HTTP/1.1" 204 0
2026-03-29 22:06:54 [bca.uk] INFO: Found listing with ID: ST64%20MMV
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST64%2520MMV%27 HTTP/1.1" 200 None
2026-03-29 22:06:54 [bca.uk] INFO: Scrape type for ST64%20MMV: 2
2026-03-29 22:06:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c98b2cc3-a1ec-5194-ae49-df6d05e42077 with identifier: ST64%20MMV
2026-03-29 22:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c98b2cc3-a1ec-5194-ae49-df6d05e42077 with scrape type 2
2026-03-29 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c98b2cc3-a1ec-5194-ae49-df6d05e42077 with scrape type 2
2026-03-29 22:06:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c98b2cc3-a1ec-5194-ae49-df6d05e42077, identifier: ST64%20MMV
2026-03-29 22:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac60f9d990>
2026-03-29 22:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_expert_report_file_58441138-33b7-4ee8-8dd0-3dcd1a4d81e9.pdf HTTP/1.1" 201 0
2026-03-29 22:06:54 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ad76e9a4-0e7d-56af-9a84-3fd65281fde6
2026-03-29 22:06:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad76e9a4-0e7d-56af-9a84-3fd65281fde6, skipping ID generation
2026-03-29 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad76e9a4-0e7d-56af-9a84-3fd65281fde6
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLM09CVU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM09CVU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:06:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a0f5e6c9-06ba-5b09-9ec6-f7043019979d with identifier: LO10%20GWV
2026-03-29 22:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a0f5e6c9-06ba-5b09-9ec6-f7043019979d with identifier: LO10%20GWV
2026-03-29 22:06:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a0f5e6c9-06ba-5b09-9ec6-f7043019979d with identifier: LO10%20GWV to the API
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO10%20GWV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a0f5e6c9-06ba-5b09-9ec6-f7043019979d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LO10 GWV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LO10%20GWV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 106149,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.4 85 SE DSG Hatchback',
'transmission': 'automatic',
'trim': '85 SE DSG',
'vin': 'WVWZZZ6RZAY271820',
'year': 2010}
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO10%2520GWV%27 HTTP/1.1" 200 None
2026-03-29 22:06:54 [bca.uk] INFO: Saving data for LO10%20GWV: {'auction_closing_time': 1774864800.0, 'created_time': 1774621670.893105, 'last_price_update_time': 1774822014.728022}
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LO10%2520GWV') HTTP/1.1" 204 0
2026-03-29 22:06:54 [bca.uk] INFO: Found listing with ID: WV18%20WXN
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV18%2520WXN%27 HTTP/1.1" 200 None
2026-03-29 22:06:54 [bca.uk] INFO: Scrape type for WV18%20WXN: 2
2026-03-29 22:06:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9706080c-71c1-5f73-bc14-083fec0112e7 with identifier: WV18%20WXN
2026-03-29 22:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9706080c-71c1-5f73-bc14-083fec0112e7 with scrape type 2
2026-03-29 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9706080c-71c1-5f73-bc14-083fec0112e7 with scrape type 2
2026-03-29 22:06:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9706080c-71c1-5f73-bc14-083fec0112e7, identifier: WV18%20WXN
2026-03-29 22:06:54 [bca.uk] INFO: Found listing with ID: MT12%20LJZ
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT12%2520LJZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:54 [bca.uk] INFO: Scrape type for MT12%20LJZ: 2
2026-03-29 22:06:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2a7ebc8-3779-5484-8073-7a1c6fb87969 with identifier: MT12%20LJZ
2026-03-29 22:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2a7ebc8-3779-5484-8073-7a1c6fb87969 with scrape type 2
2026-03-29 22:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2a7ebc8-3779-5484-8073-7a1c6fb87969 with scrape type 2
2026-03-29 22:06:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c2a7ebc8-3779-5484-8073-7a1c6fb87969, identifier: MT12%20LJZ
2026-03-29 22:06:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c98b2cc3-a1ec-5194-ae49-df6d05e42077 with identifier: ST64%20MMV
2026-03-29 22:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c98b2cc3-a1ec-5194-ae49-df6d05e42077 with identifier: ST64%20MMV
2026-03-29 22:06:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c98b2cc3-a1ec-5194-ae49-df6d05e42077 with identifier: ST64%20MMV to the API
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': None,
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c98b2cc3-a1ec-5194-ae49-df6d05e42077',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ST64 MMV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ST64%20MMV&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow',
'make': 'VOLKSWAGEN',
'model': 'GOLF SV',
'odometer': 103184,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF SV 1.4 TSI 125 SE MPV',
'transmission': 'manual',
'trim': 'TSI 125 SE',
'vin': 'WVWZZZAUZFW557996',
'year': 2014}
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST64%2520MMV%27 HTTP/1.1" 200 None
2026-03-29 22:06:55 [bca.uk] INFO: Saving data for ST64%20MMV: {'auction_closing_time': 1775210400.0, 'created_time': 1774735456.103646, 'last_price_update_time': 1774822015.242076}
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ST64%2520MMV') HTTP/1.1" 204 0
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699103831%27 HTTP/1.1" 200 None
2026-03-29 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103831 not downloaded yet
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427714%27 HTTP/1.1" 200 None
2026-03-29 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427714 not downloaded yet
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699139514%27 HTTP/1.1" 200 None
2026-03-29 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139514 not downloaded yet
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430098%27 HTTP/1.1" 200 None
2026-03-29 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430098 not downloaded yet
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435122%27 HTTP/1.1" 200 None
2026-03-29 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435122 not downloaded yet
2026-03-29 22:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac60fce210>
2026-03-29 22:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_expert_report_file_2d963a44-3fc3-4627-a4ec-0100048ccbce.pdf HTTP/1.1" 201 0
2026-03-29 22:06:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1a63c92f-88a3-5364-8028-ccaa89112c46
2026-03-29 22:06:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a63c92f-88a3-5364-8028-ccaa89112c46, skipping ID generation
2026-03-29 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a63c92f-88a3-5364-8028-ccaa89112c46
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWR60HNV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WR60HNV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 22:06:55 [bca.uk] INFO: Found listing with ID: PY60%20HJF
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY60%2520HJF%27 HTTP/1.1" 200 None
2026-03-29 22:06:55 [bca.uk] INFO: Scrape type for PY60%20HJF: 2
2026-03-29 22:06:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3059609-afec-5b3f-8103-70b92c282897 with identifier: PY60%20HJF
2026-03-29 22:06:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3059609-afec-5b3f-8103-70b92c282897 with scrape type 2
2026-03-29 22:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3059609-afec-5b3f-8103-70b92c282897 with scrape type 2
2026-03-29 22:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e3059609-afec-5b3f-8103-70b92c282897, identifier: PY60%20HJF
2026-03-29 22:06:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9706080c-71c1-5f73-bc14-083fec0112e7 with identifier: WV18%20WXN
2026-03-29 22:06:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9706080c-71c1-5f73-bc14-083fec0112e7 with identifier: WV18%20WXN
2026-03-29 22:06:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9706080c-71c1-5f73-bc14-083fec0112e7 with identifier: WV18%20WXN to the API
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 132,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV18%20WXN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9706080c-71c1-5f73-bc14-083fec0112e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WV18 WXN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WV18%20WXN&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MERCEDES-BENZ',
'model': 'A200',
'odometer': 31268,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A200 1.6 AMG LINE EXECUTIVE Hatchback',
'transmission': 'manual',
'trim': 'AMG LINE EXECUTIVE',
'vin': 'WDD1760432J768742',
'year': 2018}
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV18%2520WXN%27 HTTP/1.1" 200 None
2026-03-29 22:06:55 [bca.uk] INFO: Saving data for WV18%20WXN: {'auction_closing_time': 1774951200.0, 'created_time': 1774735396.288996, 'last_price_update_time': 1774822015.797649}
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WV18%2520WXN') HTTP/1.1" 204 0
2026-03-29 22:06:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c2a7ebc8-3779-5484-8073-7a1c6fb87969 with identifier: MT12%20LJZ
2026-03-29 22:06:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c2a7ebc8-3779-5484-8073-7a1c6fb87969 with identifier: MT12%20LJZ
2026-03-29 22:06:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c2a7ebc8-3779-5484-8073-7a1c6fb87969 with identifier: MT12%20LJZ to the API
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT12%20LJZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c2a7ebc8-3779-5484-8073-7a1c6fb87969',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT12 LJZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT12%20LJZ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 74492,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.5 DCI 110 ACENTA Hatchback',
'transmission': 'manual',
'trim': 'DCI 110 ACENTA',
'vin': 'SJNFCAJ10U2586169',
'year': 2012}
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT12%2520LJZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:56 [bca.uk] INFO: Saving data for MT12%20LJZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774735479.542659, 'last_price_update_time': 1774822016.096049}
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT12%2520LJZ') HTTP/1.1" 204 0
2026-03-29 22:06:56 [bca.uk] INFO: Found listing with ID: AF20%20XNC
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF20%2520XNC%27 HTTP/1.1" 200 None
2026-03-29 22:06:56 [bca.uk] INFO: Scrape type for AF20%20XNC: 2
2026-03-29 22:06:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78b0421d-18ef-5012-9f9a-61cd23cc4cf6 with identifier: AF20%20XNC
2026-03-29 22:06:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78b0421d-18ef-5012-9f9a-61cd23cc4cf6 with scrape type 2
2026-03-29 22:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78b0421d-18ef-5012-9f9a-61cd23cc4cf6 with scrape type 2
2026-03-29 22:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 78b0421d-18ef-5012-9f9a-61cd23cc4cf6, identifier: AF20%20XNC
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699124359%27 HTTP/1.1" 200 None
2026-03-29 22:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124359 not downloaded yet
2026-03-29 22:06:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e3059609-afec-5b3f-8103-70b92c282897 with identifier: PY60%20HJF
2026-03-29 22:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e3059609-afec-5b3f-8103-70b92c282897 with identifier: PY60%20HJF
2026-03-29 22:06:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e3059609-afec-5b3f-8103-70b92c282897 with identifier: PY60%20HJF to the API
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PY60%20HJF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e3059609-afec-5b3f-8103-70b92c282897',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PY60 HJF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PY60%20HJF&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MAZDA',
'model': '2',
'odometer': 59802,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'MAZDA 2 1.3 TAMURA Hatchback',
'transmission': 'manual',
'trim': 'TAMURA',
'vin': 'JMZDEA4J200403062',
'year': 2011}
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY60%2520HJF%27 HTTP/1.1" 200 None
2026-03-29 22:06:56 [bca.uk] INFO: Saving data for PY60%20HJF: {'auction_closing_time': 1774864800.0, 'created_time': 1774622490.854148, 'last_price_update_time': 1774822016.530716}
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PY60%2520HJF') HTTP/1.1" 204 0
2026-03-29 22:06:56 [bca.uk] INFO: Found listing with ID: WJ15%20ZVL
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ15%2520ZVL%27 HTTP/1.1" 200 None
2026-03-29 22:06:56 [bca.uk] INFO: Scrape type for WJ15%20ZVL: 2
2026-03-29 22:06:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ec8d1eb-2bf1-50ab-b27b-39402c98fc53 with identifier: WJ15%20ZVL
2026-03-29 22:06:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec8d1eb-2bf1-50ab-b27b-39402c98fc53 with scrape type 2
2026-03-29 22:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ec8d1eb-2bf1-50ab-b27b-39402c98fc53 with scrape type 2
2026-03-29 22:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4ec8d1eb-2bf1-50ab-b27b-39402c98fc53, identifier: WJ15%20ZVL
2026-03-29 22:06:56 [bca.uk] INFO: Found listing with ID: YP11%20SXG
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP11%2520SXG%27 HTTP/1.1" 200 None
2026-03-29 22:06:56 [bca.uk] INFO: Scrape type for YP11%20SXG: 2
2026-03-29 22:06:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13188273-241e-5122-a324-f170682054c3 with identifier: YP11%20SXG
2026-03-29 22:06:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13188273-241e-5122-a324-f170682054c3 with scrape type 2
2026-03-29 22:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13188273-241e-5122-a324-f170682054c3 with scrape type 2
2026-03-29 22:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 13188273-241e-5122-a324-f170682054c3, identifier: YP11%20SXG
2026-03-29 22:06:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 78b0421d-18ef-5012-9f9a-61cd23cc4cf6 with identifier: AF20%20XNC
2026-03-29 22:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 78b0421d-18ef-5012-9f9a-61cd23cc4cf6 with identifier: AF20%20XNC
2026-03-29 22:06:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 78b0421d-18ef-5012-9f9a-61cd23cc4cf6 with identifier: AF20%20XNC to the API
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF20%20XNC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '78b0421d-18ef-5012-9f9a-61cd23cc4cf6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF20 XNC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF20%20XNC&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'BMW',
'model': '118I',
'odometer': 81844,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'BMW 118I 1.5 SPORT STEP Hatchback',
'transmission': 'automatic',
'trim': 'SPORT STEP',
'vin': 'WBA7K320505R60339',
'year': 2020}
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF20%2520XNC%27 HTTP/1.1" 200 None
2026-03-29 22:06:57 [bca.uk] INFO: Saving data for AF20%20XNC: {'auction_closing_time': 1774951200.0, 'created_time': 1774735431.630673, 'last_price_update_time': 1774822017.076586}
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF20%2520XNC') HTTP/1.1" 204 0
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699103834%27 HTTP/1.1" 200 None
2026-03-29 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103834 not downloaded yet
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430122%27 HTTP/1.1" 200 None
2026-03-29 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430122 not downloaded yet
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699139522%27 HTTP/1.1" 200 None
2026-03-29 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139522 not downloaded yet
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430136%27 HTTP/1.1" 200 None
2026-03-29 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430136 not downloaded yet
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435134%27 HTTP/1.1" 200 None
2026-03-29 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435134 not downloaded yet
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146881%27 HTTP/1.1" 200 None
2026-03-29 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146881 not downloaded yet
2026-03-29 22:06:57 [bca.uk] INFO: Found listing with ID: SM62%20CJZ
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM62%2520CJZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:57 [bca.uk] INFO: Scrape type for SM62%20CJZ: 0
2026-03-29 22:06:57 [bca.uk] INFO: Found listing with ID: FV69%20BJO
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV69%2520BJO%27 HTTP/1.1" 200 None
2026-03-29 22:06:57 [bca.uk] INFO: Scrape type for FV69%20BJO: 2
2026-03-29 22:06:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbce9e71-f6f9-5b70-87a1-2cf7e0368db6 with identifier: FV69%20BJO
2026-03-29 22:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbce9e71-f6f9-5b70-87a1-2cf7e0368db6 with scrape type 2
2026-03-29 22:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbce9e71-f6f9-5b70-87a1-2cf7e0368db6 with scrape type 2
2026-03-29 22:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fbce9e71-f6f9-5b70-87a1-2cf7e0368db6, identifier: FV69%20BJO
2026-03-29 22:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4ec8d1eb-2bf1-50ab-b27b-39402c98fc53 with identifier: WJ15%20ZVL
2026-03-29 22:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4ec8d1eb-2bf1-50ab-b27b-39402c98fc53 with identifier: WJ15%20ZVL
2026-03-29 22:06:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4ec8d1eb-2bf1-50ab-b27b-39402c98fc53 with identifier: WJ15%20ZVL to the API
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ15%20ZVL-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4ec8d1eb-2bf1-50ab-b27b-39402c98fc53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ15 ZVL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ15%20ZVL&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MINI',
'model': 'COOPER',
'odometer': 99528,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MINI COOPER 2.0 230 JOHN COOPER WORKS Hatchback',
'transmission': 'automatic',
'trim': '230 JOHN COOPER WORKS',
'vin': 'WMWXM920102A28169',
'year': 2015}
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ15%2520ZVL%27 HTTP/1.1" 200 None
2026-03-29 22:06:57 [bca.uk] INFO: Saving data for WJ15%20ZVL: {'auction_closing_time': 1774864800.0, 'created_time': 1774044474.914507, 'last_price_update_time': 1774822017.74481}
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ15%2520ZVL') HTTP/1.1" 204 0
2026-03-29 22:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 13188273-241e-5122-a324-f170682054c3 with identifier: YP11%20SXG
2026-03-29 22:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 13188273-241e-5122-a324-f170682054c3 with identifier: YP11%20SXG
2026-03-29 22:06:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 13188273-241e-5122-a324-f170682054c3 with identifier: YP11%20SXG to the API
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YP11%20SXG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '13188273-241e-5122-a324-f170682054c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YP11 SXG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YP11%20SXG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLVO',
'model': 'C30',
'odometer': 122078,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'VOLVO C30 1.6 DRIVE 115 SE Coupe',
'transmission': 'manual',
'trim': 'DRIVE 115 SE',
'vin': 'YV1MK84F1C2265293',
'year': 2011}
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP11%2520SXG%27 HTTP/1.1" 200 None
2026-03-29 22:06:58 [bca.uk] INFO: Saving data for YP11%20SXG: {'auction_closing_time': 1774864800.0, 'created_time': 1774735477.987162, 'last_price_update_time': 1774822018.033225}
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YP11%2520SXG') HTTP/1.1" 204 0
2026-03-29 22:06:58 [bca.uk] INFO: Found listing with ID: LX62%20RKE
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX62%2520RKE%27 HTTP/1.1" 200 None
2026-03-29 22:06:58 [bca.uk] INFO: Scrape type for LX62%20RKE: 2
2026-03-29 22:06:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ad57269-af6f-5f89-b6bd-0f6f92938d2b with identifier: LX62%20RKE
2026-03-29 22:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ad57269-af6f-5f89-b6bd-0f6f92938d2b with scrape type 2
2026-03-29 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ad57269-af6f-5f89-b6bd-0f6f92938d2b with scrape type 2
2026-03-29 22:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2ad57269-af6f-5f89-b6bd-0f6f92938d2b, identifier: LX62%20RKE
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699124362%27 HTTP/1.1" 200 None
2026-03-29 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124362 not downloaded yet
2026-03-29 22:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fbce9e71-f6f9-5b70-87a1-2cf7e0368db6 with identifier: FV69%20BJO
2026-03-29 22:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fbce9e71-f6f9-5b70-87a1-2cf7e0368db6 with identifier: FV69%20BJO
2026-03-29 22:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fbce9e71-f6f9-5b70-87a1-2cf7e0368db6 with identifier: FV69%20BJO to the API
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FV69%20BJO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fbce9e71-f6f9-5b70-87a1-2cf7e0368db6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FV69 BJO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FV69%20BJO&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MAZDA',
'model': '3',
'odometer': 67242,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MAZDA 3 2.0 SKY-X SPORT LUX Hatchback',
'transmission': 'manual',
'trim': 'SKY-X SPORT LUX',
'vin': 'JMZBP6HH601133053',
'year': 2019}
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV69%2520BJO%27 HTTP/1.1" 200 None
2026-03-29 22:06:58 [bca.uk] INFO: Saving data for FV69%20BJO: {'auction_closing_time': 1774951200.0, 'created_time': 1774735392.541278, 'last_price_update_time': 1774822018.428422}
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FV69%2520BJO') HTTP/1.1" 204 0
2026-03-29 22:06:58 [bca.uk] INFO: Found listing with ID: VO16%20OOC
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO16%2520OOC%27 HTTP/1.1" 200 None
2026-03-29 22:06:58 [bca.uk] INFO: Scrape type for VO16%20OOC: 2
2026-03-29 22:06:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a483ecb-536a-5a7a-b51b-bc1d2c782d27 with identifier: VO16%20OOC
2026-03-29 22:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a483ecb-536a-5a7a-b51b-bc1d2c782d27 with scrape type 2
2026-03-29 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a483ecb-536a-5a7a-b51b-bc1d2c782d27 with scrape type 2
2026-03-29 22:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5a483ecb-536a-5a7a-b51b-bc1d2c782d27, identifier: VO16%20OOC
2026-03-29 22:06:58 [bca.uk] INFO: Found listing with ID: B10%20PGJ
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27B10%2520PGJ%27 HTTP/1.1" 200 None
2026-03-29 22:06:58 [bca.uk] INFO: Scrape type for B10%20PGJ: 2
2026-03-29 22:06:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 414fda2b-7a8b-5d29-ad43-b0e99521f4d6 with identifier: B10%20PGJ
2026-03-29 22:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 414fda2b-7a8b-5d29-ad43-b0e99521f4d6 with scrape type 2
2026-03-29 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 414fda2b-7a8b-5d29-ad43-b0e99521f4d6 with scrape type 2
2026-03-29 22:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 414fda2b-7a8b-5d29-ad43-b0e99521f4d6, identifier: B10%20PGJ
2026-03-29 22:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2ad57269-af6f-5f89-b6bd-0f6f92938d2b with identifier: LX62%20RKE
2026-03-29 22:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2ad57269-af6f-5f89-b6bd-0f6f92938d2b with identifier: LX62%20RKE
2026-03-29 22:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2ad57269-af6f-5f89-b6bd-0f6f92938d2b with identifier: LX62%20RKE to the API
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 94,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX62%20RKE-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '2ad57269-af6f-5f89-b6bd-0f6f92938d2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LX62 RKE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LX62%20RKE&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'LEXUS',
'model': 'CT 200H',
'odometer': 85231,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'LEXUS CT 200H 1.8 SE-L Hatchback',
'transmission': 'automatic',
'trim': 'SE-L',
'vin': 'JTHKD5BH102107414',
'year': 2012}
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX62%2520RKE%27 HTTP/1.1" 200 None
2026-03-29 22:06:58 [bca.uk] INFO: Saving data for LX62%20RKE: {'auction_closing_time': 1774951200.0, 'created_time': 1774735461.777918, 'last_price_update_time': 1774822018.926541}
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LX62%2520RKE') HTTP/1.1" 204 0
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699103837%27 HTTP/1.1" 200 None
2026-03-29 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103837 not downloaded yet
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427731%27 HTTP/1.1" 200 None
2026-03-29 22:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427731 not downloaded yet
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699139527%27 HTTP/1.1" 200 None
2026-03-29 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139527 not downloaded yet
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430171%27 HTTP/1.1" 200 None
2026-03-29 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430171 not downloaded yet
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435142%27 HTTP/1.1" 200 None
2026-03-29 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435142 not downloaded yet
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146888%27 HTTP/1.1" 200 None
2026-03-29 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146888 not downloaded yet
2026-03-29 22:06:59 [bca.uk] INFO: Found listing with ID: YS68%20WCC
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS68%2520WCC%27 HTTP/1.1" 200 None
2026-03-29 22:06:59 [bca.uk] INFO: Scrape type for YS68%20WCC: 2
2026-03-29 22:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de869e9c-857e-550f-abd9-12553d63d9ad with identifier: YS68%20WCC
2026-03-29 22:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de869e9c-857e-550f-abd9-12553d63d9ad with scrape type 2
2026-03-29 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de869e9c-857e-550f-abd9-12553d63d9ad with scrape type 2
2026-03-29 22:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: de869e9c-857e-550f-abd9-12553d63d9ad, identifier: YS68%20WCC
2026-03-29 22:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5a483ecb-536a-5a7a-b51b-bc1d2c782d27 with identifier: VO16%20OOC
2026-03-29 22:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5a483ecb-536a-5a7a-b51b-bc1d2c782d27 with identifier: VO16%20OOC
2026-03-29 22:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5a483ecb-536a-5a7a-b51b-bc1d2c782d27 with identifier: VO16%20OOC to the API
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO16%20OOC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5a483ecb-536a-5a7a-b51b-bc1d2c782d27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO16 OOC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO16%20OOC&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MINI',
'model': 'COOPER',
'odometer': 78477,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.5 136 Hatchback',
'transmission': 'automatic',
'trim': '136',
'vin': 'WMWXM520202D01516',
'year': 2016}
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO16%2520OOC%27 HTTP/1.1" 200 None
2026-03-29 22:06:59 [bca.uk] INFO: Saving data for VO16%20OOC: {'auction_closing_time': 1774864800.0, 'created_time': 1774735387.67162, 'last_price_update_time': 1774822019.511307}
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO16%2520OOC') HTTP/1.1" 204 0
2026-03-29 22:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 414fda2b-7a8b-5d29-ad43-b0e99521f4d6 with identifier: B10%20PGJ
2026-03-29 22:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 414fda2b-7a8b-5d29-ad43-b0e99521f4d6 with identifier: B10%20PGJ
2026-03-29 22:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 414fda2b-7a8b-5d29-ad43-b0e99521f4d6 with identifier: B10%20PGJ to the API
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 254,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=B10%20PGJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '414fda2b-7a8b-5d29-ad43-b0e99521f4d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'B10 PGJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=B10%20PGJ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'JEEP',
'model': 'WRANGLER',
'odometer': 31755,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'JEEP WRANGLER 2.0 GME RUBICON HARD TOP StationWagon',
'transmission': 'automatic',
'trim': 'GME RUBICON HARD TOP',
'vin': '1C4HJXJN8LW174788',
'year': 2021}
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27B10%2520PGJ%27 HTTP/1.1" 200 None
2026-03-29 22:06:59 [bca.uk] INFO: Saving data for B10%20PGJ: {'auction_closing_time': 1774951200.0, 'created_time': 1774735469.402965, 'last_price_update_time': 1774822019.795873}
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='B10%2520PGJ') HTTP/1.1" 204 0
2026-03-29 22:06:59 [bca.uk] INFO: Found listing with ID: SW19%20FWZ
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW19%2520FWZ%27 HTTP/1.1" 200 None
2026-03-29 22:06:59 [bca.uk] INFO: Scrape type for SW19%20FWZ: 2
2026-03-29 22:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e with identifier: SW19%20FWZ
2026-03-29 22:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e with scrape type 2
2026-03-29 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e with scrape type 2
2026-03-29 22:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e, identifier: SW19%20FWZ
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699124365%27 HTTP/1.1" 200 None
2026-03-29 22:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124365 not downloaded yet
2026-03-29 22:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: de869e9c-857e-550f-abd9-12553d63d9ad with identifier: YS68%20WCC
2026-03-29 22:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: de869e9c-857e-550f-abd9-12553d63d9ad with identifier: YS68%20WCC
2026-03-29 22:07:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: de869e9c-857e-550f-abd9-12553d63d9ad with identifier: YS68%20WCC to the API
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YS68%20WCC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'de869e9c-857e-550f-abd9-12553d63d9ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YS68 WCC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YS68%20WCC&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'ALFA ROMEO',
'model': 'STELVIO',
'odometer': 50497,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'ALFA ROMEO STELVIO 2.2 D 190 AWD NERO EDIZIONE StationWagon',
'transmission': 'automatic',
'trim': 'D 190 AWD NERO EDIZIONE',
'vin': 'ZARPAHGX5K7C38748',
'year': 2019}
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS68%2520WCC%27 HTTP/1.1" 200 None
2026-03-29 22:07:00 [bca.uk] INFO: Saving data for YS68%20WCC: {'auction_closing_time': 1774864800.0, 'created_time': 1774339630.137103, 'last_price_update_time': 1774822020.273063}
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YS68%2520WCC') HTTP/1.1" 204 0
2026-03-29 22:07:00 [bca.uk] INFO: Found listing with ID: WJ67%20VEM
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ67%2520VEM%27 HTTP/1.1" 200 None
2026-03-29 22:07:00 [bca.uk] INFO: Scrape type for WJ67%20VEM: 2
2026-03-29 22:07:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c0b8d3c-494f-51dc-ba6a-63cfe435e086 with identifier: WJ67%20VEM
2026-03-29 22:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c0b8d3c-494f-51dc-ba6a-63cfe435e086 with scrape type 2
2026-03-29 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c0b8d3c-494f-51dc-ba6a-63cfe435e086 with scrape type 2
2026-03-29 22:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3c0b8d3c-494f-51dc-ba6a-63cfe435e086, identifier: WJ67%20VEM
2026-03-29 22:07:00 [bca.uk] INFO: Found listing with ID: DK23%20XXL
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK23%2520XXL%27 HTTP/1.1" 200 None
2026-03-29 22:07:00 [bca.uk] INFO: Scrape type for DK23%20XXL: 2
2026-03-29 22:07:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47f78646-9cef-5fc7-bd80-803ea7a167c9 with identifier: DK23%20XXL
2026-03-29 22:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47f78646-9cef-5fc7-bd80-803ea7a167c9 with scrape type 2
2026-03-29 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47f78646-9cef-5fc7-bd80-803ea7a167c9 with scrape type 2
2026-03-29 22:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 47f78646-9cef-5fc7-bd80-803ea7a167c9, identifier: DK23%20XXL
2026-03-29 22:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e with identifier: SW19%20FWZ
2026-03-29 22:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e with identifier: SW19%20FWZ
2026-03-29 22:07:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 91ccc5b9-c785-59f2-b3e3-b519a80bbf9e with identifier: SW19%20FWZ to the API
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_source_url': None,
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': '91ccc5b9-c785-59f2-b3e3-b519a80bbf9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SW19 FWZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SW19%20FWZ&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'FORD',
'model': 'TRANSIT 350 RWD',
'odometer': 127973,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD TRANSIT 350 RWD 2.0 TDCI 130 LWB Dropside',
'transmission': 'manual',
'trim': 'TDCI 130 LWB',
'vin': 'WF0DXXTTGDJG01441',
'year': 2019}
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW19%2520FWZ%27 HTTP/1.1" 200 None
2026-03-29 22:07:00 [bca.uk] INFO: Saving data for SW19%20FWZ: {'auction_closing_time': 1775210400.0, 'created_time': 1774735421.172884, 'last_price_update_time': 1774822020.775683}
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SW19%2520FWZ') HTTP/1.1" 204 0
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699103842%27 HTTP/1.1" 200 None
2026-03-29 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103842 not downloaded yet
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430157%27 HTTP/1.1" 200 None
2026-03-29 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430157 not downloaded yet
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699139535%27 HTTP/1.1" 200 None
2026-03-29 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139535 not downloaded yet
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430193%27 HTTP/1.1" 200 None
2026-03-29 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430193 not downloaded yet
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435148%27 HTTP/1.1" 200 None
2026-03-29 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435148 not downloaded yet
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146896%27 HTTP/1.1" 200 None
2026-03-29 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146896 not downloaded yet
2026-03-29 22:07:00 [bca.uk] INFO: Found listing with ID: AV68%20JYU
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV68%2520JYU%27 HTTP/1.1" 200 None
2026-03-29 22:07:00 [bca.uk] INFO: Scrape type for AV68%20JYU: 2
2026-03-29 22:07:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e48c561-f5d3-5b6d-8454-2d5fa2b7d67a with identifier: AV68%20JYU
2026-03-29 22:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e48c561-f5d3-5b6d-8454-2d5fa2b7d67a with scrape type 2
2026-03-29 22:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e48c561-f5d3-5b6d-8454-2d5fa2b7d67a with scrape type 2
2026-03-29 22:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2e48c561-f5d3-5b6d-8454-2d5fa2b7d67a, identifier: AV68%20JYU
2026-03-29 22:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3c0b8d3c-494f-51dc-ba6a-63cfe435e086 with identifier: WJ67%20VEM
2026-03-29 22:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3c0b8d3c-494f-51dc-ba6a-63cfe435e086 with identifier: WJ67%20VEM
2026-03-29 22:07:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3c0b8d3c-494f-51dc-ba6a-63cfe435e086 with identifier: WJ67%20VEM to the API
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ67%20VEM-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3c0b8d3c-494f-51dc-ba6a-63cfe435e086',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ67 VEM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ67%20VEM&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'TOYOTA',
'model': 'PROACE VERSO',
'odometer': 101634,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'TOYOTA PROACE VERSO 2.0 D 150 FAMILY COMPACT MPV',
'transmission': 'manual',
'trim': 'D 150 FAMILY COMPACT',
'vin': 'YARVEAHXHGZ111651',
'year': 2017}
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ67%2520VEM%27 HTTP/1.1" 200 None
2026-03-29 22:07:01 [bca.uk] INFO: Saving data for WJ67%20VEM: {'auction_closing_time': 1774864800.0, 'created_time': 1774735388.840957, 'last_price_update_time': 1774822021.295787}
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ67%2520VEM') HTTP/1.1" 204 0
2026-03-29 22:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 47f78646-9cef-5fc7-bd80-803ea7a167c9 with identifier: DK23%20XXL
2026-03-29 22:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 47f78646-9cef-5fc7-bd80-803ea7a167c9 with identifier: DK23%20XXL
2026-03-29 22:07:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 47f78646-9cef-5fc7-bd80-803ea7a167c9 with identifier: DK23%20XXL to the API
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DK23%20XXL-GB',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '47f78646-9cef-5fc7-bd80-803ea7a167c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DK23 XXL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DK23%20XXL&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MG MOTOR UK',
'model': 'MG3',
'odometer': 41725,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'MG MOTOR UK MG3 1.5 VTI-TECH EXCLUSIVE Hatchback',
'transmission': 'manual',
'trim': 'VTI-TECH EXCLUSIVE',
'vin': 'LSJZ14U99NS094989',
'year': 2023}
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK23%2520XXL%27 HTTP/1.1" 200 None
2026-03-29 22:07:01 [bca.uk] INFO: Saving data for DK23%20XXL: {'auction_closing_time': 1774951200.0, 'created_time': 1774735463.699202, 'last_price_update_time': 1774822021.595459}
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DK23%2520XXL') HTTP/1.1" 204 0
2026-03-29 22:07:01 [bca.uk] INFO: Found listing with ID: CU71%20VTC
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU71%2520VTC%27 HTTP/1.1" 200 None
2026-03-29 22:07:01 [bca.uk] INFO: Scrape type for CU71%20VTC: 0
2026-03-29 22:07:01 [bca.uk] INFO: Found listing with ID: SR21%20XPN
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR21%2520XPN%27 HTTP/1.1" 200 None
2026-03-29 22:07:01 [bca.uk] INFO: Scrape type for SR21%20XPN: 0
2026-03-29 22:07:01 [bca.uk] INFO: Found listing with ID: ST72%20OPY
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST72%2520OPY%27 HTTP/1.1" 200 None
2026-03-29 22:07:01 [bca.uk] INFO: Scrape type for ST72%20OPY: 0
2026-03-29 22:07:01 [bca.uk] INFO: Found listing with ID: ST72%20OSN
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST72%2520OSN%27 HTTP/1.1" 200 None
2026-03-29 22:07:01 [bca.uk] INFO: Scrape type for ST72%20OSN: 2
2026-03-29 22:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faac7e05-80dd-59ba-9e57-f65529be8812 with identifier: ST72%20OSN
2026-03-29 22:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faac7e05-80dd-59ba-9e57-f65529be8812 with scrape type 2
2026-03-29 22:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faac7e05-80dd-59ba-9e57-f65529be8812 with scrape type 2
2026-03-29 22:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: faac7e05-80dd-59ba-9e57-f65529be8812, identifier: ST72%20OSN
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699124369%27 HTTP/1.1" 200 None
2026-03-29 22:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124369 not downloaded yet
2026-03-29 22:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2e48c561-f5d3-5b6d-8454-2d5fa2b7d67a with identifier: AV68%20JYU
2026-03-29 22:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2e48c561-f5d3-5b6d-8454-2d5fa2b7d67a with identifier: AV68%20JYU
2026-03-29 22:07:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2e48c561-f5d3-5b6d-8454-2d5fa2b7d67a with identifier: AV68%20JYU to the API
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV68%20JYU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2e48c561-f5d3-5b6d-8454-2d5fa2b7d67a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV68 JYU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV68%20JYU&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'KUGA',
'odometer': 110935,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD KUGA 1.5 TDCI 120 2WD TITANIUM StationWagon',
'transmission': 'manual',
'trim': 'TDCI 120 2WD TITANIUM',
'vin': 'WF0AXXWPMAJU50726',
'year': 2018}
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV68%2520JYU%27 HTTP/1.1" 200 None
2026-03-29 22:07:02 [bca.uk] INFO: Saving data for AV68%20JYU: {'auction_closing_time': 1774864800.0, 'created_time': 1774621500.990708, 'last_price_update_time': 1774822022.088601}
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV68%2520JYU') HTTP/1.1" 204 0
2026-03-29 22:07:02 [bca.uk] INFO: Found listing with ID: YS06%20XVF
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS06%2520XVF%27 HTTP/1.1" 200 None
2026-03-29 22:07:02 [bca.uk] INFO: Scrape type for YS06%20XVF: 2
2026-03-29 22:07:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee972586-3286-5910-8d85-df63dfdcf24d with identifier: YS06%20XVF
2026-03-29 22:07:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee972586-3286-5910-8d85-df63dfdcf24d with scrape type 2
2026-03-29 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee972586-3286-5910-8d85-df63dfdcf24d with scrape type 2
2026-03-29 22:07:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ee972586-3286-5910-8d85-df63dfdcf24d, identifier: YS06%20XVF
2026-03-29 22:07:02 [bca.uk] INFO: Found listing with ID: DT69%20OUG
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT69%2520OUG%27 HTTP/1.1" 200 None
2026-03-29 22:07:02 [bca.uk] INFO: Scrape type for DT69%20OUG: 2
2026-03-29 22:07:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1f5ee4c-4910-54f2-806e-fcee61f2b886 with identifier: DT69%20OUG
2026-03-29 22:07:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1f5ee4c-4910-54f2-806e-fcee61f2b886 with scrape type 2
2026-03-29 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1f5ee4c-4910-54f2-806e-fcee61f2b886 with scrape type 2
2026-03-29 22:07:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b1f5ee4c-4910-54f2-806e-fcee61f2b886, identifier: DT69%20OUG
2026-03-29 22:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: faac7e05-80dd-59ba-9e57-f65529be8812 with identifier: ST72%20OSN
2026-03-29 22:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: faac7e05-80dd-59ba-9e57-f65529be8812 with identifier: ST72%20OSN
2026-03-29 22:07:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: faac7e05-80dd-59ba-9e57-f65529be8812 with identifier: ST72%20OSN to the API
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ST72%20OSN-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'faac7e05-80dd-59ba-9e57-f65529be8812',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ST72 OSN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ST72%20OSN&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow',
'make': 'FORD',
'model': 'TRANSIT COURIER',
'odometer': 12631,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'FORD TRANSIT COURIER 1.5 TDCI 100 LEADER (6) Van',
'transmission': 'manual',
'trim': 'TDCI 100 LEADER (6)',
'vin': 'WF0WXXTACWNR67580',
'year': 2022}
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST72%2520OSN%27 HTTP/1.1" 200 None
2026-03-29 22:07:02 [bca.uk] INFO: Saving data for ST72%20OSN: {'auction_closing_time': 1775210400.0, 'created_time': 1774535130.4698, 'last_price_update_time': 1774822022.729587}
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ST72%2520OSN') HTTP/1.1" 204 0
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699103848%27 HTTP/1.1" 200 None
2026-03-29 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103848 not downloaded yet
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427769%27 HTTP/1.1" 200 None
2026-03-29 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427769 not downloaded yet
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699139551%27 HTTP/1.1" 200 None
2026-03-29 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139551 not downloaded yet
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430227%27 HTTP/1.1" 200 None
2026-03-29 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430227 not downloaded yet
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435152%27 HTTP/1.1" 200 None
2026-03-29 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435152 not downloaded yet
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146901%27 HTTP/1.1" 200 None
2026-03-29 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146901 not downloaded yet
2026-03-29 22:07:02 [bca.uk] INFO: Found listing with ID: BU64%20FFW
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU64%2520FFW%27 HTTP/1.1" 200 None
2026-03-29 22:07:02 [bca.uk] INFO: Scrape type for BU64%20FFW: 0
2026-03-29 22:07:02 [bca.uk] INFO: Found listing with ID: FD64%20DKV
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD64%2520DKV%27 HTTP/1.1" 200 None
2026-03-29 22:07:02 [bca.uk] INFO: Scrape type for FD64%20DKV: 0
2026-03-29 22:07:02 [bca.uk] INFO: Found listing with ID: ML18%20SVE
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML18%2520SVE%27 HTTP/1.1" 200 None
2026-03-29 22:07:02 [bca.uk] INFO: Scrape type for ML18%20SVE: 2
2026-03-29 22:07:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0e13b85-256a-5085-9abb-6bc39b8ee420 with identifier: ML18%20SVE
2026-03-29 22:07:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0e13b85-256a-5085-9abb-6bc39b8ee420 with scrape type 2
2026-03-29 22:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0e13b85-256a-5085-9abb-6bc39b8ee420 with scrape type 2
2026-03-29 22:07:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c0e13b85-256a-5085-9abb-6bc39b8ee420, identifier: ML18%20SVE
2026-03-29 22:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ee972586-3286-5910-8d85-df63dfdcf24d with identifier: YS06%20XVF
2026-03-29 22:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ee972586-3286-5910-8d85-df63dfdcf24d with identifier: YS06%20XVF
2026-03-29 22:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ee972586-3286-5910-8d85-df63dfdcf24d with identifier: YS06%20XVF to the API
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YS06%20XVF-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ee972586-3286-5910-8d85-df63dfdcf24d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YS06 XVF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YS06%20XVF&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 119669,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 ZETEC CLIMATE Hatchback',
'transmission': 'automatic',
'trim': 'ZETEC CLIMATE',
'vin': 'WF05XXWPD56U20954',
'year': 2006}
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS06%2520XVF%27 HTTP/1.1" 200 None
2026-03-29 22:07:03 [bca.uk] INFO: Saving data for YS06%20XVF: {'auction_closing_time': 1774864800.0, 'created_time': 1774735376.450475, 'last_price_update_time': 1774822023.286033}
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YS06%2520XVF') HTTP/1.1" 204 0
2026-03-29 22:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b1f5ee4c-4910-54f2-806e-fcee61f2b886 with identifier: DT69%20OUG
2026-03-29 22:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b1f5ee4c-4910-54f2-806e-fcee61f2b886 with identifier: DT69%20OUG
2026-03-29 22:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b1f5ee4c-4910-54f2-806e-fcee61f2b886 with identifier: DT69%20OUG to the API
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DT69%20OUG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b1f5ee4c-4910-54f2-806e-fcee61f2b886',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DT69 OUG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DT69%20OUG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 22392,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.2 TURBO 145 SRI Hatchback',
'transmission': 'manual',
'trim': 'TURBO 145 SRI',
'vin': 'W0VBF6EW6LG010248',
'year': 2020}
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT69%2520OUG%27 HTTP/1.1" 200 None
2026-03-29 22:07:03 [bca.uk] INFO: Saving data for DT69%20OUG: {'auction_closing_time': 1774951200.0, 'created_time': 1774735473.785976, 'last_price_update_time': 1774822023.5616}
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DT69%2520OUG') HTTP/1.1" 204 0
2026-03-29 22:07:03 [bca.uk] INFO: Found listing with ID: ST72%20TKU
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST72%2520TKU%27 HTTP/1.1" 200 None
2026-03-29 22:07:03 [bca.uk] INFO: Scrape type for ST72%20TKU: 0
2026-03-29 22:07:03 [bca.uk] INFO: Found listing with ID: SY22%20UHR
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY22%2520UHR%27 HTTP/1.1" 200 None
2026-03-29 22:07:03 [bca.uk] INFO: Scrape type for SY22%20UHR: 0
2026-03-29 22:07:03 [bca.uk] INFO: Found listing with ID: MD19%20GWP
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD19%2520GWP%27 HTTP/1.1" 200 None
2026-03-29 22:07:03 [bca.uk] INFO: Scrape type for MD19%20GWP: 0
2026-03-29 22:07:03 [bca.uk] INFO: Found listing with ID: DE72%20KZJ
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE72%2520KZJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:03 [bca.uk] INFO: Scrape type for DE72%20KZJ: 2
2026-03-29 22:07:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 300e41a8-d251-59f7-802e-bbb7283fa1e6 with identifier: DE72%20KZJ
2026-03-29 22:07:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 300e41a8-d251-59f7-802e-bbb7283fa1e6 with scrape type 2
2026-03-29 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 300e41a8-d251-59f7-802e-bbb7283fa1e6 with scrape type 2
2026-03-29 22:07:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 300e41a8-d251-59f7-802e-bbb7283fa1e6, identifier: DE72%20KZJ
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699124373%27 HTTP/1.1" 200 None
2026-03-29 22:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124373 not downloaded yet
2026-03-29 22:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c0e13b85-256a-5085-9abb-6bc39b8ee420 with identifier: ML18%20SVE
2026-03-29 22:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c0e13b85-256a-5085-9abb-6bc39b8ee420 with identifier: ML18%20SVE
2026-03-29 22:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c0e13b85-256a-5085-9abb-6bc39b8ee420 with identifier: ML18%20SVE to the API
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML18%20SVE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c0e13b85-256a-5085-9abb-6bc39b8ee420',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML18 SVE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML18%20SVE&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 98278,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.2 P/T 82 ACTIVE MPV',
'transmission': 'manual',
'trim': 'P/T 82 ACTIVE',
'vin': 'VF3CUHMZ6JY005996',
'year': 2018}
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML18%2520SVE%27 HTTP/1.1" 200 None
2026-03-29 22:07:04 [bca.uk] INFO: Saving data for ML18%20SVE: {'auction_closing_time': 1774864800.0, 'created_time': 1774610277.361271, 'last_price_update_time': 1774822024.100673}
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML18%2520SVE') HTTP/1.1" 204 0
2026-03-29 22:07:04 [bca.uk] INFO: Found listing with ID: YY56%20ODW
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY56%2520ODW%27 HTTP/1.1" 200 None
2026-03-29 22:07:04 [bca.uk] INFO: Scrape type for YY56%20ODW: 2
2026-03-29 22:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc0e7ef8-c401-5590-9e6c-d0083796c0be with identifier: YY56%20ODW
2026-03-29 22:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc0e7ef8-c401-5590-9e6c-d0083796c0be with scrape type 2
2026-03-29 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc0e7ef8-c401-5590-9e6c-d0083796c0be with scrape type 2
2026-03-29 22:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dc0e7ef8-c401-5590-9e6c-d0083796c0be, identifier: YY56%20ODW
2026-03-29 22:07:04 [bca.uk] INFO: Found listing with ID: MF19%20KHM
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF19%2520KHM%27 HTTP/1.1" 200 None
2026-03-29 22:07:04 [bca.uk] INFO: Scrape type for MF19%20KHM: 2
2026-03-29 22:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4ba462d-c70d-5156-b443-d7d5e76250e2 with identifier: MF19%20KHM
2026-03-29 22:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4ba462d-c70d-5156-b443-d7d5e76250e2 with scrape type 2
2026-03-29 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4ba462d-c70d-5156-b443-d7d5e76250e2 with scrape type 2
2026-03-29 22:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a4ba462d-c70d-5156-b443-d7d5e76250e2, identifier: MF19%20KHM
2026-03-29 22:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 300e41a8-d251-59f7-802e-bbb7283fa1e6 with identifier: DE72%20KZJ
2026-03-29 22:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 300e41a8-d251-59f7-802e-bbb7283fa1e6 with identifier: DE72%20KZJ
2026-03-29 22:07:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 300e41a8-d251-59f7-802e-bbb7283fa1e6 with identifier: DE72%20KZJ to the API
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE72%20KZJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '300e41a8-d251-59f7-802e-bbb7283fa1e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DE72 KZJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DE72%20KZJ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'AUDI',
'model': 'Q2',
'odometer': 36394,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'AUDI Q2 1.5 35 TFSI BLACK ED.S-T Hatchback',
'transmission': 'automatic',
'trim': '35 TFSI BLACK ED.S-T',
'vin': 'WAUZZZGA1PA003359',
'year': 2022}
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE72%2520KZJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:04 [bca.uk] INFO: Saving data for DE72%20KZJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774706866.34932, 'last_price_update_time': 1774822024.669777}
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DE72%2520KZJ') HTTP/1.1" 204 0
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699103853%27 HTTP/1.1" 200 None
2026-03-29 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103853 not downloaded yet
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430178%27 HTTP/1.1" 200 None
2026-03-29 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430178 not downloaded yet
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699139564%27 HTTP/1.1" 200 None
2026-03-29 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139564 not downloaded yet
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430255%27 HTTP/1.1" 200 None
2026-03-29 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430255 not downloaded yet
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435161%27 HTTP/1.1" 200 None
2026-03-29 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435161 not downloaded yet
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146908%27 HTTP/1.1" 200 None
2026-03-29 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146908 not downloaded yet
2026-03-29 22:07:04 [bca.uk] INFO: Found listing with ID: MM17%20ZZL
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM17%2520ZZL%27 HTTP/1.1" 200 None
2026-03-29 22:07:04 [bca.uk] INFO: Scrape type for MM17%20ZZL: 0
2026-03-29 22:07:04 [bca.uk] INFO: Found listing with ID: ND64%20WZO
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND64%2520WZO%27 HTTP/1.1" 200 None
2026-03-29 22:07:04 [bca.uk] INFO: Scrape type for ND64%20WZO: 0
2026-03-29 22:07:04 [bca.uk] INFO: Found listing with ID: PE15%20LHF
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE15%2520LHF%27 HTTP/1.1" 200 None
2026-03-29 22:07:04 [bca.uk] INFO: Scrape type for PE15%20LHF: 2
2026-03-29 22:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53b360f8-e28e-5066-a3a2-3aa59cee10b7 with identifier: PE15%20LHF
2026-03-29 22:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53b360f8-e28e-5066-a3a2-3aa59cee10b7 with scrape type 2
2026-03-29 22:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53b360f8-e28e-5066-a3a2-3aa59cee10b7 with scrape type 2
2026-03-29 22:07:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 53b360f8-e28e-5066-a3a2-3aa59cee10b7, identifier: PE15%20LHF
2026-03-29 22:07:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dc0e7ef8-c401-5590-9e6c-d0083796c0be with identifier: YY56%20ODW
2026-03-29 22:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dc0e7ef8-c401-5590-9e6c-d0083796c0be with identifier: YY56%20ODW
2026-03-29 22:07:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dc0e7ef8-c401-5590-9e6c-d0083796c0be with identifier: YY56%20ODW to the API
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YY56%20ODW-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dc0e7ef8-c401-5590-9e6c-d0083796c0be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YY56 ODW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YY56%20ODW&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 115903,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.3 VVT-I ZINC MMT Hatchback',
'transmission': 'automatic',
'trim': 'VVT-I ZINC MMT',
'vin': 'VNKKL96350A138138',
'year': 2007}
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY56%2520ODW%27 HTTP/1.1" 200 None
2026-03-29 22:07:05 [bca.uk] INFO: Saving data for YY56%20ODW: {'auction_closing_time': 1774864800.0, 'created_time': 1774735375.469346, 'last_price_update_time': 1774822025.29331}
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YY56%2520ODW') HTTP/1.1" 204 0
2026-03-29 22:07:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a4ba462d-c70d-5156-b443-d7d5e76250e2 with identifier: MF19%20KHM
2026-03-29 22:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a4ba462d-c70d-5156-b443-d7d5e76250e2 with identifier: MF19%20KHM
2026-03-29 22:07:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a4ba462d-c70d-5156-b443-d7d5e76250e2 with identifier: MF19%20KHM to the API
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF19%20KHM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a4ba462d-c70d-5156-b443-d7d5e76250e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF19 KHM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF19%20KHM&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 62510,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.5 BLUEHDI 130 GT LINE Hatchback',
'transmission': 'manual',
'trim': 'BLUEHDI 130 GT LINE',
'vin': 'VF3MCYHZJJS487274',
'year': 2019}
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF19%2520KHM%27 HTTP/1.1" 200 None
2026-03-29 22:07:05 [bca.uk] INFO: Saving data for MF19%20KHM: {'auction_closing_time': 1774951200.0, 'created_time': 1774735470.697493, 'last_price_update_time': 1774822025.582355}
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF19%2520KHM') HTTP/1.1" 204 0
2026-03-29 22:07:05 [bca.uk] INFO: Found listing with ID: BW21%20EVR
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW21%2520EVR%27 HTTP/1.1" 200 None
2026-03-29 22:07:05 [bca.uk] INFO: Scrape type for BW21%20EVR: 2
2026-03-29 22:07:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96c4f924-7308-5bd2-b24d-6916e1a7f917 with identifier: BW21%20EVR
2026-03-29 22:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96c4f924-7308-5bd2-b24d-6916e1a7f917 with scrape type 2
2026-03-29 22:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96c4f924-7308-5bd2-b24d-6916e1a7f917 with scrape type 2
2026-03-29 22:07:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 96c4f924-7308-5bd2-b24d-6916e1a7f917, identifier: BW21%20EVR
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699124379%27 HTTP/1.1" 200 None
2026-03-29 22:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124379 not downloaded yet
2026-03-29 22:07:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 53b360f8-e28e-5066-a3a2-3aa59cee10b7 with identifier: PE15%20LHF
2026-03-29 22:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 53b360f8-e28e-5066-a3a2-3aa59cee10b7 with identifier: PE15%20LHF
2026-03-29 22:07:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 53b360f8-e28e-5066-a3a2-3aa59cee10b7 with identifier: PE15%20LHF to the API
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 182,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PE15%20LHF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '53b360f8-e28e-5066-a3a2-3aa59cee10b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PE15 LHF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PE15%20LHF&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'LAND ROVER',
'model': 'RANGE ROVER',
'odometer': 123563,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'LAND ROVER RANGE ROVER 3.0 TDV6 VOGUE StationWagon',
'transmission': 'manual',
'trim': 'TDV6 VOGUE',
'vin': 'SALGA2KE4FA221757',
'year': 2015}
2026-03-29 22:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE15%2520LHF%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [bca.uk] INFO: Saving data for PE15%20LHF: {'auction_closing_time': 1774864800.0, 'created_time': 1774389709.115778, 'last_price_update_time': 1774822026.007395}
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PE15%2520LHF') HTTP/1.1" 204 0
2026-03-29 22:07:06 [bca.uk] INFO: Found listing with ID: AK60%20YGR
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK60%2520YGR%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [bca.uk] INFO: Scrape type for AK60%20YGR: 2
2026-03-29 22:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c199cc4-2b6f-5122-8d05-996d23603f8a with identifier: AK60%20YGR
2026-03-29 22:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c199cc4-2b6f-5122-8d05-996d23603f8a with scrape type 2
2026-03-29 22:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c199cc4-2b6f-5122-8d05-996d23603f8a with scrape type 2
2026-03-29 22:07:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1c199cc4-2b6f-5122-8d05-996d23603f8a, identifier: AK60%20YGR
2026-03-29 22:07:06 [bca.uk] INFO: Found listing with ID: YT69%20LRX
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT69%2520LRX%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [bca.uk] INFO: Scrape type for YT69%20LRX: 0
2026-03-29 22:07:06 [bca.uk] INFO: Found listing with ID: LY69%20GMG
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY69%2520GMG%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [bca.uk] INFO: Scrape type for LY69%20GMG: 0
2026-03-29 22:07:06 [bca.uk] INFO: Found listing with ID: DX68%20ZHP
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX68%2520ZHP%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [bca.uk] INFO: Scrape type for DX68%20ZHP: 0
2026-03-29 22:07:06 [bca.uk] INFO: Found listing with ID: GP19%20AEE
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP19%2520AEE%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [bca.uk] INFO: Scrape type for GP19%20AEE: 0
2026-03-29 22:07:06 [bca.uk] INFO: Found listing with ID: PK20%20LVZ
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK20%2520LVZ%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [bca.uk] INFO: Scrape type for PK20%20LVZ: 0
2026-03-29 22:07:06 [bca.uk] INFO: Found listing with ID: YT70%20LPK
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT70%2520LPK%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [bca.uk] INFO: Scrape type for YT70%20LPK: 2
2026-03-29 22:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c56c1109-0372-5f69-97bc-e780b3d8ac65 with identifier: YT70%20LPK
2026-03-29 22:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c56c1109-0372-5f69-97bc-e780b3d8ac65 with scrape type 2
2026-03-29 22:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c56c1109-0372-5f69-97bc-e780b3d8ac65 with scrape type 2
2026-03-29 22:07:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c56c1109-0372-5f69-97bc-e780b3d8ac65, identifier: YT70%20LPK
2026-03-29 22:07:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 96c4f924-7308-5bd2-b24d-6916e1a7f917 with identifier: BW21%20EVR
2026-03-29 22:07:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 96c4f924-7308-5bd2-b24d-6916e1a7f917 with identifier: BW21%20EVR
2026-03-29 22:07:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 96c4f924-7308-5bd2-b24d-6916e1a7f917 with identifier: BW21%20EVR to the API
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BW21%20EVR-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '96c4f924-7308-5bd2-b24d-6916e1a7f917',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BW21 EVR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BW21%20EVR&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LEXUS',
'model': 'UX 250H',
'odometer': 83462,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'LEXUS UX 250H 2.0 Hatchback',
'transmission': 'automatic',
'trim': '',
'vin': 'JTHY65BH902103535',
'year': 2021}
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW21%2520EVR%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [bca.uk] INFO: Saving data for BW21%20EVR: {'auction_closing_time': 1774864800.0, 'created_time': 1774735448.987025, 'last_price_update_time': 1774822026.612114}
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BW21%2520EVR') HTTP/1.1" 204 0
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699103856%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103856 not downloaded yet
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699427784%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427784 not downloaded yet
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699139576%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139576 not downloaded yet
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430284%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430284 not downloaded yet
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435168%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435168 not downloaded yet
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146921%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146921 not downloaded yet
2026-03-29 22:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:07:06 [bca.uk] INFO: Found listing with ID: VO71%20XBU
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO71%2520XBU%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [bca.uk] INFO: Scrape type for VO71%20XBU: 0
2026-03-29 22:07:06 [bca.uk] INFO: Found listing with ID: YK65%20OXD
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK65%2520OXD%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [bca.uk] INFO: Scrape type for YK65%20OXD: 0
2026-03-29 22:07:06 [bca.uk] INFO: Found listing with ID: WP63%20XYK
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP63%2520XYK%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [bca.uk] INFO: Scrape type for WP63%20XYK: 0
2026-03-29 22:07:06 [bca.uk] INFO: Found listing with ID: YK21%20DGC
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK21%2520DGC%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [bca.uk] INFO: Scrape type for YK21%20DGC: 0
2026-03-29 22:07:06 [bca.uk] INFO: Found listing with ID: YR13%20ZXN
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR13%2520ZXN%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [bca.uk] INFO: Scrape type for YR13%20ZXN: 0
2026-03-29 22:07:06 [bca.uk] INFO: Found listing with ID: DK63%20WMY
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK63%2520WMY%27 HTTP/1.1" 200 None
2026-03-29 22:07:06 [bca.uk] INFO: Scrape type for DK63%20WMY: 2
2026-03-29 22:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d10fd0ff-e651-505e-98ff-e4147b34f850 with identifier: DK63%20WMY
2026-03-29 22:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d10fd0ff-e651-505e-98ff-e4147b34f850 with scrape type 2
2026-03-29 22:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d10fd0ff-e651-505e-98ff-e4147b34f850 with scrape type 2
2026-03-29 22:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d10fd0ff-e651-505e-98ff-e4147b34f850, identifier: DK63%20WMY
2026-03-29 22:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1c199cc4-2b6f-5122-8d05-996d23603f8a with identifier: AK60%20YGR
2026-03-29 22:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1c199cc4-2b6f-5122-8d05-996d23603f8a with identifier: AK60%20YGR
2026-03-29 22:07:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1c199cc4-2b6f-5122-8d05-996d23603f8a with identifier: AK60%20YGR to the API
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK60%20YGR-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1c199cc4-2b6f-5122-8d05-996d23603f8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AK60 YGR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AK60%20YGR&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLVO',
'model': 'S80',
'odometer': 270375,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VOLVO S80 2.0 D3 163 SE G/T Saloon',
'transmission': 'manual',
'trim': 'D3 163 SE G/T',
'vin': 'YV1AS5250B1142602',
'year': 2010}
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK60%2520YGR%27 HTTP/1.1" 200 None
2026-03-29 22:07:07 [bca.uk] INFO: Saving data for AK60%20YGR: {'auction_closing_time': 1774864800.0, 'created_time': 1774735372.437902, 'last_price_update_time': 1774822027.289698}
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AK60%2520YGR') HTTP/1.1" 204 0
2026-03-29 22:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c56c1109-0372-5f69-97bc-e780b3d8ac65 with identifier: YT70%20LPK
2026-03-29 22:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c56c1109-0372-5f69-97bc-e780b3d8ac65 with identifier: YT70%20LPK
2026-03-29 22:07:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c56c1109-0372-5f69-97bc-e780b3d8ac65 with identifier: YT70%20LPK to the API
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 92,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YT70%20LPK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'c56c1109-0372-5f69-97bc-e780b3d8ac65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YT70 LPK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YT70%20LPK&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 30573,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.5 HYBRID DESIGN Hatchback',
'transmission': 'automatic',
'trim': 'HYBRID DESIGN',
'vin': 'VNKKBAC370A013280',
'year': 2020}
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT70%2520LPK%27 HTTP/1.1" 200 None
2026-03-29 22:07:07 [bca.uk] INFO: Saving data for YT70%20LPK: {'auction_closing_time': 1774951200.0, 'created_time': 1774735495.558422, 'last_price_update_time': 1774822027.604135}
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YT70%2520LPK') HTTP/1.1" 204 0
2026-03-29 22:07:07 [bca.uk] INFO: Found listing with ID: CA19%20YWE
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA19%2520YWE%27 HTTP/1.1" 200 None
2026-03-29 22:07:07 [bca.uk] INFO: Scrape type for CA19%20YWE: 2
2026-03-29 22:07:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 425c7b94-e605-550f-9362-6af12cc1998a with identifier: CA19%20YWE
2026-03-29 22:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 425c7b94-e605-550f-9362-6af12cc1998a with scrape type 2
2026-03-29 22:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 425c7b94-e605-550f-9362-6af12cc1998a with scrape type 2
2026-03-29 22:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 425c7b94-e605-550f-9362-6af12cc1998a, identifier: CA19%20YWE
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699124388%27 HTTP/1.1" 200 None
2026-03-29 22:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124388 not downloaded yet
2026-03-29 22:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d10fd0ff-e651-505e-98ff-e4147b34f850 with identifier: DK63%20WMY
2026-03-29 22:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d10fd0ff-e651-505e-98ff-e4147b34f850 with identifier: DK63%20WMY
2026-03-29 22:07:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d10fd0ff-e651-505e-98ff-e4147b34f850 with identifier: DK63%20WMY to the API
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DK63%20WMY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd10fd0ff-e651-505e-98ff-e4147b34f850',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DK63 WMY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DK63%20WMY&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VOLKSWAGEN',
'model': 'CADDY MAXI LIFE',
'odometer': 192168,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN CADDY MAXI LIFE 1.6 TDI 102 DSG MPV',
'transmission': 'automatic',
'trim': 'TDI 102 DSG',
'vin': 'WV2ZZZ2KZEX039850',
'year': 2013}
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK63%2520WMY%27 HTTP/1.1" 200 None
2026-03-29 22:07:08 [bca.uk] INFO: Saving data for DK63%20WMY: {'auction_closing_time': 1774864800.0, 'created_time': 1774621664.124209, 'last_price_update_time': 1774822028.036799}
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DK63%2520WMY') HTTP/1.1" 204 0
2026-03-29 22:07:08 [bca.uk] INFO: Found listing with ID: AY07%20YBB
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY07%2520YBB%27 HTTP/1.1" 200 None
2026-03-29 22:07:08 [bca.uk] INFO: Scrape type for AY07%20YBB: 2
2026-03-29 22:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88817b86-325c-592c-b16f-dff4dccb2371 with identifier: AY07%20YBB
2026-03-29 22:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88817b86-325c-592c-b16f-dff4dccb2371 with scrape type 2
2026-03-29 22:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88817b86-325c-592c-b16f-dff4dccb2371 with scrape type 2
2026-03-29 22:07:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 88817b86-325c-592c-b16f-dff4dccb2371, identifier: AY07%20YBB
2026-03-29 22:07:08 [bca.uk] INFO: Found listing with ID: DT18%20GME
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT18%2520GME%27 HTTP/1.1" 200 None
2026-03-29 22:07:08 [bca.uk] INFO: Scrape type for DT18%20GME: 2
2026-03-29 22:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfa1c404-6451-54cd-8c9e-13c4279fa00e with identifier: DT18%20GME
2026-03-29 22:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfa1c404-6451-54cd-8c9e-13c4279fa00e with scrape type 2
2026-03-29 22:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfa1c404-6451-54cd-8c9e-13c4279fa00e with scrape type 2
2026-03-29 22:07:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bfa1c404-6451-54cd-8c9e-13c4279fa00e, identifier: DT18%20GME
2026-03-29 22:07:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 425c7b94-e605-550f-9362-6af12cc1998a with identifier: CA19%20YWE
2026-03-29 22:07:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 425c7b94-e605-550f-9362-6af12cc1998a with identifier: CA19%20YWE
2026-03-29 22:07:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 425c7b94-e605-550f-9362-6af12cc1998a with identifier: CA19%20YWE to the API
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CA19%20YWE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '425c7b94-e605-550f-9362-6af12cc1998a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CA19 YWE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CA19%20YWE&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 90400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.6 TDI 115 MATCH DSG Hatchback',
'transmission': 'automatic',
'trim': 'TDI 115 MATCH DSG',
'vin': 'WVWZZZAUZKW155532',
'year': 2019}
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA19%2520YWE%27 HTTP/1.1" 200 None
2026-03-29 22:07:08 [bca.uk] INFO: Saving data for CA19%20YWE: {'auction_closing_time': 1774864800.0, 'created_time': 1774735450.109105, 'last_price_update_time': 1774822028.530298}
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CA19%2520YWE') HTTP/1.1" 204 0
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430199%27 HTTP/1.1" 200 None
2026-03-29 22:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430199 not downloaded yet
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699139586%27 HTTP/1.1" 200 None
2026-03-29 22:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139586 not downloaded yet
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699430310%27 HTTP/1.1" 200 None
2026-03-29 22:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430310 not downloaded yet
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435175%27 HTTP/1.1" 200 None
2026-03-29 22:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435175 not downloaded yet
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146934%27 HTTP/1.1" 200 None
2026-03-29 22:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146934 not downloaded yet
2026-03-29 22:07:08 [bca.uk] INFO: Found listing with ID: DY10%20SSJ
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY10%2520SSJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:08 [bca.uk] INFO: Scrape type for DY10%20SSJ: 2
2026-03-29 22:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0f8dcd8-cbe5-57fc-95b2-a1d208cc3fad with identifier: DY10%20SSJ
2026-03-29 22:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0f8dcd8-cbe5-57fc-95b2-a1d208cc3fad with scrape type 2
2026-03-29 22:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0f8dcd8-cbe5-57fc-95b2-a1d208cc3fad with scrape type 2
2026-03-29 22:07:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a0f8dcd8-cbe5-57fc-95b2-a1d208cc3fad, identifier: DY10%20SSJ
2026-03-29 22:07:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 88817b86-325c-592c-b16f-dff4dccb2371 with identifier: AY07%20YBB
2026-03-29 22:07:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 88817b86-325c-592c-b16f-dff4dccb2371 with identifier: AY07%20YBB
2026-03-29 22:07:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 88817b86-325c-592c-b16f-dff4dccb2371 with identifier: AY07%20YBB to the API
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AY07%20YBB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '88817b86-325c-592c-b16f-dff4dccb2371',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AY07 YBB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AY07%20YBB&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 85179,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.4 S 80 Hatchback',
'transmission': 'manual',
'trim': 'S 80',
'vin': 'WVWZZZ9NZ7Y133445',
'year': 2007}
2026-03-29 22:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY07%2520YBB%27 HTTP/1.1" 200 None
2026-03-29 22:07:09 [bca.uk] INFO: Saving data for AY07%20YBB: {'auction_closing_time': 1774864800.0, 'created_time': 1774735365.17831, 'last_price_update_time': 1774822029.001915}
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AY07%2520YBB') HTTP/1.1" 204 0
2026-03-29 22:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bfa1c404-6451-54cd-8c9e-13c4279fa00e with identifier: DT18%20GME
2026-03-29 22:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bfa1c404-6451-54cd-8c9e-13c4279fa00e with identifier: DT18%20GME
2026-03-29 22:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bfa1c404-6451-54cd-8c9e-13c4279fa00e with identifier: DT18%20GME to the API
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DT18%20GME-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bfa1c404-6451-54cd-8c9e-13c4279fa00e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DT18 GME',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DT18%20GME&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 40221,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 90 SE Hatchback',
'transmission': 'automatic',
'trim': '90 SE',
'vin': 'W0V0XEP08J6064276',
'year': 2018}
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT18%2520GME%27 HTTP/1.1" 200 None
2026-03-29 22:07:09 [bca.uk] INFO: Saving data for DT18%20GME: {'auction_closing_time': 1774951200.0, 'created_time': 1774735496.272889, 'last_price_update_time': 1774822029.284935}
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DT18%2520GME') HTTP/1.1" 204 0
2026-03-29 22:07:09 [bca.uk] INFO: Found listing with ID: HL19%20RNJ
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HL19%2520RNJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:09 [bca.uk] INFO: Scrape type for HL19%20RNJ: 2
2026-03-29 22:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f3b828e-d75c-5ff7-a14e-22edf0b6b900 with identifier: HL19%20RNJ
2026-03-29 22:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f3b828e-d75c-5ff7-a14e-22edf0b6b900 with scrape type 2
2026-03-29 22:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f3b828e-d75c-5ff7-a14e-22edf0b6b900 with scrape type 2
2026-03-29 22:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1f3b828e-d75c-5ff7-a14e-22edf0b6b900, identifier: HL19%20RNJ
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699124400%27 HTTP/1.1" 200 None
2026-03-29 22:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124400 not downloaded yet
2026-03-29 22:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a0f8dcd8-cbe5-57fc-95b2-a1d208cc3fad with identifier: DY10%20SSJ
2026-03-29 22:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a0f8dcd8-cbe5-57fc-95b2-a1d208cc3fad with identifier: DY10%20SSJ
2026-03-29 22:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a0f8dcd8-cbe5-57fc-95b2-a1d208cc3fad with identifier: DY10%20SSJ to the API
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DY10%20SSJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a0f8dcd8-cbe5-57fc-95b2-a1d208cc3fad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DY10 SSJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DY10%20SSJ&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'AUDI',
'model': 'TT',
'odometer': 197639,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'AUDI TT 2.0 TDI QUATTRO S LINE Coupe',
'transmission': 'manual',
'trim': 'TDI QUATTRO S LINE',
'vin': 'TRUZZZ8J4A1013348',
'year': 2010}
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY10%2520SSJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:09 [bca.uk] INFO: Saving data for DY10%20SSJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774621551.995077, 'last_price_update_time': 1774822029.713978}
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DY10%2520SSJ') HTTP/1.1" 204 0
2026-03-29 22:07:09 [bca.uk] INFO: Found listing with ID: EO61%20OVX
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO61%2520OVX%27 HTTP/1.1" 200 None
2026-03-29 22:07:09 [bca.uk] INFO: Scrape type for EO61%20OVX: 2
2026-03-29 22:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2337f209-45ff-57b7-b370-ccb04b4d58bb with identifier: EO61%20OVX
2026-03-29 22:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2337f209-45ff-57b7-b370-ccb04b4d58bb with scrape type 2
2026-03-29 22:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2337f209-45ff-57b7-b370-ccb04b4d58bb with scrape type 2
2026-03-29 22:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2337f209-45ff-57b7-b370-ccb04b4d58bb, identifier: EO61%20OVX
2026-03-29 22:07:09 [bca.uk] INFO: Found listing with ID: MM67%20RNV
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM67%2520RNV%27 HTTP/1.1" 200 None
2026-03-29 22:07:09 [bca.uk] INFO: Scrape type for MM67%20RNV: 2
2026-03-29 22:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2aaf8e0-6656-5ea0-a55c-8214d714b81c with identifier: MM67%20RNV
2026-03-29 22:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2aaf8e0-6656-5ea0-a55c-8214d714b81c with scrape type 2
2026-03-29 22:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2aaf8e0-6656-5ea0-a55c-8214d714b81c with scrape type 2
2026-03-29 22:07:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a2aaf8e0-6656-5ea0-a55c-8214d714b81c, identifier: MM67%20RNV
2026-03-29 22:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1f3b828e-d75c-5ff7-a14e-22edf0b6b900 with identifier: HL19%20RNJ
2026-03-29 22:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1f3b828e-d75c-5ff7-a14e-22edf0b6b900 with identifier: HL19%20RNJ
2026-03-29 22:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1f3b828e-d75c-5ff7-a14e-22edf0b6b900 with identifier: HL19%20RNJ to the API
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HL19%20RNJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1f3b828e-d75c-5ff7-a14e-22edf0b6b900',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HL19 RNJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HL19%20RNJ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': '320I',
'odometer': 34039,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW 320I 2.0 T SPORT TOURING STEP Estate',
'transmission': 'automatic',
'trim': 'T SPORT TOURING STEP',
'vin': 'WBA8G32040FH13753',
'year': 2019}
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HL19%2520RNJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:10 [bca.uk] INFO: Saving data for HL19%20RNJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774735451.543431, 'last_price_update_time': 1774822030.319565}
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HL19%2520RNJ') HTTP/1.1" 204 0
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699435182%27 HTTP/1.1" 200 None
2026-03-29 22:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435182 not downloaded yet
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146948%27 HTTP/1.1" 200 None
2026-03-29 22:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146948 not downloaded yet
2026-03-29 22:07:10 [scrapy.extensions.logstats] INFO: Crawled 153 pages (at 5 pages/min), scraped 489 items (at 121 items/min)
2026-03-29 22:07:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 200MiB
2026-03-29 22:07:10 [bca.uk] INFO: Found listing with ID: FH08%20ABU
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH08%2520ABU%27 HTTP/1.1" 200 None
2026-03-29 22:07:10 [bca.uk] INFO: Scrape type for FH08%20ABU: 0
2026-03-29 22:07:10 [bca.uk] INFO: Found listing with ID: FL14%20OFC
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL14%2520OFC%27 HTTP/1.1" 200 None
2026-03-29 22:07:10 [bca.uk] INFO: Scrape type for FL14%20OFC: 0
2026-03-29 22:07:10 [bca.uk] INFO: Found listing with ID: KX09%20PFF
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX09%2520PFF%27 HTTP/1.1" 200 None
2026-03-29 22:07:10 [bca.uk] INFO: Scrape type for KX09%20PFF: 0
2026-03-29 22:07:10 [bca.uk] INFO: Found listing with ID: LG61%20TGV
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG61%2520TGV%27 HTTP/1.1" 200 None
2026-03-29 22:07:10 [bca.uk] INFO: Scrape type for LG61%20TGV: 2
2026-03-29 22:07:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 889b94fe-dd95-5dd8-8d9a-cdf1267e6762 with identifier: LG61%20TGV
2026-03-29 22:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 889b94fe-dd95-5dd8-8d9a-cdf1267e6762 with scrape type 2
2026-03-29 22:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 889b94fe-dd95-5dd8-8d9a-cdf1267e6762 with scrape type 2
2026-03-29 22:07:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 889b94fe-dd95-5dd8-8d9a-cdf1267e6762, identifier: LG61%20TGV
2026-03-29 22:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2337f209-45ff-57b7-b370-ccb04b4d58bb with identifier: EO61%20OVX
2026-03-29 22:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2337f209-45ff-57b7-b370-ccb04b4d58bb with identifier: EO61%20OVX
2026-03-29 22:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2337f209-45ff-57b7-b370-ccb04b4d58bb with identifier: EO61%20OVX to the API
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO61%20OVX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2337f209-45ff-57b7-b370-ccb04b4d58bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EO61 OVX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EO61%20OVX&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MINI',
'model': 'COOPER',
'odometer': 79851,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.6 S Convertible',
'transmission': 'manual',
'trim': 'S',
'vin': 'WMWZP32050TY87687',
'year': 2011}
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO61%2520OVX%27 HTTP/1.1" 200 None
2026-03-29 22:07:10 [bca.uk] INFO: Saving data for EO61%20OVX: {'auction_closing_time': 1774864800.0, 'created_time': 1774735366.573635, 'last_price_update_time': 1774822030.806484}
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EO61%2520OVX') HTTP/1.1" 204 0
2026-03-29 22:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a2aaf8e0-6656-5ea0-a55c-8214d714b81c with identifier: MM67%20RNV
2026-03-29 22:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a2aaf8e0-6656-5ea0-a55c-8214d714b81c with identifier: MM67%20RNV
2026-03-29 22:07:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a2aaf8e0-6656-5ea0-a55c-8214d714b81c with identifier: MM67%20RNV to the API
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MM67%20RNV-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a2aaf8e0-6656-5ea0-a55c-8214d714b81c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MM67 RNV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MM67%20RNV&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'ECOSPORT',
'odometer': 45455,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD ECOSPORT 1.0 E/B 125 ST-LINE StationWagon',
'transmission': 'automatic',
'trim': 'E/B 125 ST-LINE',
'vin': 'WF01XXERK1JY37600',
'year': 2018}
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM67%2520RNV%27 HTTP/1.1" 200 None
2026-03-29 22:07:11 [bca.uk] INFO: Saving data for MM67%20RNV: {'auction_closing_time': 1774951200.0, 'created_time': 1774735497.308188, 'last_price_update_time': 1774822031.200555}
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MM67%2520RNV') HTTP/1.1" 204 0
2026-03-29 22:07:11 [bca.uk] INFO: Found listing with ID: KF19%20DKY
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF19%2520DKY%27 HTTP/1.1" 200 None
2026-03-29 22:07:11 [bca.uk] INFO: Scrape type for KF19%20DKY: 2
2026-03-29 22:07:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3f29b60-3863-5769-bd32-0a73da36e20b with identifier: KF19%20DKY
2026-03-29 22:07:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3f29b60-3863-5769-bd32-0a73da36e20b with scrape type 2
2026-03-29 22:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3f29b60-3863-5769-bd32-0a73da36e20b with scrape type 2
2026-03-29 22:07:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f3f29b60-3863-5769-bd32-0a73da36e20b, identifier: KF19%20DKY
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699124407%27 HTTP/1.1" 200 None
2026-03-29 22:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124407 not downloaded yet
2026-03-29 22:07:11 [bca.uk] INFO: Total items found: 100
2026-03-29 22:07:11 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded
2026-03-29 22:07:11 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:07:11 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:07:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 889b94fe-dd95-5dd8-8d9a-cdf1267e6762 with identifier: LG61%20TGV
2026-03-29 22:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 889b94fe-dd95-5dd8-8d9a-cdf1267e6762 with identifier: LG61%20TGV
2026-03-29 22:07:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 889b94fe-dd95-5dd8-8d9a-cdf1267e6762 with identifier: LG61%20TGV to the API
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 243,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LG61%20TGV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '889b94fe-dd95-5dd8-8d9a-cdf1267e6762',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LG61 TGV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LG61%20TGV&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 133385,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 TDV6 HSE StationWagon',
'transmission': 'automatic',
'trim': 'TDV6 HSE',
'vin': 'SALLSAAG3BA716346',
'year': 2011}
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG61%2520TGV%27 HTTP/1.1" 200 None
2026-03-29 22:07:11 [bca.uk] INFO: Saving data for LG61%20TGV: {'auction_closing_time': 1774864800.0, 'created_time': 1774610901.826446, 'last_price_update_time': 1774822031.632308}
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LG61%2520TGV') HTTP/1.1" 204 0
2026-03-29 22:07:11 [bca.uk] INFO: Found listing with ID: WN12%20FKU
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN12%2520FKU%27 HTTP/1.1" 200 None
2026-03-29 22:07:11 [bca.uk] INFO: Scrape type for WN12%20FKU: 2
2026-03-29 22:07:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30726c84-9b6d-55d7-85ab-840199d36e87 with identifier: WN12%20FKU
2026-03-29 22:07:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30726c84-9b6d-55d7-85ab-840199d36e87 with scrape type 2
2026-03-29 22:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30726c84-9b6d-55d7-85ab-840199d36e87 with scrape type 2
2026-03-29 22:07:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 30726c84-9b6d-55d7-85ab-840199d36e87, identifier: WN12%20FKU
2026-03-29 22:07:11 [bca.uk] INFO: Found listing with ID: AE58%20YDD
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE58%2520YDD%27 HTTP/1.1" 200 None
2026-03-29 22:07:11 [bca.uk] INFO: Scrape type for AE58%20YDD: 2
2026-03-29 22:07:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8291a8f-ab36-539f-839d-bb424053b7c9 with identifier: AE58%20YDD
2026-03-29 22:07:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8291a8f-ab36-539f-839d-bb424053b7c9 with scrape type 2
2026-03-29 22:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8291a8f-ab36-539f-839d-bb424053b7c9 with scrape type 2
2026-03-29 22:07:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a8291a8f-ab36-539f-839d-bb424053b7c9, identifier: AE58%20YDD
2026-03-29 22:07:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f3f29b60-3863-5769-bd32-0a73da36e20b with identifier: KF19%20DKY
2026-03-29 22:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f3f29b60-3863-5769-bd32-0a73da36e20b with identifier: KF19%20DKY
2026-03-29 22:07:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f3f29b60-3863-5769-bd32-0a73da36e20b with identifier: KF19%20DKY to the API
2026-03-29 22:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KF19%20DKY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f3f29b60-3863-5769-bd32-0a73da36e20b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KF19 DKY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KF19%20DKY&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 23622,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 TSI 95 BEATS DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI 95 BEATS DSG',
'vin': 'WVWZZZAWZKU027701',
'year': 2019}
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF19%2520DKY%27 HTTP/1.1" 200 None
2026-03-29 22:07:12 [bca.uk] INFO: Saving data for KF19%20DKY: {'auction_closing_time': 1774864800.0, 'created_time': 1774735452.296847, 'last_price_update_time': 1774822032.158208}
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KF19%2520DKY') HTTP/1.1" 204 0
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146962%27 HTTP/1.1" 200 None
2026-03-29 22:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146962 not downloaded yet
2026-03-29 22:07:12 [bca.uk] INFO: Found listing with ID: NU65%20OJO
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU65%2520OJO%27 HTTP/1.1" 200 None
2026-03-29 22:07:12 [bca.uk] INFO: Scrape type for NU65%20OJO: 0
2026-03-29 22:07:12 [bca.uk] INFO: Found listing with ID: PK10%20NKU
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK10%2520NKU%27 HTTP/1.1" 200 None
2026-03-29 22:07:12 [bca.uk] INFO: Scrape type for PK10%20NKU: 0
2026-03-29 22:07:12 [bca.uk] INFO: Found listing with ID: PO61%20YVU
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO61%2520YVU%27 HTTP/1.1" 200 None
2026-03-29 22:07:12 [bca.uk] INFO: Scrape type for PO61%20YVU: 0
2026-03-29 22:07:12 [bca.uk] INFO: Found listing with ID: MK19%20LHL
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK19%2520LHL%27 HTTP/1.1" 200 None
2026-03-29 22:07:12 [bca.uk] INFO: Scrape type for MK19%20LHL: 0
2026-03-29 22:07:12 [bca.uk] INFO: Found listing with ID: AV17%20OFO
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV17%2520OFO%27 HTTP/1.1" 200 None
2026-03-29 22:07:12 [bca.uk] INFO: Scrape type for AV17%20OFO: 2
2026-03-29 22:07:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62da7e4a-f128-5b70-86d8-39fd060a8d23 with identifier: AV17%20OFO
2026-03-29 22:07:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62da7e4a-f128-5b70-86d8-39fd060a8d23 with scrape type 2
2026-03-29 22:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62da7e4a-f128-5b70-86d8-39fd060a8d23 with scrape type 2
2026-03-29 22:07:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 62da7e4a-f128-5b70-86d8-39fd060a8d23, identifier: AV17%20OFO
2026-03-29 22:07:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 30726c84-9b6d-55d7-85ab-840199d36e87 with identifier: WN12%20FKU
2026-03-29 22:07:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 30726c84-9b6d-55d7-85ab-840199d36e87 with identifier: WN12%20FKU
2026-03-29 22:07:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 30726c84-9b6d-55d7-85ab-840199d36e87 with identifier: WN12%20FKU to the API
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN12%20FKU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '30726c84-9b6d-55d7-85ab-840199d36e87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WN12 FKU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WN12%20FKU&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FIAT',
'model': '500',
'odometer': 73606,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 LOUNGE S/S Hatchback',
'transmission': 'manual',
'trim': 'LOUNGE S/S',
'vin': 'ZFA31200000820523',
'year': 2012}
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN12%2520FKU%27 HTTP/1.1" 200 None
2026-03-29 22:07:12 [bca.uk] INFO: Saving data for WN12%20FKU: {'auction_closing_time': 1774864800.0, 'created_time': 1774735367.79219, 'last_price_update_time': 1774822032.66512}
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WN12%2520FKU') HTTP/1.1" 204 0
2026-03-29 22:07:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a8291a8f-ab36-539f-839d-bb424053b7c9 with identifier: AE58%20YDD
2026-03-29 22:07:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a8291a8f-ab36-539f-839d-bb424053b7c9 with identifier: AE58%20YDD
2026-03-29 22:07:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a8291a8f-ab36-539f-839d-bb424053b7c9 with identifier: AE58%20YDD to the API
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE58%20YDD-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a8291a8f-ab36-539f-839d-bb424053b7c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE58 YDD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AE58%20YDD&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 62528,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 SXI 16V Hatchback',
'transmission': 'manual',
'trim': 'SXI 16V',
'vin': 'W0L0SDL6894049935',
'year': 2008}
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE58%2520YDD%27 HTTP/1.1" 200 None
2026-03-29 22:07:13 [bca.uk] INFO: Saving data for AE58%20YDD: {'auction_closing_time': 1774864800.0, 'created_time': 1774735497.688483, 'last_price_update_time': 1774822033.034088}
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AE58%2520YDD') HTTP/1.1" 204 0
2026-03-29 22:07:13 [bca.uk] INFO: Found listing with ID: LG72%20UJY
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG72%2520UJY%27 HTTP/1.1" 200 None
2026-03-29 22:07:13 [bca.uk] INFO: Scrape type for LG72%20UJY: 2
2026-03-29 22:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55409954-1173-5276-a10a-2f132fbeb032 with identifier: LG72%20UJY
2026-03-29 22:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55409954-1173-5276-a10a-2f132fbeb032 with scrape type 2
2026-03-29 22:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55409954-1173-5276-a10a-2f132fbeb032 with scrape type 2
2026-03-29 22:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 55409954-1173-5276-a10a-2f132fbeb032, identifier: LG72%20UJY
2026-03-29 22:07:13 [bca.uk] INFO: Found listing with ID: LN03%20XSM
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN03%2520XSM%27 HTTP/1.1" 200 None
2026-03-29 22:07:13 [bca.uk] INFO: Scrape type for LN03%20XSM: 2
2026-03-29 22:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8aa6468d-a0af-5b55-ae84-c596442f3580 with identifier: LN03%20XSM
2026-03-29 22:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aa6468d-a0af-5b55-ae84-c596442f3580 with scrape type 2
2026-03-29 22:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8aa6468d-a0af-5b55-ae84-c596442f3580 with scrape type 2
2026-03-29 22:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8aa6468d-a0af-5b55-ae84-c596442f3580, identifier: LN03%20XSM
2026-03-29 22:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 62da7e4a-f128-5b70-86d8-39fd060a8d23 with identifier: AV17%20OFO
2026-03-29 22:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 62da7e4a-f128-5b70-86d8-39fd060a8d23 with identifier: AV17%20OFO
2026-03-29 22:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 62da7e4a-f128-5b70-86d8-39fd060a8d23 with identifier: AV17%20OFO to the API
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV17%20OFO-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '62da7e4a-f128-5b70-86d8-39fd060a8d23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV17 OFO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV17%20OFO&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 78923,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 100 ZETEC EDITION Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 ZETEC EDITION',
'vin': 'WF05XXGCC5HU49279',
'year': 2017}
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV17%2520OFO%27 HTTP/1.1" 200 None
2026-03-29 22:07:13 [bca.uk] INFO: Saving data for AV17%20OFO: {'auction_closing_time': 1774864800.0, 'created_time': 1774621506.603336, 'last_price_update_time': 1774822033.538374}
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV17%2520OFO') HTTP/1.1" 204 0
2026-03-29 22:07:13 [bca.uk] INFO: Found listing with ID: FD70%20LYC
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD70%2520LYC%27 HTTP/1.1" 200 None
2026-03-29 22:07:13 [bca.uk] INFO: Scrape type for FD70%20LYC: 2
2026-03-29 22:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5dbf164-beca-542e-a8d7-8ec419cfcb14 with identifier: FD70%20LYC
2026-03-29 22:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5dbf164-beca-542e-a8d7-8ec419cfcb14 with scrape type 2
2026-03-29 22:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5dbf164-beca-542e-a8d7-8ec419cfcb14 with scrape type 2
2026-03-29 22:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c5dbf164-beca-542e-a8d7-8ec419cfcb14, identifier: FD70%20LYC
2026-03-29 22:07:13 [bca.uk] INFO: Found listing with ID: KK07%20YAO
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK07%2520YAO%27 HTTP/1.1" 200 None
2026-03-29 22:07:13 [bca.uk] INFO: Scrape type for KK07%20YAO: 2
2026-03-29 22:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f9f14f-130c-5d1a-99c0-15c1239aa436 with identifier: KK07%20YAO
2026-03-29 22:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f9f14f-130c-5d1a-99c0-15c1239aa436 with scrape type 2
2026-03-29 22:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5f9f14f-130c-5d1a-99c0-15c1239aa436 with scrape type 2
2026-03-29 22:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d5f9f14f-130c-5d1a-99c0-15c1239aa436, identifier: KK07%20YAO
2026-03-29 22:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 55409954-1173-5276-a10a-2f132fbeb032 with identifier: LG72%20UJY
2026-03-29 22:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 55409954-1173-5276-a10a-2f132fbeb032 with identifier: LG72%20UJY
2026-03-29 22:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 55409954-1173-5276-a10a-2f132fbeb032 with identifier: LG72%20UJY to the API
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LG72%20UJY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '55409954-1173-5276-a10a-2f132fbeb032',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LG72 UJY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LG72%20UJY&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MINI',
'model': 'COOPER',
'odometer': 52994,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.5 EXCLUSIVE STEP Convertible',
'transmission': 'automatic',
'trim': 'EXCLUSIVE STEP',
'vin': 'WMW22DL0603P57860',
'year': 2022}
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG72%2520UJY%27 HTTP/1.1" 200 None
2026-03-29 22:07:14 [bca.uk] INFO: Saving data for LG72%20UJY: {'auction_closing_time': 1774864800.0, 'created_time': 1774735439.003889, 'last_price_update_time': 1774822034.038328}
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LG72%2520UJY') HTTP/1.1" 204 0
2026-03-29 22:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8aa6468d-a0af-5b55-ae84-c596442f3580 with identifier: LN03%20XSM
2026-03-29 22:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8aa6468d-a0af-5b55-ae84-c596442f3580 with identifier: LN03%20XSM
2026-03-29 22:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8aa6468d-a0af-5b55-ae84-c596442f3580 with identifier: LN03%20XSM to the API
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 212,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LN03%20XSM-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8aa6468d-a0af-5b55-ae84-c596442f3580',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LN03 XSM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LN03%20XSM&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'MERCEDES-BENZ',
'model': 'C200',
'odometer': 79640,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C200 1.8 K AVANTGARDE SE Saloon',
'transmission': 'manual',
'trim': 'K AVANTGARDE SE',
'vin': 'WDC2030422R102206',
'year': 2003}
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN03%2520XSM%27 HTTP/1.1" 200 None
2026-03-29 22:07:14 [bca.uk] INFO: Saving data for LN03%20XSM: {'auction_closing_time': 1774864800.0, 'created_time': 1774304070.782947, 'last_price_update_time': 1774822034.340819}
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LN03%2520XSM') HTTP/1.1" 204 0
2026-03-29 22:07:14 [bca.uk] INFO: Found listing with ID: NG16%20RUC
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG16%2520RUC%27 HTTP/1.1" 200 None
2026-03-29 22:07:14 [bca.uk] INFO: Scrape type for NG16%20RUC: 2
2026-03-29 22:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f24d578-38f3-5587-ad8d-873caa79348d with identifier: NG16%20RUC
2026-03-29 22:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f24d578-38f3-5587-ad8d-873caa79348d with scrape type 2
2026-03-29 22:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f24d578-38f3-5587-ad8d-873caa79348d with scrape type 2
2026-03-29 22:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1f24d578-38f3-5587-ad8d-873caa79348d, identifier: NG16%20RUC
2026-03-29 22:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c5dbf164-beca-542e-a8d7-8ec419cfcb14 with identifier: FD70%20LYC
2026-03-29 22:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c5dbf164-beca-542e-a8d7-8ec419cfcb14 with identifier: FD70%20LYC
2026-03-29 22:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c5dbf164-beca-542e-a8d7-8ec419cfcb14 with identifier: FD70%20LYC to the API
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FD70%20LYC-GB',
'category': 'Car',
'color': 'orange',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c5dbf164-beca-542e-a8d7-8ec419cfcb14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FD70 LYC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FD70%20LYC&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 81045,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 TURBO 100 SRI Hatchback',
'transmission': 'manual',
'trim': 'TURBO 100 SRI',
'vin': 'VXKUPHNKKL4447164',
'year': 2020}
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD70%2520LYC%27 HTTP/1.1" 200 None
2026-03-29 22:07:14 [bca.uk] INFO: Saving data for FD70%20LYC: {'auction_closing_time': 1774951200.0, 'created_time': 1774735358.957511, 'last_price_update_time': 1774822034.755733}
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FD70%2520LYC') HTTP/1.1" 204 0
2026-03-29 22:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d5f9f14f-130c-5d1a-99c0-15c1239aa436 with identifier: KK07%20YAO
2026-03-29 22:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d5f9f14f-130c-5d1a-99c0-15c1239aa436 with identifier: KK07%20YAO
2026-03-29 22:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d5f9f14f-130c-5d1a-99c0-15c1239aa436 with identifier: KK07%20YAO to the API
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 355,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KK07%20YAO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd5f9f14f-130c-5d1a-99c0-15c1239aa436',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KK07 YAO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KK07%20YAO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MAZDA',
'model': '5',
'odometer': 132337,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MAZDA 5 1.8 TS2 MPV',
'transmission': 'manual',
'trim': 'TS2',
'vin': 'JMZCR198200215100',
'year': 2007}
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK07%2520YAO%27 HTTP/1.1" 200 None
2026-03-29 22:07:15 [bca.uk] INFO: Saving data for KK07%20YAO: {'auction_closing_time': 1774864800.0, 'created_time': 1774735498.56025, 'last_price_update_time': 1774822035.037586}
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KK07%2520YAO') HTTP/1.1" 204 0
2026-03-29 22:07:15 [bca.uk] INFO: Found listing with ID: RJ69%20GGF
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ69%2520GGF%27 HTTP/1.1" 200 None
2026-03-29 22:07:15 [bca.uk] INFO: Scrape type for RJ69%20GGF: 0
2026-03-29 22:07:15 [bca.uk] INFO: Found listing with ID: RK68%20WZS
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK68%2520WZS%27 HTTP/1.1" 200 None
2026-03-29 22:07:15 [bca.uk] INFO: Scrape type for RK68%20WZS: 2
2026-03-29 22:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e86ebe18-a2b5-52bb-9b19-9683b6ffda08 with identifier: RK68%20WZS
2026-03-29 22:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e86ebe18-a2b5-52bb-9b19-9683b6ffda08 with scrape type 2
2026-03-29 22:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e86ebe18-a2b5-52bb-9b19-9683b6ffda08 with scrape type 2
2026-03-29 22:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e86ebe18-a2b5-52bb-9b19-9683b6ffda08, identifier: RK68%20WZS
2026-03-29 22:07:15 [bca.uk] INFO: Found listing with ID: KF54%20RYD
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF54%2520RYD%27 HTTP/1.1" 200 None
2026-03-29 22:07:15 [bca.uk] INFO: Scrape type for KF54%20RYD: 0
2026-03-29 22:07:15 [bca.uk] INFO: Found listing with ID: DE59%20LRX
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE59%2520LRX%27 HTTP/1.1" 200 None
2026-03-29 22:07:15 [bca.uk] INFO: Scrape type for DE59%20LRX: 0
2026-03-29 22:07:15 [bca.uk] INFO: Found listing with ID: YB08%20SFN
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB08%2520SFN%27 HTTP/1.1" 200 None
2026-03-29 22:07:15 [bca.uk] INFO: Scrape type for YB08%20SFN: 2
2026-03-29 22:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef473b27-2adc-5a8e-8fc2-8406885a385c with identifier: YB08%20SFN
2026-03-29 22:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef473b27-2adc-5a8e-8fc2-8406885a385c with scrape type 2
2026-03-29 22:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef473b27-2adc-5a8e-8fc2-8406885a385c with scrape type 2
2026-03-29 22:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ef473b27-2adc-5a8e-8fc2-8406885a385c, identifier: YB08%20SFN
2026-03-29 22:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1f24d578-38f3-5587-ad8d-873caa79348d with identifier: NG16%20RUC
2026-03-29 22:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1f24d578-38f3-5587-ad8d-873caa79348d with identifier: NG16%20RUC
2026-03-29 22:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1f24d578-38f3-5587-ad8d-873caa79348d with identifier: NG16%20RUC to the API
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 93,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NG16%20RUC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1f24d578-38f3-5587-ad8d-873caa79348d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NG16 RUC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NG16%20RUC&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 98007,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.5 DCI 90 ACENTA Hatchback',
'transmission': 'manual',
'trim': 'DCI 90 ACENTA',
'vin': 'SJNTCAE12U1163110',
'year': 2016}
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG16%2520RUC%27 HTTP/1.1" 200 None
2026-03-29 22:07:15 [bca.uk] INFO: Saving data for NG16%20RUC: {'auction_closing_time': 1774864800.0, 'created_time': 1774621505.106301, 'last_price_update_time': 1774822035.583243}
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NG16%2520RUC') HTTP/1.1" 204 0
2026-03-29 22:07:15 [bca.uk] INFO: Found listing with ID: WX18%20RKK
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX18%2520RKK%27 HTTP/1.1" 200 None
2026-03-29 22:07:15 [bca.uk] INFO: Scrape type for WX18%20RKK: 2
2026-03-29 22:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4ec4e6f-59e8-58bb-b6e7-08502c0644b2 with identifier: WX18%20RKK
2026-03-29 22:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4ec4e6f-59e8-58bb-b6e7-08502c0644b2 with scrape type 2
2026-03-29 22:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4ec4e6f-59e8-58bb-b6e7-08502c0644b2 with scrape type 2
2026-03-29 22:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a4ec4e6f-59e8-58bb-b6e7-08502c0644b2, identifier: WX18%20RKK
2026-03-29 22:07:15 [bca.uk] INFO: Found listing with ID: M5%20SNV
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M5%2520SNV%27 HTTP/1.1" 200 None
2026-03-29 22:07:15 [bca.uk] INFO: Scrape type for M5%20SNV: 0
2026-03-29 22:07:15 [bca.uk] INFO: Found listing with ID: VF15%20KKY
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF15%2520KKY%27 HTTP/1.1" 200 None
2026-03-29 22:07:15 [bca.uk] INFO: Scrape type for VF15%20KKY: 2
2026-03-29 22:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3a29049-d0cb-5ad0-80d6-fe24d9cb8763 with identifier: VF15%20KKY
2026-03-29 22:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3a29049-d0cb-5ad0-80d6-fe24d9cb8763 with scrape type 2
2026-03-29 22:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3a29049-d0cb-5ad0-80d6-fe24d9cb8763 with scrape type 2
2026-03-29 22:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a3a29049-d0cb-5ad0-80d6-fe24d9cb8763, identifier: VF15%20KKY
2026-03-29 22:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e86ebe18-a2b5-52bb-9b19-9683b6ffda08 with identifier: RK68%20WZS
2026-03-29 22:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e86ebe18-a2b5-52bb-9b19-9683b6ffda08 with identifier: RK68%20WZS
2026-03-29 22:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e86ebe18-a2b5-52bb-9b19-9683b6ffda08 with identifier: RK68%20WZS to the API
2026-03-29 22:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 175,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RK68%20WZS-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e86ebe18-a2b5-52bb-9b19-9683b6ffda08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RK68 WZS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RK68%20WZS&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 45933,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'HONDA CR-V 2.0 I-VTEC SE PLUS 4WD StationWagon',
'transmission': 'automatic',
'trim': 'I-VTEC SE PLUS 4WD',
'vin': 'SHSRE5850JU005875',
'year': 2018}
2026-03-29 22:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK68%2520WZS%27 HTTP/1.1" 200 None
2026-03-29 22:07:16 [bca.uk] INFO: Saving data for RK68%20WZS: {'auction_closing_time': 1774864800.0, 'created_time': 1774735439.639241, 'last_price_update_time': 1774822036.127303}
2026-03-29 22:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RK68%2520WZS') HTTP/1.1" 204 0
2026-03-29 22:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ef473b27-2adc-5a8e-8fc2-8406885a385c with identifier: YB08%20SFN
2026-03-29 22:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ef473b27-2adc-5a8e-8fc2-8406885a385c with identifier: YB08%20SFN
2026-03-29 22:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ef473b27-2adc-5a8e-8fc2-8406885a385c with identifier: YB08%20SFN to the API
2026-03-29 22:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YB08%20SFN-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ef473b27-2adc-5a8e-8fc2-8406885a385c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YB08 SFN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YB08%20SFN&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'MINI',
'model': 'ONE',
'odometer': 88432,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MINI ONE 1.4 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWME32060TM55559',
'year': 2008}
2026-03-29 22:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB08%2520SFN%27 HTTP/1.1" 200 None
2026-03-29 22:07:16 [bca.uk] INFO: Saving data for YB08%20SFN: {'auction_closing_time': 1774864800.0, 'created_time': 1774621483.623975, 'last_price_update_time': 1774822036.507312}
2026-03-29 22:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YB08%2520SFN') HTTP/1.1" 204 0
2026-03-29 22:07:16 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:07:16 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:07:16 [bca.uk] INFO: Found listing with ID: SG15%20UVN
2026-03-29 22:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG15%2520UVN%27 HTTP/1.1" 200 None
2026-03-29 22:07:16 [bca.uk] INFO: Scrape type for SG15%20UVN: 2
2026-03-29 22:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b221976-219b-5fe1-b558-0adb253a35c9 with identifier: SG15%20UVN
2026-03-29 22:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b221976-219b-5fe1-b558-0adb253a35c9 with scrape type 2
2026-03-29 22:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b221976-219b-5fe1-b558-0adb253a35c9 with scrape type 2
2026-03-29 22:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4b221976-219b-5fe1-b558-0adb253a35c9, identifier: SG15%20UVN
2026-03-29 22:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a4ec4e6f-59e8-58bb-b6e7-08502c0644b2 with identifier: WX18%20RKK
2026-03-29 22:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a4ec4e6f-59e8-58bb-b6e7-08502c0644b2 with identifier: WX18%20RKK
2026-03-29 22:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a4ec4e6f-59e8-58bb-b6e7-08502c0644b2 with identifier: WX18%20RKK to the API
2026-03-29 22:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WX18%20RKK-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a4ec4e6f-59e8-58bb-b6e7-08502c0644b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WX18 RKK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WX18%20RKK&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'MERCEDES-BENZ',
'model': 'A200 D',
'odometer': 63076,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A200 D 2.1 AMG LINE EXECUTIVE DCT Hatchback',
'transmission': 'automatic',
'trim': 'AMG LINE EXECUTIVE DCT',
'vin': 'WDD1760082J757673',
'year': 2018}
2026-03-29 22:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX18%2520RKK%27 HTTP/1.1" 200 None
2026-03-29 22:07:17 [bca.uk] INFO: Saving data for WX18%20RKK: {'auction_closing_time': 1774951200.0, 'created_time': 1774735358.060703, 'last_price_update_time': 1774822037.002653}
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WX18%2520RKK') HTTP/1.1" 204 0
2026-03-29 22:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a3a29049-d0cb-5ad0-80d6-fe24d9cb8763 with identifier: VF15%20KKY
2026-03-29 22:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a3a29049-d0cb-5ad0-80d6-fe24d9cb8763 with identifier: VF15%20KKY
2026-03-29 22:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a3a29049-d0cb-5ad0-80d6-fe24d9cb8763 with identifier: VF15%20KKY to the API
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 39,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VF15%20KKY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'a3a29049-d0cb-5ad0-80d6-fe24d9cb8763',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VF15 KKY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VF15%20KKY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 115945,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.4 TSI GTE DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI GTE DSG',
'vin': 'WVWZZZAUZGW801392',
'year': 2015}
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF15%2520KKY%27 HTTP/1.1" 200 None
2026-03-29 22:07:17 [bca.uk] INFO: Saving data for VF15%20KKY: {'auction_closing_time': 1774864800.0, 'created_time': 1774735491.967205, 'last_price_update_time': 1774822037.283537}
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VF15%2520KKY') HTTP/1.1" 204 0
2026-03-29 22:07:17 [bca.uk] INFO: Found listing with ID: YH70%20HRN
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH70%2520HRN%27 HTTP/1.1" 200 None
2026-03-29 22:07:17 [bca.uk] INFO: Scrape type for YH70%20HRN: 2
2026-03-29 22:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fa3513c-d7c1-5913-b481-6acfffd741bf with identifier: YH70%20HRN
2026-03-29 22:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fa3513c-d7c1-5913-b481-6acfffd741bf with scrape type 2
2026-03-29 22:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fa3513c-d7c1-5913-b481-6acfffd741bf with scrape type 2
2026-03-29 22:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6fa3513c-d7c1-5913-b481-6acfffd741bf, identifier: YH70%20HRN
2026-03-29 22:07:17 [bca.uk] INFO: Found listing with ID: YK63%20HJU
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK63%2520HJU%27 HTTP/1.1" 200 None
2026-03-29 22:07:17 [bca.uk] INFO: Scrape type for YK63%20HJU: 0
2026-03-29 22:07:17 [bca.uk] INFO: Found listing with ID: VN10%20HZJ
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN10%2520HZJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:17 [bca.uk] INFO: Scrape type for VN10%20HZJ: 2
2026-03-29 22:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af7614dc-d0aa-516f-9e3a-5a12f63942d2 with identifier: VN10%20HZJ
2026-03-29 22:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af7614dc-d0aa-516f-9e3a-5a12f63942d2 with scrape type 2
2026-03-29 22:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af7614dc-d0aa-516f-9e3a-5a12f63942d2 with scrape type 2
2026-03-29 22:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: af7614dc-d0aa-516f-9e3a-5a12f63942d2, identifier: VN10%20HZJ
2026-03-29 22:07:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4b221976-219b-5fe1-b558-0adb253a35c9 with identifier: SG15%20UVN
2026-03-29 22:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4b221976-219b-5fe1-b558-0adb253a35c9 with identifier: SG15%20UVN
2026-03-29 22:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4b221976-219b-5fe1-b558-0adb253a35c9 with identifier: SG15%20UVN to the API
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SG15%20UVN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4b221976-219b-5fe1-b558-0adb253a35c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SG15 UVN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SG15%20UVN&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'SKODA',
'model': 'FABIA',
'odometer': 105020,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'SKODA FABIA 1.2 TSI 90 SE Estate',
'transmission': 'manual',
'trim': 'TSI 90 SE',
'vin': 'TMBKM6NJ5FZ016779',
'year': 2015}
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG15%2520UVN%27 HTTP/1.1" 200 None
2026-03-29 22:07:17 [bca.uk] INFO: Saving data for SG15%20UVN: {'auction_closing_time': 1774864800.0, 'created_time': 1774621523.097573, 'last_price_update_time': 1774822037.802533}
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SG15%2520UVN') HTTP/1.1" 204 0
2026-03-29 22:07:17 [bca.uk] INFO: Found listing with ID: RJ71%20WJK
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ71%2520WJK%27 HTTP/1.1" 200 None
2026-03-29 22:07:17 [bca.uk] INFO: Scrape type for RJ71%20WJK: 2
2026-03-29 22:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45e8e181-dc16-5b78-833d-28f874a8334d with identifier: RJ71%20WJK
2026-03-29 22:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e8e181-dc16-5b78-833d-28f874a8334d with scrape type 2
2026-03-29 22:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45e8e181-dc16-5b78-833d-28f874a8334d with scrape type 2
2026-03-29 22:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 45e8e181-dc16-5b78-833d-28f874a8334d, identifier: RJ71%20WJK
2026-03-29 22:07:17 [bca.uk] INFO: Found listing with ID: WN16%20MXA
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN16%2520MXA%27 HTTP/1.1" 200 None
2026-03-29 22:07:17 [bca.uk] INFO: Scrape type for WN16%20MXA: 2
2026-03-29 22:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4011303-c936-5ad4-909d-9af520e69082 with identifier: WN16%20MXA
2026-03-29 22:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4011303-c936-5ad4-909d-9af520e69082 with scrape type 2
2026-03-29 22:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4011303-c936-5ad4-909d-9af520e69082 with scrape type 2
2026-03-29 22:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c4011303-c936-5ad4-909d-9af520e69082, identifier: WN16%20MXA
2026-03-29 22:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6fa3513c-d7c1-5913-b481-6acfffd741bf with identifier: YH70%20HRN
2026-03-29 22:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6fa3513c-d7c1-5913-b481-6acfffd741bf with identifier: YH70%20HRN
2026-03-29 22:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6fa3513c-d7c1-5913-b481-6acfffd741bf with identifier: YH70%20HRN to the API
2026-03-29 22:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH70%20HRN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6fa3513c-d7c1-5913-b481-6acfffd741bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH70 HRN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH70%20HRN&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'SEAT',
'model': 'IBIZA',
'odometer': 45227,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'SEAT IBIZA 1.0 TSI 115 FR EZ Hatchback',
'transmission': 'manual',
'trim': 'TSI 115 FR EZ',
'vin': 'VSSZZZKJZLR157377',
'year': 2020}
2026-03-29 22:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH70%2520HRN%27 HTTP/1.1" 200 None
2026-03-29 22:07:18 [bca.uk] INFO: Saving data for YH70%20HRN: {'auction_closing_time': 1774864800.0, 'created_time': 1774735438.65293, 'last_price_update_time': 1774822038.325696}
2026-03-29 22:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH70%2520HRN') HTTP/1.1" 204 0
2026-03-29 22:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: af7614dc-d0aa-516f-9e3a-5a12f63942d2 with identifier: VN10%20HZJ
2026-03-29 22:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: af7614dc-d0aa-516f-9e3a-5a12f63942d2 with identifier: VN10%20HZJ
2026-03-29 22:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: af7614dc-d0aa-516f-9e3a-5a12f63942d2 with identifier: VN10%20HZJ to the API
2026-03-29 22:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VN10%20HZJ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'af7614dc-d0aa-516f-9e3a-5a12f63942d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VN10 HZJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VN10%20HZJ&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'KA',
'odometer': 86953,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD KA 1.2 STUDIO Hatchback',
'transmission': 'manual',
'trim': 'STUDIO',
'vin': 'WF0UXXLTRUAS70777',
'year': 2010}
2026-03-29 22:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN10%2520HZJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:18 [bca.uk] INFO: Saving data for VN10%20HZJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774610896.48492, 'last_price_update_time': 1774822038.617118}
2026-03-29 22:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VN10%2520HZJ') HTTP/1.1" 204 0
2026-03-29 22:07:18 [bca.uk] INFO: Found listing with ID: YF14%20OCH
2026-03-29 22:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF14%2520OCH%27 HTTP/1.1" 200 None
2026-03-29 22:07:18 [bca.uk] INFO: Scrape type for YF14%20OCH: 2
2026-03-29 22:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ffcf2cb-2013-506c-a876-97bed46c2d21 with identifier: YF14%20OCH
2026-03-29 22:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ffcf2cb-2013-506c-a876-97bed46c2d21 with scrape type 2
2026-03-29 22:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ffcf2cb-2013-506c-a876-97bed46c2d21 with scrape type 2
2026-03-29 22:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7ffcf2cb-2013-506c-a876-97bed46c2d21, identifier: YF14%20OCH
2026-03-29 22:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 45e8e181-dc16-5b78-833d-28f874a8334d with identifier: RJ71%20WJK
2026-03-29 22:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 45e8e181-dc16-5b78-833d-28f874a8334d with identifier: RJ71%20WJK
2026-03-29 22:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 45e8e181-dc16-5b78-833d-28f874a8334d with identifier: RJ71%20WJK to the API
2026-03-29 22:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RJ71%20WJK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '45e8e181-dc16-5b78-833d-28f874a8334d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RJ71 WJK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RJ71%20WJK&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'ABARTH',
'model': '595',
'odometer': 64598,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'ABARTH 595 1.4 T-JET 165 F595 Hatchback',
'transmission': 'automatic',
'trim': 'T-JET 165 F595',
'vin': 'ZFABF11H0NJF87300',
'year': 2021}
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ71%2520WJK%27 HTTP/1.1" 200 None
2026-03-29 22:07:19 [bca.uk] INFO: Saving data for RJ71%20WJK: {'auction_closing_time': 1774951200.0, 'created_time': 1774735356.838422, 'last_price_update_time': 1774822039.020309}
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RJ71%2520WJK') HTTP/1.1" 204 0
2026-03-29 22:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c4011303-c936-5ad4-909d-9af520e69082 with identifier: WN16%20MXA
2026-03-29 22:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c4011303-c936-5ad4-909d-9af520e69082 with identifier: WN16%20MXA
2026-03-29 22:07:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c4011303-c936-5ad4-909d-9af520e69082 with identifier: WN16%20MXA to the API
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN16%20MXA-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c4011303-c936-5ad4-909d-9af520e69082',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WN16 MXA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WN16%20MXA&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FIAT',
'model': '500X',
'odometer': 73944,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FIAT 500X 2.0 M/JET 140 4X4 CROSS PLUS Hatchback',
'transmission': 'automatic',
'trim': 'M/JET 140 4X4 CROSS PLUS',
'vin': 'ZFA3340000P442918',
'year': 2016}
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN16%2520MXA%27 HTTP/1.1" 200 None
2026-03-29 22:07:19 [bca.uk] INFO: Saving data for WN16%20MXA: {'auction_closing_time': 1774864800.0, 'created_time': 1774735489.423702, 'last_price_update_time': 1774822039.310116}
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WN16%2520MXA') HTTP/1.1" 204 0
2026-03-29 22:07:19 [bca.uk] INFO: Found listing with ID: MP19%20HZK
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520HZK%27 HTTP/1.1" 200 None
2026-03-29 22:07:19 [bca.uk] INFO: Scrape type for MP19%20HZK: 0
2026-03-29 22:07:19 [bca.uk] INFO: Found listing with ID: MT23%20TUO
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT23%2520TUO%27 HTTP/1.1" 200 None
2026-03-29 22:07:19 [bca.uk] INFO: Scrape type for MT23%20TUO: 0
2026-03-29 22:07:19 [bca.uk] INFO: Found listing with ID: NU72%20GYN
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU72%2520GYN%27 HTTP/1.1" 200 None
2026-03-29 22:07:19 [bca.uk] INFO: Scrape type for NU72%20GYN: 0
2026-03-29 22:07:19 [bca.uk] INFO: Found listing with ID: RGZ%202258
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RGZ%25202258%27 HTTP/1.1" 200 None
2026-03-29 22:07:19 [bca.uk] INFO: Scrape type for RGZ%202258: 2
2026-03-29 22:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df646afa-cd7d-59ba-af23-e32bf2546109 with identifier: RGZ%202258
2026-03-29 22:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df646afa-cd7d-59ba-af23-e32bf2546109 with scrape type 2
2026-03-29 22:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df646afa-cd7d-59ba-af23-e32bf2546109 with scrape type 2
2026-03-29 22:07:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: df646afa-cd7d-59ba-af23-e32bf2546109, identifier: RGZ%202258
2026-03-29 22:07:19 [bca.uk] INFO: Found listing with ID: RY07%20SLU
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY07%2520SLU%27 HTTP/1.1" 200 None
2026-03-29 22:07:19 [bca.uk] INFO: Scrape type for RY07%20SLU: 0
2026-03-29 22:07:19 [bca.uk] INFO: Found listing with ID: W12%20SWW
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27W12%2520SWW%27 HTTP/1.1" 200 None
2026-03-29 22:07:19 [bca.uk] INFO: Scrape type for W12%20SWW: 0
2026-03-29 22:07:19 [bca.uk] INFO: Found listing with ID: ET12%20EPJ
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET12%2520EPJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:19 [bca.uk] INFO: Scrape type for ET12%20EPJ: 0
2026-03-29 22:07:19 [bca.uk] INFO: Found listing with ID: KT07%20CZW
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT07%2520CZW%27 HTTP/1.1" 200 None
2026-03-29 22:07:19 [bca.uk] INFO: Scrape type for KT07%20CZW: 0
2026-03-29 22:07:19 [bca.uk] INFO: Found listing with ID: GU05%20LVY
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU05%2520LVY%27 HTTP/1.1" 200 None
2026-03-29 22:07:19 [bca.uk] INFO: Scrape type for GU05%20LVY: 2
2026-03-29 22:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05f5389c-b833-5c19-8373-cc7c365a1ca4 with identifier: GU05%20LVY
2026-03-29 22:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05f5389c-b833-5c19-8373-cc7c365a1ca4 with scrape type 2
2026-03-29 22:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05f5389c-b833-5c19-8373-cc7c365a1ca4 with scrape type 2
2026-03-29 22:07:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 05f5389c-b833-5c19-8373-cc7c365a1ca4, identifier: GU05%20LVY
2026-03-29 22:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7ffcf2cb-2013-506c-a876-97bed46c2d21 with identifier: YF14%20OCH
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-29 22:07:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 22:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7ffcf2cb-2013-506c-a876-97bed46c2d21 with identifier: YF14%20OCH
2026-03-29 22:07:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7ffcf2cb-2013-506c-a876-97bed46c2d21 with identifier: YF14%20OCH to the API
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF14%20OCH-GB',
'category': 'Car',
'color': 'beige',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7ffcf2cb-2013-506c-a876-97bed46c2d21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF14 OCH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF14%20OCH&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 52645,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN 2.0 TDI 177 BMT 4M MATCH DSG StationWagon',
'transmission': 'automatic',
'trim': 'TDI 177 BMT 4M MATCH DSG',
'vin': 'WVGZZZ5NZEW082934',
'year': 2014}
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF14%2520OCH%27 HTTP/1.1" 200 None
2026-03-29 22:07:20 [bca.uk] INFO: Saving data for YF14%20OCH: {'auction_closing_time': 1774864800.0, 'created_time': 1774621521.751804, 'last_price_update_time': 1774822040.071467}
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF14%2520OCH') HTTP/1.1" 204 0
2026-03-29 22:07:20 [bca.uk] INFO: Found listing with ID: WN70%20GXV
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN70%2520GXV%27 HTTP/1.1" 200 None
2026-03-29 22:07:20 [bca.uk] INFO: Scrape type for WN70%20GXV: 2
2026-03-29 22:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e568b76a-20a9-5c16-99a7-ea60aeecf1e0 with identifier: WN70%20GXV
2026-03-29 22:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e568b76a-20a9-5c16-99a7-ea60aeecf1e0 with scrape type 2
2026-03-29 22:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e568b76a-20a9-5c16-99a7-ea60aeecf1e0 with scrape type 2
2026-03-29 22:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e568b76a-20a9-5c16-99a7-ea60aeecf1e0, identifier: WN70%20GXV
2026-03-29 22:07:20 [bca.uk] INFO: Found listing with ID: GH15%20HTD
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GH15%2520HTD%27 HTTP/1.1" 200 None
2026-03-29 22:07:20 [bca.uk] INFO: Scrape type for GH15%20HTD: 0
2026-03-29 22:07:20 [bca.uk] INFO: Found listing with ID: LT66%20HCJ
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT66%2520HCJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:20 [bca.uk] INFO: Scrape type for LT66%20HCJ: 2
2026-03-29 22:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c346eec4-40ba-53d7-bb4d-ada017b4776d with identifier: LT66%20HCJ
2026-03-29 22:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c346eec4-40ba-53d7-bb4d-ada017b4776d with scrape type 2
2026-03-29 22:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c346eec4-40ba-53d7-bb4d-ada017b4776d with scrape type 2
2026-03-29 22:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c346eec4-40ba-53d7-bb4d-ada017b4776d, identifier: LT66%20HCJ
2026-03-29 22:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: df646afa-cd7d-59ba-af23-e32bf2546109 with identifier: RGZ%202258
2026-03-29 22:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: df646afa-cd7d-59ba-af23-e32bf2546109 with identifier: RGZ%202258
2026-03-29 22:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: df646afa-cd7d-59ba-af23-e32bf2546109 with identifier: RGZ%202258 to the API
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RGZ%202258-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'df646afa-cd7d-59ba-af23-e32bf2546109',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RGZ 2258',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RGZ%202258&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'KIA',
'model': 'NIRO',
'odometer': 51865,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'KIA NIRO 1.6 GDI HYBRID 2 DCT Hatchback',
'transmission': 'automatic',
'trim': 'GDI HYBRID 2 DCT',
'vin': 'KNACC81CVL5391687',
'year': 2020}
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RGZ%25202258%27 HTTP/1.1" 200 None
2026-03-29 22:07:20 [bca.uk] INFO: Saving data for RGZ%202258: {'auction_closing_time': 1774951200.0, 'created_time': 1774735441.932704, 'last_price_update_time': 1774822040.678618}
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RGZ%25202258') HTTP/1.1" 204 0
2026-03-29 22:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 05f5389c-b833-5c19-8373-cc7c365a1ca4 with identifier: GU05%20LVY
2026-03-29 22:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 05f5389c-b833-5c19-8373-cc7c365a1ca4 with identifier: GU05%20LVY
2026-03-29 22:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 05f5389c-b833-5c19-8373-cc7c365a1ca4 with identifier: GU05%20LVY to the API
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 228,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU05%20LVY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '05f5389c-b833-5c19-8373-cc7c365a1ca4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU05 LVY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU05%20LVY&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'PEUGEOT',
'model': '407 SW',
'odometer': 1,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'PEUGEOT 407 SW 2.2 SE LUX PACK Estate',
'transmission': 'manual',
'trim': 'SE LUX PACK',
'vin': 'VF36E3FZF21110907',
'year': 2005}
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU05%2520LVY%27 HTTP/1.1" 200 None
2026-03-29 22:07:20 [bca.uk] INFO: Saving data for GU05%20LVY: {'auction_closing_time': 1774864800.0, 'created_time': 1774622522.265121, 'last_price_update_time': 1774822040.965148}
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU05%2520LVY') HTTP/1.1" 204 0
2026-03-29 22:07:20 [bca.uk] INFO: Found listing with ID: VN63%20OZK
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN63%2520OZK%27 HTTP/1.1" 200 None
2026-03-29 22:07:20 [bca.uk] INFO: Scrape type for VN63%20OZK: 0
2026-03-29 22:07:20 [bca.uk] INFO: Found listing with ID: WG14%20FZH
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG14%2520FZH%27 HTTP/1.1" 200 None
2026-03-29 22:07:21 [bca.uk] INFO: Scrape type for WG14%20FZH: 0
2026-03-29 22:07:21 [bca.uk] INFO: Found listing with ID: WJ62%20DYN
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ62%2520DYN%27 HTTP/1.1" 200 None
2026-03-29 22:07:21 [bca.uk] INFO: Scrape type for WJ62%20DYN: 2
2026-03-29 22:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be37694a-5687-58c3-87cf-ba5e49941ce9 with identifier: WJ62%20DYN
2026-03-29 22:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be37694a-5687-58c3-87cf-ba5e49941ce9 with scrape type 2
2026-03-29 22:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be37694a-5687-58c3-87cf-ba5e49941ce9 with scrape type 2
2026-03-29 22:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: be37694a-5687-58c3-87cf-ba5e49941ce9, identifier: WJ62%20DYN
2026-03-29 22:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e568b76a-20a9-5c16-99a7-ea60aeecf1e0 with identifier: WN70%20GXV
2026-03-29 22:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e568b76a-20a9-5c16-99a7-ea60aeecf1e0 with identifier: WN70%20GXV
2026-03-29 22:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e568b76a-20a9-5c16-99a7-ea60aeecf1e0 with identifier: WN70%20GXV to the API
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN70%20GXV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e568b76a-20a9-5c16-99a7-ea60aeecf1e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WN70 GXV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WN70%20GXV&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FIAT',
'model': '500',
'odometer': 7156,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FIAT 500 1.0 M/H POP Hatchback',
'transmission': 'manual',
'trim': 'M/H POP',
'vin': 'ZFA3120000JE04717',
'year': 2020}
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN70%2520GXV%27 HTTP/1.1" 200 None
2026-03-29 22:07:21 [bca.uk] INFO: Saving data for WN70%20GXV: {'auction_closing_time': 1774951200.0, 'created_time': 1774735348.142378, 'last_price_update_time': 1774822041.428301}
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WN70%2520GXV') HTTP/1.1" 204 0
2026-03-29 22:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c346eec4-40ba-53d7-bb4d-ada017b4776d with identifier: LT66%20HCJ
2026-03-29 22:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c346eec4-40ba-53d7-bb4d-ada017b4776d with identifier: LT66%20HCJ
2026-03-29 22:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c346eec4-40ba-53d7-bb4d-ada017b4776d with identifier: LT66%20HCJ to the API
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 87,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT66%20HCJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c346eec4-40ba-53d7-bb4d-ada017b4776d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT66 HCJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT66%20HCJ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'DS AUTOMOBILES',
'model': 'DS 3',
'odometer': 78739,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'DS AUTOMOBILES DS 3 1.6 BLUEHDI 100 ELEGANCE Hatchback',
'transmission': 'manual',
'trim': 'BLUEHDI 100 ELEGANCE',
'vin': 'VF7SABHY6GW614383',
'year': 2016}
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT66%2520HCJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:21 [bca.uk] INFO: Saving data for LT66%20HCJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774735487.977072, 'last_price_update_time': 1774822041.723282}
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT66%2520HCJ') HTTP/1.1" 204 0
2026-03-29 22:07:21 [bca.uk] INFO: Found listing with ID: SH22%20GFY
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH22%2520GFY%27 HTTP/1.1" 200 None
2026-03-29 22:07:21 [bca.uk] INFO: Scrape type for SH22%20GFY: 2
2026-03-29 22:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95add145-cfdb-56fb-a27d-d877a0432bd6 with identifier: SH22%20GFY
2026-03-29 22:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95add145-cfdb-56fb-a27d-d877a0432bd6 with scrape type 2
2026-03-29 22:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95add145-cfdb-56fb-a27d-d877a0432bd6 with scrape type 2
2026-03-29 22:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 95add145-cfdb-56fb-a27d-d877a0432bd6, identifier: SH22%20GFY
2026-03-29 22:07:21 [bca.uk] INFO: Found listing with ID: LE04%20AFJ
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LE04%2520AFJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:21 [bca.uk] INFO: Scrape type for LE04%20AFJ: 0
2026-03-29 22:07:21 [bca.uk] INFO: Found listing with ID: GJ56%20OZO
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ56%2520OZO%27 HTTP/1.1" 200 None
2026-03-29 22:07:21 [bca.uk] INFO: Scrape type for GJ56%20OZO: 2
2026-03-29 22:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 059acf93-d057-5059-8445-f75f7e03be18 with identifier: GJ56%20OZO
2026-03-29 22:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 059acf93-d057-5059-8445-f75f7e03be18 with scrape type 2
2026-03-29 22:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 059acf93-d057-5059-8445-f75f7e03be18 with scrape type 2
2026-03-29 22:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 059acf93-d057-5059-8445-f75f7e03be18, identifier: GJ56%20OZO
2026-03-29 22:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: be37694a-5687-58c3-87cf-ba5e49941ce9 with identifier: WJ62%20DYN
2026-03-29 22:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: be37694a-5687-58c3-87cf-ba5e49941ce9 with identifier: WJ62%20DYN
2026-03-29 22:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: be37694a-5687-58c3-87cf-ba5e49941ce9 with identifier: WJ62%20DYN to the API
2026-03-29 22:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ62%20DYN-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'be37694a-5687-58c3-87cf-ba5e49941ce9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ62 DYN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ62%20DYN&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'RENAULT',
'model': 'GRAND SCENIC',
'odometer': 88395,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'RENAULT GRAND SCENIC 1.5 DCI 110E DYNAMIQUE TOM TOM S/S MPV',
'transmission': 'manual',
'trim': 'DCI 110E DYNAMIQUE TOM TOM S/S',
'vin': 'VF1JZ14B647816987',
'year': 2012}
2026-03-29 22:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ62%2520DYN%27 HTTP/1.1" 200 None
2026-03-29 22:07:22 [bca.uk] INFO: Saving data for WJ62%20DYN: {'auction_closing_time': 1774864800.0, 'created_time': 1774620785.679375, 'last_price_update_time': 1774822042.260658}
2026-03-29 22:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ62%2520DYN') HTTP/1.1" 204 0
2026-03-29 22:07:22 [bca.uk] INFO: Found listing with ID: AV09%20XGM
2026-03-29 22:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV09%2520XGM%27 HTTP/1.1" 200 None
2026-03-29 22:07:22 [bca.uk] INFO: Scrape type for AV09%20XGM: 2
2026-03-29 22:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c42f4349-1b81-5dc4-a105-671ff23a08dd with identifier: AV09%20XGM
2026-03-29 22:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c42f4349-1b81-5dc4-a105-671ff23a08dd with scrape type 2
2026-03-29 22:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c42f4349-1b81-5dc4-a105-671ff23a08dd with scrape type 2
2026-03-29 22:07:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c42f4349-1b81-5dc4-a105-671ff23a08dd, identifier: AV09%20XGM
2026-03-29 22:07:22 [bca.uk] INFO: Found listing with ID: SJ16%20SYV
2026-03-29 22:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ16%2520SYV%27 HTTP/1.1" 200 None
2026-03-29 22:07:22 [bca.uk] INFO: Scrape type for SJ16%20SYV: 2
2026-03-29 22:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15f02d0f-7d6c-5628-aec2-1916af416587 with identifier: SJ16%20SYV
2026-03-29 22:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f02d0f-7d6c-5628-aec2-1916af416587 with scrape type 2
2026-03-29 22:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15f02d0f-7d6c-5628-aec2-1916af416587 with scrape type 2
2026-03-29 22:07:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 15f02d0f-7d6c-5628-aec2-1916af416587, identifier: SJ16%20SYV
2026-03-29 22:07:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 95add145-cfdb-56fb-a27d-d877a0432bd6 with identifier: SH22%20GFY
2026-03-29 22:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 95add145-cfdb-56fb-a27d-d877a0432bd6 with identifier: SH22%20GFY
2026-03-29 22:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 95add145-cfdb-56fb-a27d-d877a0432bd6 with identifier: SH22%20GFY to the API
2026-03-29 22:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SH22%20GFY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '95add145-cfdb-56fb-a27d-d877a0432bd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SH22 GFY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SH22%20GFY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 26054,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 TURBO 100 ELITE ED. Hatchback',
'transmission': 'manual',
'trim': 'TURBO 100 ELITE ED.',
'vin': 'VXKUPHNEKN4232281',
'year': 2022}
2026-03-29 22:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH22%2520GFY%27 HTTP/1.1" 200 None
2026-03-29 22:07:22 [bca.uk] INFO: Saving data for SH22%20GFY: {'auction_closing_time': 1774951200.0, 'created_time': 1774706842.946145, 'last_price_update_time': 1774822042.83219}
2026-03-29 22:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SH22%2520GFY') HTTP/1.1" 204 0
2026-03-29 22:07:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 059acf93-d057-5059-8445-f75f7e03be18 with identifier: GJ56%20OZO
2026-03-29 22:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 059acf93-d057-5059-8445-f75f7e03be18 with identifier: GJ56%20OZO
2026-03-29 22:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 059acf93-d057-5059-8445-f75f7e03be18 with identifier: GJ56%20OZO to the API
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 157,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ56%20OZO-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '059acf93-d057-5059-8445-f75f7e03be18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ56 OZO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ56%20OZO&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'MERCEDES-BENZ',
'model': 'B180',
'odometer': 83254,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ B180 2.0 CDI SE Hatchback',
'transmission': 'manual',
'trim': 'CDI SE',
'vin': 'WDD2452072J148312',
'year': 2006}
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ56%2520OZO%27 HTTP/1.1" 200 None
2026-03-29 22:07:23 [bca.uk] INFO: Saving data for GJ56%20OZO: {'auction_closing_time': 1774864800.0, 'created_time': 1774621407.716843, 'last_price_update_time': 1774822043.224022}
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ56%2520OZO') HTTP/1.1" 204 0
2026-03-29 22:07:23 [bca.uk] INFO: Found listing with ID: WK13%20ORJ
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK13%2520ORJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:23 [bca.uk] INFO: Scrape type for WK13%20ORJ: 2
2026-03-29 22:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72a7b74a-1409-50a7-8a48-9d086ca07816 with identifier: WK13%20ORJ
2026-03-29 22:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72a7b74a-1409-50a7-8a48-9d086ca07816 with scrape type 2
2026-03-29 22:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72a7b74a-1409-50a7-8a48-9d086ca07816 with scrape type 2
2026-03-29 22:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 72a7b74a-1409-50a7-8a48-9d086ca07816, identifier: WK13%20ORJ
2026-03-29 22:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c42f4349-1b81-5dc4-a105-671ff23a08dd with identifier: AV09%20XGM
2026-03-29 22:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c42f4349-1b81-5dc4-a105-671ff23a08dd with identifier: AV09%20XGM
2026-03-29 22:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c42f4349-1b81-5dc4-a105-671ff23a08dd with identifier: AV09%20XGM to the API
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 153,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV09%20XGM-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c42f4349-1b81-5dc4-a105-671ff23a08dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV09 XGM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV09%20XGM&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VOLVO',
'model': 'V50',
'odometer': 205325,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VOLVO V50 2.0 D R DESIGN Estate',
'transmission': 'manual',
'trim': 'D R DESIGN',
'vin': 'YV1MW7541A2523584',
'year': 2009}
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV09%2520XGM%27 HTTP/1.1" 200 None
2026-03-29 22:07:23 [bca.uk] INFO: Saving data for AV09%20XGM: {'auction_closing_time': 1774864800.0, 'created_time': 1774735345.860829, 'last_price_update_time': 1774822043.627619}
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV09%2520XGM') HTTP/1.1" 204 0
2026-03-29 22:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 15f02d0f-7d6c-5628-aec2-1916af416587 with identifier: SJ16%20SYV
2026-03-29 22:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 15f02d0f-7d6c-5628-aec2-1916af416587 with identifier: SJ16%20SYV
2026-03-29 22:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 15f02d0f-7d6c-5628-aec2-1916af416587 with identifier: SJ16%20SYV to the API
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SJ16%20SYV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '15f02d0f-7d6c-5628-aec2-1916af416587',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SJ16 SYV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SJ16%20SYV&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'C-MAX',
'odometer': 57673,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD C-MAX 1.5 TDCI 120 TITANIUM P/S MPV',
'transmission': 'automatic',
'trim': 'TDCI 120 TITANIUM P/S',
'vin': 'WF0VXXGCEVGK06650',
'year': 2016}
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ16%2520SYV%27 HTTP/1.1" 200 None
2026-03-29 22:07:23 [bca.uk] INFO: Saving data for SJ16%20SYV: {'auction_closing_time': 1774864800.0, 'created_time': 1774735483.216078, 'last_price_update_time': 1774822043.925872}
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SJ16%2520SYV') HTTP/1.1" 204 0
2026-03-29 22:07:23 [bca.uk] INFO: Found listing with ID: WF68%20XGD
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF68%2520XGD%27 HTTP/1.1" 200 None
2026-03-29 22:07:23 [bca.uk] INFO: Scrape type for WF68%20XGD: 0
2026-03-29 22:07:23 [bca.uk] INFO: Found listing with ID: WO19%20HKY
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO19%2520HKY%27 HTTP/1.1" 200 None
2026-03-29 22:07:23 [bca.uk] INFO: Scrape type for WO19%20HKY: 0
2026-03-29 22:07:23 [bca.uk] INFO: Found listing with ID: YC68%20TVN
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC68%2520TVN%27 HTTP/1.1" 200 None
2026-03-29 22:07:23 [bca.uk] INFO: Scrape type for YC68%20TVN: 2
2026-03-29 22:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 384424c5-4a27-5c4a-8ba8-b04b931ad0f3 with identifier: YC68%20TVN
2026-03-29 22:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 384424c5-4a27-5c4a-8ba8-b04b931ad0f3 with scrape type 2
2026-03-29 22:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 384424c5-4a27-5c4a-8ba8-b04b931ad0f3 with scrape type 2
2026-03-29 22:07:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 384424c5-4a27-5c4a-8ba8-b04b931ad0f3, identifier: YC68%20TVN
2026-03-29 22:07:24 [bca.uk] INFO: Found listing with ID: DN13%20WOV
2026-03-29 22:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN13%2520WOV%27 HTTP/1.1" 200 None
2026-03-29 22:07:24 [bca.uk] INFO: Scrape type for DN13%20WOV: 2
2026-03-29 22:07:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42729d14-217d-56b3-bd10-a260b7bfd9d2 with identifier: DN13%20WOV
2026-03-29 22:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42729d14-217d-56b3-bd10-a260b7bfd9d2 with scrape type 2
2026-03-29 22:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42729d14-217d-56b3-bd10-a260b7bfd9d2 with scrape type 2
2026-03-29 22:07:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 42729d14-217d-56b3-bd10-a260b7bfd9d2, identifier: DN13%20WOV
2026-03-29 22:07:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 72a7b74a-1409-50a7-8a48-9d086ca07816 with identifier: WK13%20ORJ
2026-03-29 22:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 72a7b74a-1409-50a7-8a48-9d086ca07816 with identifier: WK13%20ORJ
2026-03-29 22:07:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 72a7b74a-1409-50a7-8a48-9d086ca07816 with identifier: WK13%20ORJ to the API
2026-03-29 22:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WK13%20ORJ-GB',
'category': 'Car',
'color': 'orange',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '72a7b74a-1409-50a7-8a48-9d086ca07816',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WK13 ORJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WK13%20ORJ&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VAUXHALL',
'model': 'ADAM',
'odometer': 67626,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL ADAM 1.4 VVT 87 JAM Hatchback',
'transmission': 'manual',
'trim': 'VVT 87 JAM',
'vin': 'W0L0MAP08D6040511',
'year': 2013}
2026-03-29 22:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK13%2520ORJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:25 [bca.uk] INFO: Saving data for WK13%20ORJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774620787.494127, 'last_price_update_time': 1774822045.510632}
2026-03-29 22:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WK13%2520ORJ') HTTP/1.1" 204 0
2026-03-29 22:07:25 [bca.uk] INFO: Found listing with ID: KN12%20MPO
2026-03-29 22:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN12%2520MPO%27 HTTP/1.1" 200 None
2026-03-29 22:07:25 [bca.uk] INFO: Scrape type for KN12%20MPO: 2
2026-03-29 22:07:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0cc7482-767b-567d-a58d-775f8d1bb696 with identifier: KN12%20MPO
2026-03-29 22:07:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0cc7482-767b-567d-a58d-775f8d1bb696 with scrape type 2
2026-03-29 22:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0cc7482-767b-567d-a58d-775f8d1bb696 with scrape type 2
2026-03-29 22:07:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e0cc7482-767b-567d-a58d-775f8d1bb696, identifier: KN12%20MPO
2026-03-29 22:07:25 [bca.uk] INFO: Found listing with ID: BU67%20KTN
2026-03-29 22:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU67%2520KTN%27 HTTP/1.1" 200 None
2026-03-29 22:07:25 [bca.uk] INFO: Scrape type for BU67%20KTN: 2
2026-03-29 22:07:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a8934b9-4045-555c-b8d3-812b6cc9a1e0 with identifier: BU67%20KTN
2026-03-29 22:07:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8934b9-4045-555c-b8d3-812b6cc9a1e0 with scrape type 2
2026-03-29 22:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a8934b9-4045-555c-b8d3-812b6cc9a1e0 with scrape type 2
2026-03-29 22:07:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1a8934b9-4045-555c-b8d3-812b6cc9a1e0, identifier: BU67%20KTN
2026-03-29 22:07:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 384424c5-4a27-5c4a-8ba8-b04b931ad0f3 with identifier: YC68%20TVN
2026-03-29 22:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 384424c5-4a27-5c4a-8ba8-b04b931ad0f3 with identifier: YC68%20TVN
2026-03-29 22:07:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 384424c5-4a27-5c4a-8ba8-b04b931ad0f3 with identifier: YC68%20TVN to the API
2026-03-29 22:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC68%20TVN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '384424c5-4a27-5c4a-8ba8-b04b931ad0f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC68 TVN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC68%20TVN&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'JAGUAR',
'model': 'E-PACE',
'odometer': 45022,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'JAGUAR E-PACE 2.0 D150 2WD R-DYNAMIC S Hatchback',
'transmission': 'manual',
'trim': 'D150 2WD R-DYNAMIC S',
'vin': 'SADFB2CN2K1Z38767',
'year': 2018}
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC68%2520TVN%27 HTTP/1.1" 200 None
2026-03-29 22:07:26 [bca.uk] INFO: Saving data for YC68%20TVN: {'auction_closing_time': 1774951200.0, 'created_time': 1774217126.374088, 'last_price_update_time': 1774822046.03415}
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC68%2520TVN') HTTP/1.1" 204 0
2026-03-29 22:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 42729d14-217d-56b3-bd10-a260b7bfd9d2 with identifier: DN13%20WOV
2026-03-29 22:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 42729d14-217d-56b3-bd10-a260b7bfd9d2 with identifier: DN13%20WOV
2026-03-29 22:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 42729d14-217d-56b3-bd10-a260b7bfd9d2 with identifier: DN13%20WOV to the API
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DN13%20WOV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '42729d14-217d-56b3-bd10-a260b7bfd9d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DN13 WOV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DN13%20WOV&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 112277,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 2.0 CDTI 16V 165 E/F SRI S/S Hatchback',
'transmission': 'manual',
'trim': 'CDTI 16V 165 E/F SRI S/S',
'vin': 'W0LPF6EN4DG099079',
'year': 2013}
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN13%2520WOV%27 HTTP/1.1" 200 None
2026-03-29 22:07:26 [bca.uk] INFO: Saving data for DN13%20WOV: {'auction_closing_time': 1774864800.0, 'created_time': 1774621405.366188, 'last_price_update_time': 1774822046.318485}
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DN13%2520WOV') HTTP/1.1" 204 0
2026-03-29 22:07:26 [bca.uk] INFO: Found listing with ID: YC61%20FBL
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC61%2520FBL%27 HTTP/1.1" 200 None
2026-03-29 22:07:26 [bca.uk] INFO: Scrape type for YC61%20FBL: 2
2026-03-29 22:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02c6b227-f167-5666-b1fb-ecc02dc5d047 with identifier: YC61%20FBL
2026-03-29 22:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02c6b227-f167-5666-b1fb-ecc02dc5d047 with scrape type 2
2026-03-29 22:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02c6b227-f167-5666-b1fb-ecc02dc5d047 with scrape type 2
2026-03-29 22:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 02c6b227-f167-5666-b1fb-ecc02dc5d047, identifier: YC61%20FBL
2026-03-29 22:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e0cc7482-767b-567d-a58d-775f8d1bb696 with identifier: KN12%20MPO
2026-03-29 22:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e0cc7482-767b-567d-a58d-775f8d1bb696 with identifier: KN12%20MPO
2026-03-29 22:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e0cc7482-767b-567d-a58d-775f8d1bb696 with identifier: KN12%20MPO to the API
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN12%20MPO-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e0cc7482-767b-567d-a58d-775f8d1bb696',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN12 MPO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KN12%20MPO&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'PEUGEOT',
'model': '207',
'odometer': 89592,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'PEUGEOT 207 1.4 ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'ACTIVE',
'vin': 'VF3WCKFT0CE019850',
'year': 2012}
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN12%2520MPO%27 HTTP/1.1" 200 None
2026-03-29 22:07:26 [bca.uk] INFO: Saving data for KN12%20MPO: {'auction_closing_time': 1774864800.0, 'created_time': 1774735347.113878, 'last_price_update_time': 1774822046.710891}
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KN12%2520MPO') HTTP/1.1" 204 0
2026-03-29 22:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1a8934b9-4045-555c-b8d3-812b6cc9a1e0 with identifier: BU67%20KTN
2026-03-29 22:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1a8934b9-4045-555c-b8d3-812b6cc9a1e0 with identifier: BU67%20KTN
2026-03-29 22:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1a8934b9-4045-555c-b8d3-812b6cc9a1e0 with identifier: BU67%20KTN to the API
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 463,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BU67%20KTN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1a8934b9-4045-555c-b8d3-812b6cc9a1e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BU67 KTN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BU67%20KTN&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 42547,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 90 SRI Hatchback',
'transmission': 'manual',
'trim': '90 SRI',
'vin': 'W0V0XEP08J6028164',
'year': 2017}
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU67%2520KTN%27 HTTP/1.1" 200 None
2026-03-29 22:07:26 [bca.uk] INFO: Saving data for BU67%20KTN: {'auction_closing_time': 1774951200.0, 'created_time': 1774735478.801287, 'last_price_update_time': 1774822046.994382}
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BU67%2520KTN') HTTP/1.1" 204 0
2026-03-29 22:07:27 [bca.uk] INFO: Found listing with ID: YK19%20TBP
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK19%2520TBP%27 HTTP/1.1" 200 None
2026-03-29 22:07:27 [bca.uk] INFO: Scrape type for YK19%20TBP: 0
2026-03-29 22:07:27 [bca.uk] INFO: Found listing with ID: DK69%20NEO
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK69%2520NEO%27 HTTP/1.1" 200 None
2026-03-29 22:07:27 [bca.uk] INFO: Scrape type for DK69%20NEO: 2
2026-03-29 22:07:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6 with identifier: DK69%20NEO
2026-03-29 22:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6 with scrape type 2
2026-03-29 22:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6 with scrape type 2
2026-03-29 22:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6, identifier: DK69%20NEO
2026-03-29 22:07:27 [bca.uk] INFO: Found listing with ID: SL60%20TLY
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL60%2520TLY%27 HTTP/1.1" 200 None
2026-03-29 22:07:27 [bca.uk] INFO: Scrape type for SL60%20TLY: 2
2026-03-29 22:07:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f872912-6c80-592c-99ea-edc541a9babf with identifier: SL60%20TLY
2026-03-29 22:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f872912-6c80-592c-99ea-edc541a9babf with scrape type 2
2026-03-29 22:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f872912-6c80-592c-99ea-edc541a9babf with scrape type 2
2026-03-29 22:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2f872912-6c80-592c-99ea-edc541a9babf, identifier: SL60%20TLY
2026-03-29 22:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 02c6b227-f167-5666-b1fb-ecc02dc5d047 with identifier: YC61%20FBL
2026-03-29 22:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 02c6b227-f167-5666-b1fb-ecc02dc5d047 with identifier: YC61%20FBL
2026-03-29 22:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 02c6b227-f167-5666-b1fb-ecc02dc5d047 with identifier: YC61%20FBL to the API
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 164,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC61%20FBL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '02c6b227-f167-5666-b1fb-ecc02dc5d047',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC61 FBL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC61%20FBL&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 114709,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'AUDI A3 SPORTBACK 1.6 TECHNIK Hatchback',
'transmission': 'manual',
'trim': 'TECHNIK',
'vin': 'WAUZZZ8P5CA085190',
'year': 2012}
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC61%2520FBL%27 HTTP/1.1" 200 None
2026-03-29 22:07:27 [bca.uk] INFO: Saving data for YC61%20FBL: {'auction_closing_time': 1774864800.0, 'created_time': 1774621484.749848, 'last_price_update_time': 1774822047.511374}
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC61%2520FBL') HTTP/1.1" 204 0
2026-03-29 22:07:27 [bca.uk] INFO: Found listing with ID: WJ10%20DVF
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ10%2520DVF%27 HTTP/1.1" 200 None
2026-03-29 22:07:27 [bca.uk] INFO: Scrape type for WJ10%20DVF: 2
2026-03-29 22:07:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b5e0f49-0b91-505b-88af-460f766781c7 with identifier: WJ10%20DVF
2026-03-29 22:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b5e0f49-0b91-505b-88af-460f766781c7 with scrape type 2
2026-03-29 22:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b5e0f49-0b91-505b-88af-460f766781c7 with scrape type 2
2026-03-29 22:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1b5e0f49-0b91-505b-88af-460f766781c7, identifier: WJ10%20DVF
2026-03-29 22:07:27 [bca.uk] INFO: Found listing with ID: WM66%20HPY
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM66%2520HPY%27 HTTP/1.1" 200 None
2026-03-29 22:07:27 [bca.uk] INFO: Scrape type for WM66%20HPY: 2
2026-03-29 22:07:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe with identifier: WM66%20HPY
2026-03-29 22:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe with scrape type 2
2026-03-29 22:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe with scrape type 2
2026-03-29 22:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe, identifier: WM66%20HPY
2026-03-29 22:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6 with identifier: DK69%20NEO
2026-03-29 22:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6 with identifier: DK69%20NEO
2026-03-29 22:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6 with identifier: DK69%20NEO to the API
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DK69%20NEO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4249ccfe-2fe2-5ec9-9498-fdc02ee01cd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DK69 NEO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DK69%20NEO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 81446,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.5 EBL 120 ST-LINE P/S Hatchback',
'transmission': 'automatic',
'trim': 'EBL 120 ST-LINE P/S',
'vin': 'WF0NXXGCHNKT16990',
'year': 2019}
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK69%2520NEO%27 HTTP/1.1" 200 None
2026-03-29 22:07:28 [bca.uk] INFO: Saving data for DK69%20NEO: {'auction_closing_time': 1774951200.0, 'created_time': 1774735442.819371, 'last_price_update_time': 1774822048.102928}
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DK69%2520NEO') HTTP/1.1" 204 0
2026-03-29 22:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2f872912-6c80-592c-99ea-edc541a9babf with identifier: SL60%20TLY
2026-03-29 22:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2f872912-6c80-592c-99ea-edc541a9babf with identifier: SL60%20TLY
2026-03-29 22:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2f872912-6c80-592c-99ea-edc541a9babf with identifier: SL60%20TLY to the API
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL60%20TLY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2f872912-6c80-592c-99ea-edc541a9babf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SL60 TLY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SL60%20TLY&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'MINI',
'model': 'ONE',
'odometer': 75844,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'MINI ONE 1.6 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWSR32020T025491',
'year': 2010}
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL60%2520TLY%27 HTTP/1.1" 200 None
2026-03-29 22:07:28 [bca.uk] INFO: Saving data for SL60%20TLY: {'auction_closing_time': 1774864800.0, 'created_time': 1774621403.612124, 'last_price_update_time': 1774822048.393937}
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SL60%2520TLY') HTTP/1.1" 204 0
2026-03-29 22:07:28 [bca.uk] INFO: Found listing with ID: YD15%20XKJ
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD15%2520XKJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:28 [bca.uk] INFO: Scrape type for YD15%20XKJ: 0
2026-03-29 22:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1b5e0f49-0b91-505b-88af-460f766781c7 with identifier: WJ10%20DVF
2026-03-29 22:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1b5e0f49-0b91-505b-88af-460f766781c7 with identifier: WJ10%20DVF
2026-03-29 22:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1b5e0f49-0b91-505b-88af-460f766781c7 with identifier: WJ10%20DVF to the API
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ10%20DVF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1b5e0f49-0b91-505b-88af-460f766781c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ10 DVF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ10%20DVF&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'HYUNDAI',
'model': 'I20',
'odometer': 123098,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'HYUNDAI I20 1.2 CLASSIC Hatchback',
'transmission': 'manual',
'trim': 'CLASSIC',
'vin': 'MALBA51BLAM123723',
'year': 2010}
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ10%2520DVF%27 HTTP/1.1" 200 None
2026-03-29 22:07:28 [bca.uk] INFO: Saving data for WJ10%20DVF: {'auction_closing_time': 1774864800.0, 'created_time': 1774735317.162368, 'last_price_update_time': 1774822048.700964}
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ10%2520DVF') HTTP/1.1" 204 0
2026-03-29 22:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe with identifier: WM66%20HPY
2026-03-29 22:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe with identifier: WM66%20HPY
2026-03-29 22:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe with identifier: WM66%20HPY to the API
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 89,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WM66%20HPY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f7e597dc-fbae-5fb6-a7a6-6b26a2b45bbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WM66 HPY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WM66%20HPY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MERCEDES-BENZ',
'model': 'A180 D',
'odometer': 118159,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A180 D 1.5 SE EXECUTIVE Hatchback',
'transmission': 'manual',
'trim': 'SE EXECUTIVE',
'vin': 'WDD1760122V174778',
'year': 2017}
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM66%2520HPY%27 HTTP/1.1" 200 None
2026-03-29 22:07:28 [bca.uk] INFO: Saving data for WM66%20HPY: {'auction_closing_time': 1774951200.0, 'created_time': 1774735477.120695, 'last_price_update_time': 1774822048.987662}
2026-03-29 22:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WM66%2520HPY') HTTP/1.1" 204 0
2026-03-29 22:07:29 [bca.uk] INFO: Found listing with ID: MH19%20RHF
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH19%2520RHF%27 HTTP/1.1" 200 None
2026-03-29 22:07:29 [bca.uk] INFO: Scrape type for MH19%20RHF: 2
2026-03-29 22:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7bbb95c-34a4-508c-9af6-6415bfd76278 with identifier: MH19%20RHF
2026-03-29 22:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7bbb95c-34a4-508c-9af6-6415bfd76278 with scrape type 2
2026-03-29 22:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7bbb95c-34a4-508c-9af6-6415bfd76278 with scrape type 2
2026-03-29 22:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f7bbb95c-34a4-508c-9af6-6415bfd76278, identifier: MH19%20RHF
2026-03-29 22:07:29 [bca.uk] INFO: Found listing with ID: SO05%20MZE
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO05%2520MZE%27 HTTP/1.1" 200 None
2026-03-29 22:07:29 [bca.uk] INFO: Scrape type for SO05%20MZE: 0
2026-03-29 22:07:29 [bca.uk] INFO: Found listing with ID: LX14%20XNH
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX14%2520XNH%27 HTTP/1.1" 200 None
2026-03-29 22:07:29 [bca.uk] INFO: Scrape type for LX14%20XNH: 2
2026-03-29 22:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d59c8c01-c6be-586f-86c9-6eb3a7686cc2 with identifier: LX14%20XNH
2026-03-29 22:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d59c8c01-c6be-586f-86c9-6eb3a7686cc2 with scrape type 2
2026-03-29 22:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d59c8c01-c6be-586f-86c9-6eb3a7686cc2 with scrape type 2
2026-03-29 22:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d59c8c01-c6be-586f-86c9-6eb3a7686cc2, identifier: LX14%20XNH
2026-03-29 22:07:29 [bca.uk] INFO: Found listing with ID: YG19%20DRZ
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG19%2520DRZ%27 HTTP/1.1" 200 None
2026-03-29 22:07:29 [bca.uk] INFO: Scrape type for YG19%20DRZ: 2
2026-03-29 22:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e897ee42-3f14-5f4f-8d1c-2a827ef07283 with identifier: YG19%20DRZ
2026-03-29 22:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e897ee42-3f14-5f4f-8d1c-2a827ef07283 with scrape type 2
2026-03-29 22:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e897ee42-3f14-5f4f-8d1c-2a827ef07283 with scrape type 2
2026-03-29 22:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e897ee42-3f14-5f4f-8d1c-2a827ef07283, identifier: YG19%20DRZ
2026-03-29 22:07:29 [bca.uk] INFO: Found listing with ID: SV13%20XGW
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV13%2520XGW%27 HTTP/1.1" 200 None
2026-03-29 22:07:29 [bca.uk] INFO: Scrape type for SV13%20XGW: 2
2026-03-29 22:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4e4f996-7647-5f09-9c47-a666d700954d with identifier: SV13%20XGW
2026-03-29 22:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4e4f996-7647-5f09-9c47-a666d700954d with scrape type 2
2026-03-29 22:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4e4f996-7647-5f09-9c47-a666d700954d with scrape type 2
2026-03-29 22:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e4e4f996-7647-5f09-9c47-a666d700954d, identifier: SV13%20XGW
2026-03-29 22:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f7bbb95c-34a4-508c-9af6-6415bfd76278 with identifier: MH19%20RHF
2026-03-29 22:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f7bbb95c-34a4-508c-9af6-6415bfd76278 with identifier: MH19%20RHF
2026-03-29 22:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f7bbb95c-34a4-508c-9af6-6415bfd76278 with identifier: MH19%20RHF to the API
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MH19%20RHF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f7bbb95c-34a4-508c-9af6-6415bfd76278',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MH19 RHF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MH19%20RHF&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'AUDI',
'model': 'A4',
'odometer': 60922,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'AUDI A4 2.0 35 TFSI S LINE S-T Saloon',
'transmission': 'automatic',
'trim': '35 TFSI S LINE S-T',
'vin': 'WAUZZZF47KA060332',
'year': 2019}
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH19%2520RHF%27 HTTP/1.1" 200 None
2026-03-29 22:07:29 [bca.uk] INFO: Saving data for MH19%20RHF: {'auction_closing_time': 1774951200.0, 'created_time': 1774735443.192865, 'last_price_update_time': 1774822049.751065}
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MH19%2520RHF') HTTP/1.1" 204 0
2026-03-29 22:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d59c8c01-c6be-586f-86c9-6eb3a7686cc2 with identifier: LX14%20XNH
2026-03-29 22:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d59c8c01-c6be-586f-86c9-6eb3a7686cc2 with identifier: LX14%20XNH
2026-03-29 22:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d59c8c01-c6be-586f-86c9-6eb3a7686cc2 with identifier: LX14%20XNH to the API
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX14%20XNH-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd59c8c01-c6be-586f-86c9-6eb3a7686cc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LX14 XNH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LX14%20XNH&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'MOKKA',
'odometer': 86949,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL MOKKA 1.4 T 140 EXCLUSIV 2WD StationWagon',
'transmission': 'manual',
'trim': 'T 140 EXCLUSIV 2WD',
'vin': 'W0LJC7E80EB595431',
'year': 2014}
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX14%2520XNH%27 HTTP/1.1" 200 None
2026-03-29 22:07:30 [bca.uk] INFO: Saving data for LX14%20XNH: {'auction_closing_time': 1774864800.0, 'created_time': 1774735627.190737, 'last_price_update_time': 1774822050.059259}
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LX14%2520XNH') HTTP/1.1" 204 0
2026-03-29 22:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124400/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124400>
2026-03-29 22:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430310/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430310>
2026-03-29 22:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146962/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146962>
2026-03-29 22:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146948/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146948>
2026-03-29 22:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124407/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124407>
2026-03-29 22:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146934/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146934>
2026-03-29 22:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435175/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435175>
2026-03-29 22:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435182/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435182>
2026-03-29 22:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e897ee42-3f14-5f4f-8d1c-2a827ef07283 with identifier: YG19%20DRZ
2026-03-29 22:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e897ee42-3f14-5f4f-8d1c-2a827ef07283 with identifier: YG19%20DRZ
2026-03-29 22:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e897ee42-3f14-5f4f-8d1c-2a827ef07283 with identifier: YG19%20DRZ to the API
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YG19%20DRZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e897ee42-3f14-5f4f-8d1c-2a827ef07283',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YG19 DRZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YG19%20DRZ&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 44345,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.4 T 16V 150 SRI Hatchback',
'transmission': 'manual',
'trim': 'T 16V 150 SRI',
'vin': 'W0VBF6EC7KG341747',
'year': 2019}
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG19%2520DRZ%27 HTTP/1.1" 200 None
2026-03-29 22:07:30 [bca.uk] INFO: Saving data for YG19%20DRZ: {'auction_closing_time': 1774951200.0, 'created_time': 1774735351.399548, 'last_price_update_time': 1774822050.365782}
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YG19%2520DRZ') HTTP/1.1" 204 0
2026-03-29 22:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e4e4f996-7647-5f09-9c47-a666d700954d with identifier: SV13%20XGW
2026-03-29 22:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e4e4f996-7647-5f09-9c47-a666d700954d with identifier: SV13%20XGW
2026-03-29 22:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e4e4f996-7647-5f09-9c47-a666d700954d with identifier: SV13%20XGW to the API
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV13%20XGW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e4e4f996-7647-5f09-9c47-a666d700954d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV13 XGW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV13%20XGW&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 90532,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 16V ENERGY Hatchback',
'transmission': 'manual',
'trim': '16V ENERGY',
'vin': 'W0L0SDL68D4152369',
'year': 2013}
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV13%2520XGW%27 HTTP/1.1" 200 None
2026-03-29 22:07:30 [bca.uk] INFO: Saving data for SV13%20XGW: {'auction_closing_time': 1774864800.0, 'created_time': 1774735474.591685, 'last_price_update_time': 1774822050.644643}
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV13%2520XGW') HTTP/1.1" 204 0
2026-03-29 22:07:30 [bca.uk] INFO: Found listing with ID: MJ19%20JYG
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ19%2520JYG%27 HTTP/1.1" 200 None
2026-03-29 22:07:30 [bca.uk] INFO: Scrape type for MJ19%20JYG: 2
2026-03-29 22:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7c54e9b-c505-5a1c-96f8-efc7e46f0480 with identifier: MJ19%20JYG
2026-03-29 22:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7c54e9b-c505-5a1c-96f8-efc7e46f0480 with scrape type 2
2026-03-29 22:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7c54e9b-c505-5a1c-96f8-efc7e46f0480 with scrape type 2
2026-03-29 22:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a7c54e9b-c505-5a1c-96f8-efc7e46f0480, identifier: MJ19%20JYG
2026-03-29 22:07:30 [bca.uk] INFO: Found listing with ID: LK66%20WKL
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK66%2520WKL%27 HTTP/1.1" 200 None
2026-03-29 22:07:30 [bca.uk] INFO: Scrape type for LK66%20WKL: 2
2026-03-29 22:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48020b9d-f1ca-5049-9c7b-c8f63a357c9e with identifier: LK66%20WKL
2026-03-29 22:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48020b9d-f1ca-5049-9c7b-c8f63a357c9e with scrape type 2
2026-03-29 22:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48020b9d-f1ca-5049-9c7b-c8f63a357c9e with scrape type 2
2026-03-29 22:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 48020b9d-f1ca-5049-9c7b-c8f63a357c9e, identifier: LK66%20WKL
2026-03-29 22:07:30 [bca.uk] INFO: Found listing with ID: X575%20MKR
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X575%2520MKR%27 HTTP/1.1" 200 None
2026-03-29 22:07:30 [bca.uk] INFO: Scrape type for X575%20MKR: 0
2026-03-29 22:07:30 [bca.uk] INFO: Found listing with ID: YC06%20JWZ
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC06%2520JWZ%27 HTTP/1.1" 200 None
2026-03-29 22:07:30 [bca.uk] INFO: Scrape type for YC06%20JWZ: 0
2026-03-29 22:07:30 [bca.uk] INFO: Found listing with ID: YR08%20YHO
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR08%2520YHO%27 HTTP/1.1" 200 None
2026-03-29 22:07:30 [bca.uk] INFO: Scrape type for YR08%20YHO: 0
2026-03-29 22:07:30 [bca.uk] INFO: Found listing with ID: YR10%20WLK
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR10%2520WLK%27 HTTP/1.1" 200 None
2026-03-29 22:07:30 [bca.uk] INFO: Scrape type for YR10%20WLK: 0
2026-03-29 22:07:30 [bca.uk] INFO: Found listing with ID: HV09%20UFD
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV09%2520UFD%27 HTTP/1.1" 200 None
2026-03-29 22:07:30 [bca.uk] INFO: Scrape type for HV09%20UFD: 0
2026-03-29 22:07:30 [bca.uk] INFO: Found listing with ID: HV59%20VKF
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV59%2520VKF%27 HTTP/1.1" 200 None
2026-03-29 22:07:30 [bca.uk] INFO: Scrape type for HV59%20VKF: 0
2026-03-29 22:07:30 [bca.uk] INFO: Found listing with ID: MF10%20DTZ
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF10%2520DTZ%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for MF10%20DTZ: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: NA06%20VBC
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA06%2520VBC%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for NA06%20VBC: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: BN63%20ZHC
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN63%2520ZHC%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for BN63%20ZHC: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: FE13%20XAH
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE13%2520XAH%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for FE13%20XAH: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: FE14%20ONN
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE14%2520ONN%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for FE14%20ONN: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: GJ59%20KPO
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ59%2520KPO%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for GJ59%20KPO: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: NA59%20XZD
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA59%2520XZD%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for NA59%20XZD: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: NK63%20DYU
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK63%2520DYU%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for NK63%20DYU: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: SD62%20HPL
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD62%2520HPL%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for SD62%20HPL: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: YB57%20XVN
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB57%2520XVN%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for YB57%20XVN: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: YD10%20WDL
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD10%2520WDL%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for YD10%20WDL: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: YX59%20UZR
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX59%2520UZR%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for YX59%20UZR: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: YY10%20GKZ
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY10%2520GKZ%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for YY10%20GKZ: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: DY61%20OKO
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY61%2520OKO%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for DY61%20OKO: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: MW10%20RDZ
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW10%2520RDZ%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for MW10%20RDZ: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: OE10%20AEP
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE10%2520AEP%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for OE10%20AEP: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: SM57%20OPB
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM57%2520OPB%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for SM57%20OPB: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: YP10%20CTO
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP10%2520CTO%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for YP10%20CTO: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: LM59%20JDO
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM59%2520JDO%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for LM59%20JDO: 0
2026-03-29 22:07:31 [bca.uk] INFO: Found listing with ID: AE15%20URC
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE15%2520URC%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Scrape type for AE15%20URC: 2
2026-03-29 22:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7208558-825f-54e8-9356-5e2af34b2242 with identifier: AE15%20URC
2026-03-29 22:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7208558-825f-54e8-9356-5e2af34b2242 with scrape type 2
2026-03-29 22:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7208558-825f-54e8-9356-5e2af34b2242 with scrape type 2
2026-03-29 22:07:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d7208558-825f-54e8-9356-5e2af34b2242, identifier: AE15%20URC
2026-03-29 22:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a7c54e9b-c505-5a1c-96f8-efc7e46f0480 with identifier: MJ19%20JYG
2026-03-29 22:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a7c54e9b-c505-5a1c-96f8-efc7e46f0480 with identifier: MJ19%20JYG
2026-03-29 22:07:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a7c54e9b-c505-5a1c-96f8-efc7e46f0480 with identifier: MJ19%20JYG to the API
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ19%20JYG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a7c54e9b-c505-5a1c-96f8-efc7e46f0480',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ19 JYG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ19%20JYG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 39322,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.5 VVT-I ICON Hatchback',
'transmission': 'automatic',
'trim': 'VVT-I ICON',
'vin': 'VNKKG3D320A146010',
'year': 2019}
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ19%2520JYG%27 HTTP/1.1" 200 None
2026-03-29 22:07:31 [bca.uk] INFO: Saving data for MJ19%20JYG: {'auction_closing_time': 1774951200.0, 'created_time': 1774735441.368449, 'last_price_update_time': 1774822051.859026}
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ19%2520JYG') HTTP/1.1" 204 0
2026-03-29 22:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 48020b9d-f1ca-5049-9c7b-c8f63a357c9e with identifier: LK66%20WKL
2026-03-29 22:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 48020b9d-f1ca-5049-9c7b-c8f63a357c9e with identifier: LK66%20WKL
2026-03-29 22:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 48020b9d-f1ca-5049-9c7b-c8f63a357c9e with identifier: LK66%20WKL to the API
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LK66%20WKL-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '48020b9d-f1ca-5049-9c7b-c8f63a357c9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LK66 WKL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LK66%20WKL&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 82419,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN X-TRAIL 1.6 DCI 130 N-TEC (5ST) XTRONIC StationWagon',
'transmission': 'automatic',
'trim': 'DCI 130 N-TEC (5ST) XTRONIC',
'vin': 'JN1TCAT32U0040851',
'year': 2016}
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK66%2520WKL%27 HTTP/1.1" 200 None
2026-03-29 22:07:32 [bca.uk] INFO: Saving data for LK66%20WKL: {'auction_closing_time': 1774864800.0, 'created_time': 1774735604.587847, 'last_price_update_time': 1774822052.254941}
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LK66%2520WKL') HTTP/1.1" 204 0
2026-03-29 22:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d7208558-825f-54e8-9356-5e2af34b2242 with identifier: AE15%20URC
2026-03-29 22:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d7208558-825f-54e8-9356-5e2af34b2242 with identifier: AE15%20URC
2026-03-29 22:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d7208558-825f-54e8-9356-5e2af34b2242 with identifier: AE15%20URC to the API
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE15%20URC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd7208558-825f-54e8-9356-5e2af34b2242',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE15 URC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AE15%20URC&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 139838,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 SDV6 HSE StationWagon',
'transmission': 'manual',
'trim': 'SDV6 HSE',
'vin': 'SALWA2KE4FA523223',
'year': 2015}
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE15%2520URC%27 HTTP/1.1" 200 None
2026-03-29 22:07:32 [bca.uk] INFO: Saving data for AE15%20URC: {'auction_closing_time': 1774864800.0, 'created_time': 1774735472.193803, 'last_price_update_time': 1774822052.541999}
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AE15%2520URC') HTTP/1.1" 204 0
2026-03-29 22:07:32 [bca.uk] INFO: Found listing with ID: ML71%20WFO
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML71%2520WFO%27 HTTP/1.1" 200 None
2026-03-29 22:07:32 [bca.uk] INFO: Scrape type for ML71%20WFO: 2
2026-03-29 22:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932ab700-a26e-556f-85b5-1bb9734e718c with identifier: ML71%20WFO
2026-03-29 22:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932ab700-a26e-556f-85b5-1bb9734e718c with scrape type 2
2026-03-29 22:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 932ab700-a26e-556f-85b5-1bb9734e718c with scrape type 2
2026-03-29 22:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 932ab700-a26e-556f-85b5-1bb9734e718c, identifier: ML71%20WFO
2026-03-29 22:07:32 [bca.uk] INFO: Found listing with ID: GU09%20ZBO
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU09%2520ZBO%27 HTTP/1.1" 200 None
2026-03-29 22:07:32 [bca.uk] INFO: Scrape type for GU09%20ZBO: 2
2026-03-29 22:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d01a147-3afb-5ecc-8676-b197cf6baca3 with identifier: GU09%20ZBO
2026-03-29 22:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d01a147-3afb-5ecc-8676-b197cf6baca3 with scrape type 2
2026-03-29 22:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d01a147-3afb-5ecc-8676-b197cf6baca3 with scrape type 2
2026-03-29 22:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1d01a147-3afb-5ecc-8676-b197cf6baca3, identifier: GU09%20ZBO
2026-03-29 22:07:32 [bca.uk] INFO: Found listing with ID: KJ19%20ZRG
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520ZRG%27 HTTP/1.1" 200 None
2026-03-29 22:07:32 [bca.uk] INFO: Scrape type for KJ19%20ZRG: 2
2026-03-29 22:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e094926b-3a83-59ef-883a-320713cabb3c with identifier: KJ19%20ZRG
2026-03-29 22:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e094926b-3a83-59ef-883a-320713cabb3c with scrape type 2
2026-03-29 22:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e094926b-3a83-59ef-883a-320713cabb3c with scrape type 2
2026-03-29 22:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e094926b-3a83-59ef-883a-320713cabb3c, identifier: KJ19%20ZRG
2026-03-29 22:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 932ab700-a26e-556f-85b5-1bb9734e718c with identifier: ML71%20WFO
2026-03-29 22:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 932ab700-a26e-556f-85b5-1bb9734e718c with identifier: ML71%20WFO
2026-03-29 22:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 932ab700-a26e-556f-85b5-1bb9734e718c with identifier: ML71%20WFO to the API
2026-03-29 22:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 121,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML71%20WFO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '932ab700-a26e-556f-85b5-1bb9734e718c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML71 WFO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML71%20WFO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SEAT',
'model': 'ARONA',
'odometer': 37242,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'SEAT ARONA 1.0 TSI 110 FR Hatchback',
'transmission': 'manual',
'trim': 'TSI 110 FR',
'vin': 'VSSZZZKJZNR023355',
'year': 2021}
2026-03-29 22:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML71%2520WFO%27 HTTP/1.1" 200 None
2026-03-29 22:07:33 [bca.uk] INFO: Saving data for ML71%20WFO: {'auction_closing_time': 1774951200.0, 'created_time': 1774706835.800984, 'last_price_update_time': 1774822053.222939}
2026-03-29 22:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML71%2520WFO') HTTP/1.1" 204 0
2026-03-29 22:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1d01a147-3afb-5ecc-8676-b197cf6baca3 with identifier: GU09%20ZBO
2026-03-29 22:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1d01a147-3afb-5ecc-8676-b197cf6baca3 with identifier: GU09%20ZBO
2026-03-29 22:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1d01a147-3afb-5ecc-8676-b197cf6baca3 with identifier: GU09%20ZBO to the API
2026-03-29 22:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 132,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU09%20ZBO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1d01a147-3afb-5ecc-8676-b197cf6baca3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU09 ZBO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU09%20ZBO&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'MINI',
'model': 'COOPER CLUBMAN',
'odometer': 103219,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'MINI COOPER CLUBMAN 1.6 Estate',
'transmission': 'manual',
'trim': '',
'vin': 'WMWML32060TN49706',
'year': 2009}
2026-03-29 22:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU09%2520ZBO%27 HTTP/1.1" 200 None
2026-03-29 22:07:33 [bca.uk] INFO: Saving data for GU09%20ZBO: {'auction_closing_time': 1774864800.0, 'created_time': 1774735588.289826, 'last_price_update_time': 1774822053.875861}
2026-03-29 22:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU09%2520ZBO') HTTP/1.1" 204 0
2026-03-29 22:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146921/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146921>
2026-03-29 22:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139576/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139576>
2026-03-29 22:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124388/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124388>
2026-03-29 22:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435168/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435168>
2026-03-29 22:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430199/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430199>
2026-03-29 22:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139586/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139586>
2026-03-29 22:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430284/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430284>
2026-03-29 22:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e094926b-3a83-59ef-883a-320713cabb3c with identifier: KJ19%20ZRG
2026-03-29 22:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e094926b-3a83-59ef-883a-320713cabb3c with identifier: KJ19%20ZRG
2026-03-29 22:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e094926b-3a83-59ef-883a-320713cabb3c with identifier: KJ19%20ZRG to the API
2026-03-29 22:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 116,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KJ19%20ZRG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e094926b-3a83-59ef-883a-320713cabb3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KJ19 ZRG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KJ19%20ZRG&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'SKODA',
'model': 'OCTAVIA',
'odometer': 61989,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'SKODA OCTAVIA 2.0 TDI 184 VRS BLACK DSG7 Hatchback',
'transmission': 'automatic',
'trim': 'TDI 184 VRS BLACK DSG7',
'vin': 'TMBBK7NE1K0195822',
'year': 2019}
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520ZRG%27 HTTP/1.1" 200 None
2026-03-29 22:07:34 [bca.uk] INFO: Saving data for KJ19%20ZRG: {'auction_closing_time': 1774951200.0, 'created_time': 1774735470.291162, 'last_price_update_time': 1774822054.167455}
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KJ19%2520ZRG') HTTP/1.1" 204 0
2026-03-29 22:07:34 [bca.uk] INFO: Found listing with ID: YE19%20VLP
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE19%2520VLP%27 HTTP/1.1" 200 None
2026-03-29 22:07:34 [bca.uk] INFO: Scrape type for YE19%20VLP: 2
2026-03-29 22:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0e34e59-38b0-5058-b818-add93848e6bd with identifier: YE19%20VLP
2026-03-29 22:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0e34e59-38b0-5058-b818-add93848e6bd with scrape type 2
2026-03-29 22:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0e34e59-38b0-5058-b818-add93848e6bd with scrape type 2
2026-03-29 22:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b0e34e59-38b0-5058-b818-add93848e6bd, identifier: YE19%20VLP
2026-03-29 22:07:34 [bca.uk] INFO: Found listing with ID: YD13%20TWN
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD13%2520TWN%27 HTTP/1.1" 200 None
2026-03-29 22:07:34 [bca.uk] INFO: Scrape type for YD13%20TWN: 2
2026-03-29 22:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08149aa9-acd8-5621-afc9-de796506b5b4 with identifier: YD13%20TWN
2026-03-29 22:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08149aa9-acd8-5621-afc9-de796506b5b4 with scrape type 2
2026-03-29 22:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08149aa9-acd8-5621-afc9-de796506b5b4 with scrape type 2
2026-03-29 22:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 08149aa9-acd8-5621-afc9-de796506b5b4, identifier: YD13%20TWN
2026-03-29 22:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b0e34e59-38b0-5058-b818-add93848e6bd with identifier: YE19%20VLP
2026-03-29 22:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b0e34e59-38b0-5058-b818-add93848e6bd with identifier: YE19%20VLP
2026-03-29 22:07:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b0e34e59-38b0-5058-b818-add93848e6bd with identifier: YE19%20VLP to the API
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YE19%20VLP-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b0e34e59-38b0-5058-b818-add93848e6bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YE19 VLP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YE19%20VLP&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'CITROEN',
'model': 'C3 AIRCROSS',
'odometer': 70236,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'CITROEN C3 AIRCROSS 1.2 P/T 130 FLAIR Hatchback',
'transmission': 'manual',
'trim': 'P/T 130 FLAIR',
'vin': 'VF72RHNSJK4222529',
'year': 2019}
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE19%2520VLP%27 HTTP/1.1" 200 None
2026-03-29 22:07:34 [bca.uk] INFO: Saving data for YE19%20VLP: {'auction_closing_time': 1774864800.0, 'created_time': 1774130744.483752, 'last_price_update_time': 1774822054.712362}
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YE19%2520VLP') HTTP/1.1" 204 0
2026-03-29 22:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 08149aa9-acd8-5621-afc9-de796506b5b4 with identifier: YD13%20TWN
2026-03-29 22:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 08149aa9-acd8-5621-afc9-de796506b5b4 with identifier: YD13%20TWN
2026-03-29 22:07:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 08149aa9-acd8-5621-afc9-de796506b5b4 with identifier: YD13%20TWN to the API
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD13%20TWN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '08149aa9-acd8-5621-afc9-de796506b5b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD13 TWN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD13%20TWN&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 110158,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.2 SD4 4WD PURE Hatchback',
'transmission': 'automatic',
'trim': 'SD4 4WD PURE',
'vin': 'SALVA2AE2DH764862',
'year': 2013}
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD13%2520TWN%27 HTTP/1.1" 200 None
2026-03-29 22:07:34 [bca.uk] INFO: Saving data for YD13%20TWN: {'auction_closing_time': 1774864800.0, 'created_time': 1774735563.330268, 'last_price_update_time': 1774822054.99559}
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD13%2520TWN') HTTP/1.1" 204 0
2026-03-29 22:07:35 [bca.uk] INFO: Found listing with ID: YB19%20VUL
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB19%2520VUL%27 HTTP/1.1" 200 None
2026-03-29 22:07:35 [bca.uk] INFO: Scrape type for YB19%20VUL: 2
2026-03-29 22:07:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd5ff414-9c8a-5f3d-8f77-38507ba5d434 with identifier: YB19%20VUL
2026-03-29 22:07:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd5ff414-9c8a-5f3d-8f77-38507ba5d434 with scrape type 2
2026-03-29 22:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd5ff414-9c8a-5f3d-8f77-38507ba5d434 with scrape type 2
2026-03-29 22:07:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fd5ff414-9c8a-5f3d-8f77-38507ba5d434, identifier: YB19%20VUL
2026-03-29 22:07:35 [bca.uk] INFO: Found listing with ID: KP58%20SRV
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP58%2520SRV%27 HTTP/1.1" 200 None
2026-03-29 22:07:35 [bca.uk] INFO: Scrape type for KP58%20SRV: 2
2026-03-29 22:07:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dae85f49-83c1-5309-bd8a-55acf0d1d837 with identifier: KP58%20SRV
2026-03-29 22:07:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dae85f49-83c1-5309-bd8a-55acf0d1d837 with scrape type 2
2026-03-29 22:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dae85f49-83c1-5309-bd8a-55acf0d1d837 with scrape type 2
2026-03-29 22:07:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dae85f49-83c1-5309-bd8a-55acf0d1d837, identifier: KP58%20SRV
2026-03-29 22:07:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fd5ff414-9c8a-5f3d-8f77-38507ba5d434 with identifier: YB19%20VUL
2026-03-29 22:07:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fd5ff414-9c8a-5f3d-8f77-38507ba5d434 with identifier: YB19%20VUL
2026-03-29 22:07:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fd5ff414-9c8a-5f3d-8f77-38507ba5d434 with identifier: YB19%20VUL to the API
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YB19%20VUL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'fd5ff414-9c8a-5f3d-8f77-38507ba5d434',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YB19 VUL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YB19%20VUL&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'BMW',
'model': '320D',
'odometer': 999999,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 SE STEP Saloon',
'transmission': 'automatic',
'trim': 'SE STEP',
'vin': 'WBA5V52010AJ67430',
'year': 2019}
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB19%2520VUL%27 HTTP/1.1" 200 None
2026-03-29 22:07:35 [bca.uk] INFO: Saving data for YB19%20VUL: {'auction_closing_time': 1774864800.0, 'created_time': 1774536309.985425, 'last_price_update_time': 1774822055.515436}
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YB19%2520VUL') HTTP/1.1" 204 0
2026-03-29 22:07:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dae85f49-83c1-5309-bd8a-55acf0d1d837 with identifier: KP58%20SRV
2026-03-29 22:07:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dae85f49-83c1-5309-bd8a-55acf0d1d837 with identifier: KP58%20SRV
2026-03-29 22:07:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dae85f49-83c1-5309-bd8a-55acf0d1d837 with identifier: KP58%20SRV to the API
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 165,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KP58%20SRV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dae85f49-83c1-5309-bd8a-55acf0d1d837',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KP58 SRV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KP58%20SRV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 82095,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.4 80 MATCH Hatchback',
'transmission': 'automatic',
'trim': '80 MATCH',
'vin': 'WVWZZZ9NZ9Y079080',
'year': 2008}
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP58%2520SRV%27 HTTP/1.1" 200 None
2026-03-29 22:07:35 [bca.uk] INFO: Saving data for KP58%20SRV: {'auction_closing_time': 1774864800.0, 'created_time': 1774735590.264172, 'last_price_update_time': 1774822055.792403}
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KP58%2520SRV') HTTP/1.1" 204 0
2026-03-29 22:07:35 [bca.uk] INFO: Found listing with ID: NG19%20PXT
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG19%2520PXT%27 HTTP/1.1" 200 None
2026-03-29 22:07:35 [bca.uk] INFO: Scrape type for NG19%20PXT: 0
2026-03-29 22:07:35 [bca.uk] INFO: Found listing with ID: LP69%20AYT
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP69%2520AYT%27 HTTP/1.1" 200 None
2026-03-29 22:07:35 [bca.uk] INFO: Scrape type for LP69%20AYT: 0
2026-03-29 22:07:35 [bca.uk] INFO: Found listing with ID: BD19%20VEB
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD19%2520VEB%27 HTTP/1.1" 200 None
2026-03-29 22:07:35 [bca.uk] INFO: Scrape type for BD19%20VEB: 0
2026-03-29 22:07:35 [bca.uk] INFO: Found listing with ID: YB08%20OEU
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB08%2520OEU%27 HTTP/1.1" 200 None
2026-03-29 22:07:35 [bca.uk] INFO: Scrape type for YB08%20OEU: 0
2026-03-29 22:07:35 [bca.uk] INFO: Found listing with ID: MM11%20JNV
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM11%2520JNV%27 HTTP/1.1" 200 None
2026-03-29 22:07:35 [bca.uk] INFO: Scrape type for MM11%20JNV: 0
2026-03-29 22:07:35 [bca.uk] INFO: Found listing with ID: AC58%20KVH
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AC58%2520KVH%27 HTTP/1.1" 200 None
2026-03-29 22:07:35 [bca.uk] INFO: Scrape type for AC58%20KVH: 0
2026-03-29 22:07:35 [bca.uk] INFO: Found listing with ID: KS04%20HEJ
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS04%2520HEJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:35 [bca.uk] INFO: Scrape type for KS04%20HEJ: 0
2026-03-29 22:07:35 [bca.uk] INFO: Found listing with ID: YF12%20LYA
2026-03-29 22:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF12%2520LYA%27 HTTP/1.1" 200 None
2026-03-29 22:07:36 [bca.uk] INFO: Scrape type for YF12%20LYA: 0
2026-03-29 22:07:36 [bca.uk] INFO: Found listing with ID: SG09%20LCM
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG09%2520LCM%27 HTTP/1.1" 200 None
2026-03-29 22:07:36 [bca.uk] INFO: Scrape type for SG09%20LCM: 0
2026-03-29 22:07:36 [bca.uk] INFO: Found listing with ID: BT54%20XOM
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT54%2520XOM%27 HTTP/1.1" 200 None
2026-03-29 22:07:36 [bca.uk] INFO: Scrape type for BT54%20XOM: 0
2026-03-29 22:07:36 [bca.uk] INFO: Found listing with ID: SU06%20XOV
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SU06%2520XOV%27 HTTP/1.1" 200 None
2026-03-29 22:07:36 [bca.uk] INFO: Scrape type for SU06%20XOV: 2
2026-03-29 22:07:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d93a8558-0c09-5d27-83ff-565ac66c6712 with identifier: SU06%20XOV
2026-03-29 22:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d93a8558-0c09-5d27-83ff-565ac66c6712 with scrape type 2
2026-03-29 22:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d93a8558-0c09-5d27-83ff-565ac66c6712 with scrape type 2
2026-03-29 22:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d93a8558-0c09-5d27-83ff-565ac66c6712, identifier: SU06%20XOV
2026-03-29 22:07:36 [bca.uk] INFO: Found listing with ID: LT05%20ONJ
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT05%2520ONJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:36 [bca.uk] INFO: Scrape type for LT05%20ONJ: 2
2026-03-29 22:07:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08b948d7-14c0-5cfd-b5ed-455492122930 with identifier: LT05%20ONJ
2026-03-29 22:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08b948d7-14c0-5cfd-b5ed-455492122930 with scrape type 2
2026-03-29 22:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08b948d7-14c0-5cfd-b5ed-455492122930 with scrape type 2
2026-03-29 22:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 08b948d7-14c0-5cfd-b5ed-455492122930, identifier: LT05%20ONJ
2026-03-29 22:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d93a8558-0c09-5d27-83ff-565ac66c6712 with identifier: SU06%20XOV
2026-03-29 22:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d93a8558-0c09-5d27-83ff-565ac66c6712 with identifier: SU06%20XOV
2026-03-29 22:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d93a8558-0c09-5d27-83ff-565ac66c6712 with identifier: SU06%20XOV to the API
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 249,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SU06%20XOV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd93a8558-0c09-5d27-83ff-565ac66c6712',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SU06 XOV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SU06%20XOV&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'MERCEDES-BENZ',
'model': 'ML320',
'odometer': 154098,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ ML320 3.0 CDI SE StationWagon',
'transmission': 'manual',
'trim': 'CDI SE',
'vin': 'WDC1641222A059279',
'year': 2006}
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SU06%2520XOV%27 HTTP/1.1" 200 None
2026-03-29 22:07:36 [bca.uk] INFO: Saving data for SU06%20XOV: {'auction_closing_time': 1774864800.0, 'created_time': 1774535355.465273, 'last_price_update_time': 1774822056.550072}
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SU06%2520XOV') HTTP/1.1" 204 0
2026-03-29 22:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 08b948d7-14c0-5cfd-b5ed-455492122930 with identifier: LT05%20ONJ
2026-03-29 22:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 08b948d7-14c0-5cfd-b5ed-455492122930 with identifier: LT05%20ONJ
2026-03-29 22:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 08b948d7-14c0-5cfd-b5ed-455492122930 with identifier: LT05%20ONJ to the API
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT05%20ONJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '08b948d7-14c0-5cfd-b5ed-455492122930',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT05 ONJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT05%20ONJ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 111178,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.6 FSI SE Hatchback',
'transmission': 'automatic',
'trim': 'FSI SE',
'vin': 'WVWZZZ1KZ5W177524',
'year': 2005}
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT05%2520ONJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:36 [bca.uk] INFO: Saving data for LT05%20ONJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774735590.767081, 'last_price_update_time': 1774822056.89859}
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT05%2520ONJ') HTTP/1.1" 204 0
2026-03-29 22:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:07:36 [bca.uk] INFO: Found listing with ID: SP59%20HRM
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP59%2520HRM%27 HTTP/1.1" 200 None
2026-03-29 22:07:36 [bca.uk] INFO: Scrape type for SP59%20HRM: 0
2026-03-29 22:07:36 [bca.uk] INFO: Found listing with ID: GJ56%20ZHY
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ56%2520ZHY%27 HTTP/1.1" 200 None
2026-03-29 22:07:36 [bca.uk] INFO: Scrape type for GJ56%20ZHY: 0
2026-03-29 22:07:36 [bca.uk] INFO: Found listing with ID: M500%20MGW
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M500%2520MGW%27 HTTP/1.1" 200 None
2026-03-29 22:07:36 [bca.uk] INFO: Scrape type for M500%20MGW: 0
2026-03-29 22:07:36 [bca.uk] INFO: Found listing with ID: KY06%20TYK
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY06%2520TYK%27 HTTP/1.1" 200 None
2026-03-29 22:07:36 [bca.uk] INFO: Scrape type for KY06%20TYK: 2
2026-03-29 22:07:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 107d23bb-8742-5983-b85a-b41941cd68ed with identifier: KY06%20TYK
2026-03-29 22:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 107d23bb-8742-5983-b85a-b41941cd68ed with scrape type 2
2026-03-29 22:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 107d23bb-8742-5983-b85a-b41941cd68ed with scrape type 2
2026-03-29 22:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 107d23bb-8742-5983-b85a-b41941cd68ed, identifier: KY06%20TYK
2026-03-29 22:07:37 [bca.uk] INFO: Found listing with ID: ML09%20TVX
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML09%2520TVX%27 HTTP/1.1" 200 None
2026-03-29 22:07:37 [bca.uk] INFO: Scrape type for ML09%20TVX: 2
2026-03-29 22:07:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79d1bd1b-e75f-5786-8613-977c6a06c247 with identifier: ML09%20TVX
2026-03-29 22:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79d1bd1b-e75f-5786-8613-977c6a06c247 with scrape type 2
2026-03-29 22:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79d1bd1b-e75f-5786-8613-977c6a06c247 with scrape type 2
2026-03-29 22:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 79d1bd1b-e75f-5786-8613-977c6a06c247, identifier: ML09%20TVX
2026-03-29 22:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 107d23bb-8742-5983-b85a-b41941cd68ed with identifier: KY06%20TYK
2026-03-29 22:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 107d23bb-8742-5983-b85a-b41941cd68ed with identifier: KY06%20TYK
2026-03-29 22:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 107d23bb-8742-5983-b85a-b41941cd68ed with identifier: KY06%20TYK to the API
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 193,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY06%20TYK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '107d23bb-8742-5983-b85a-b41941cd68ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY06 TYK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KY06%20TYK&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MERCEDES-BENZ',
'model': 'C180',
'odometer': 99099,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C180 1.8 K SE Coupe',
'transmission': 'manual',
'trim': 'K SE',
'vin': 'WDB2037462A889874',
'year': 2006}
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY06%2520TYK%27 HTTP/1.1" 200 None
2026-03-29 22:07:37 [bca.uk] INFO: Saving data for KY06%20TYK: {'auction_closing_time': 1774864800.0, 'created_time': 1774361726.718049, 'last_price_update_time': 1774822057.518192}
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KY06%2520TYK') HTTP/1.1" 204 0
2026-03-29 22:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 79d1bd1b-e75f-5786-8613-977c6a06c247 with identifier: ML09%20TVX
2026-03-29 22:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 79d1bd1b-e75f-5786-8613-977c6a06c247 with identifier: ML09%20TVX
2026-03-29 22:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 79d1bd1b-e75f-5786-8613-977c6a06c247 with identifier: ML09%20TVX to the API
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML09%20TVX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '79d1bd1b-e75f-5786-8613-977c6a06c247',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML09 TVX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML09%20TVX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 93372,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'JAGUAR XF 3.0 D V6 240 LUXURY Saloon',
'transmission': 'automatic',
'trim': 'D V6 240 LUXURY',
'vin': 'SAJAC0525AKR49010',
'year': 2009}
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML09%2520TVX%27 HTTP/1.1" 200 None
2026-03-29 22:07:37 [bca.uk] INFO: Saving data for ML09%20TVX: {'auction_closing_time': 1774864800.0, 'created_time': 1774735562.059099, 'last_price_update_time': 1774822057.789041}
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML09%2520TVX') HTTP/1.1" 204 0
2026-03-29 22:07:37 [bca.uk] INFO: Found listing with ID: DG59%20XEM
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG59%2520XEM%27 HTTP/1.1" 200 None
2026-03-29 22:07:37 [bca.uk] INFO: Scrape type for DG59%20XEM: 0
2026-03-29 22:07:37 [bca.uk] INFO: Found listing with ID: BJ10%20UWH
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ10%2520UWH%27 HTTP/1.1" 200 None
2026-03-29 22:07:37 [bca.uk] INFO: Scrape type for BJ10%20UWH: 0
2026-03-29 22:07:37 [bca.uk] INFO: Found listing with ID: SC53%20TDX
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC53%2520TDX%27 HTTP/1.1" 200 None
2026-03-29 22:07:37 [bca.uk] INFO: Scrape type for SC53%20TDX: 0
2026-03-29 22:07:37 [bca.uk] INFO: Found listing with ID: HV57%20ETA
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV57%2520ETA%27 HTTP/1.1" 200 None
2026-03-29 22:07:37 [bca.uk] INFO: Scrape type for HV57%20ETA: 0
2026-03-29 22:07:37 [bca.uk] INFO: Found listing with ID: EN05%20JVE
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN05%2520JVE%27 HTTP/1.1" 200 None
2026-03-29 22:07:37 [bca.uk] INFO: Scrape type for EN05%20JVE: 0
2026-03-29 22:07:37 [bca.uk] INFO: Found listing with ID: GP57%20RLY
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP57%2520RLY%27 HTTP/1.1" 200 None
2026-03-29 22:07:37 [bca.uk] INFO: Scrape type for GP57%20RLY: 2
2026-03-29 22:07:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d68004bb-c7d6-5c64-a447-7e1fa4ebc052 with identifier: GP57%20RLY
2026-03-29 22:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68004bb-c7d6-5c64-a447-7e1fa4ebc052 with scrape type 2
2026-03-29 22:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d68004bb-c7d6-5c64-a447-7e1fa4ebc052 with scrape type 2
2026-03-29 22:07:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d68004bb-c7d6-5c64-a447-7e1fa4ebc052, identifier: GP57%20RLY
2026-03-29 22:07:38 [bca.uk] INFO: Found listing with ID: GU70%20SXD
2026-03-29 22:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU70%2520SXD%27 HTTP/1.1" 200 None
2026-03-29 22:07:38 [bca.uk] INFO: Scrape type for GU70%20SXD: 2
2026-03-29 22:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9eb7897-258a-53be-b988-82acf7b5019f with identifier: GU70%20SXD
2026-03-29 22:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9eb7897-258a-53be-b988-82acf7b5019f with scrape type 2
2026-03-29 22:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9eb7897-258a-53be-b988-82acf7b5019f with scrape type 2
2026-03-29 22:07:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c9eb7897-258a-53be-b988-82acf7b5019f, identifier: GU70%20SXD
2026-03-29 22:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d68004bb-c7d6-5c64-a447-7e1fa4ebc052 with identifier: GP57%20RLY
2026-03-29 22:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d68004bb-c7d6-5c64-a447-7e1fa4ebc052 with identifier: GP57%20RLY
2026-03-29 22:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d68004bb-c7d6-5c64-a447-7e1fa4ebc052 with identifier: GP57%20RLY to the API
2026-03-29 22:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GP57%20RLY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd68004bb-c7d6-5c64-a447-7e1fa4ebc052',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GP57 RLY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GP57%20RLY&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'VOLKSWAGEN',
'model': 'TOURAN',
'odometer': 132539,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TOURAN 2.0 TDI 140 SE MPV',
'transmission': 'manual',
'trim': 'TDI 140 SE',
'vin': 'WVGZZZ1TZ8W092897',
'year': 2007}
2026-03-29 22:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP57%2520RLY%27 HTTP/1.1" 200 None
2026-03-29 22:07:38 [bca.uk] INFO: Saving data for GP57%20RLY: {'auction_closing_time': 1774864800.0, 'created_time': 1774072929.651519, 'last_price_update_time': 1774822058.457513}
2026-03-29 22:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GP57%2520RLY') HTTP/1.1" 204 0
2026-03-29 22:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c9eb7897-258a-53be-b988-82acf7b5019f with identifier: GU70%20SXD
2026-03-29 22:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c9eb7897-258a-53be-b988-82acf7b5019f with identifier: GU70%20SXD
2026-03-29 22:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c9eb7897-258a-53be-b988-82acf7b5019f with identifier: GU70%20SXD to the API
2026-03-29 22:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU70%20SXD-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c9eb7897-258a-53be-b988-82acf7b5019f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU70 SXD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU70%20SXD&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'BMW',
'model': '118I',
'odometer': 44349,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'BMW 118I 1.5 M SPORT Hatchback',
'transmission': 'manual',
'trim': 'M SPORT',
'vin': 'WBA7K320807G76551',
'year': 2020}
2026-03-29 22:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU70%2520SXD%27 HTTP/1.1" 200 None
2026-03-29 22:07:38 [bca.uk] INFO: Saving data for GU70%20SXD: {'auction_closing_time': 1774864800.0, 'created_time': 1774735547.791472, 'last_price_update_time': 1774822058.860285}
2026-03-29 22:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU70%2520SXD') HTTP/1.1" 204 0
2026-03-29 22:07:38 [bca.uk] INFO: Total items found: 100
2026-03-29 22:07:38 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded
2026-03-29 22:07:38 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:07:38 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:07:38 [bca.uk] INFO: Found listing with ID: AX60%20BHW
2026-03-29 22:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX60%2520BHW%27 HTTP/1.1" 200 None
2026-03-29 22:07:39 [bca.uk] INFO: Scrape type for AX60%20BHW: 0
2026-03-29 22:07:39 [bca.uk] INFO: Found listing with ID: CA57%20XLV
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA57%2520XLV%27 HTTP/1.1" 200 None
2026-03-29 22:07:39 [bca.uk] INFO: Scrape type for CA57%20XLV: 0
2026-03-29 22:07:39 [bca.uk] INFO: Found listing with ID: YE59%20XKU
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE59%2520XKU%27 HTTP/1.1" 200 None
2026-03-29 22:07:39 [bca.uk] INFO: Scrape type for YE59%20XKU: 0
2026-03-29 22:07:39 [bca.uk] INFO: Found listing with ID: WJ58%20DWA
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ58%2520DWA%27 HTTP/1.1" 200 None
2026-03-29 22:07:39 [bca.uk] INFO: Scrape type for WJ58%20DWA: 0
2026-03-29 22:07:39 [bca.uk] INFO: Found listing with ID: HV62%20WPN
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV62%2520WPN%27 HTTP/1.1" 200 None
2026-03-29 22:07:39 [bca.uk] INFO: Scrape type for HV62%20WPN: 0
2026-03-29 22:07:39 [bca.uk] INFO: Found listing with ID: SD60%20WDX
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD60%2520WDX%27 HTTP/1.1" 200 None
2026-03-29 22:07:39 [bca.uk] INFO: Scrape type for SD60%20WDX: 0
2026-03-29 22:07:39 [bca.uk] INFO: Found listing with ID: CV61%20KBJ
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV61%2520KBJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:39 [bca.uk] INFO: Scrape type for CV61%20KBJ: 0
2026-03-29 22:07:39 [bca.uk] INFO: Found listing with ID: VO62%20VVP
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO62%2520VVP%27 HTTP/1.1" 200 None
2026-03-29 22:07:39 [bca.uk] INFO: Scrape type for VO62%20VVP: 2
2026-03-29 22:07:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1a765bb-ac90-5abf-b113-fb4f48614ee7 with identifier: VO62%20VVP
2026-03-29 22:07:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1a765bb-ac90-5abf-b113-fb4f48614ee7 with scrape type 2
2026-03-29 22:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1a765bb-ac90-5abf-b113-fb4f48614ee7 with scrape type 2
2026-03-29 22:07:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f1a765bb-ac90-5abf-b113-fb4f48614ee7, identifier: VO62%20VVP
2026-03-29 22:07:39 [bca.uk] INFO: Found listing with ID: L4%20VSX
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L4%2520VSX%27 HTTP/1.1" 200 None
2026-03-29 22:07:39 [bca.uk] INFO: Scrape type for L4%20VSX: 2
2026-03-29 22:07:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70ca5cba-185e-521d-a3da-10f6c18734b3 with identifier: L4%20VSX
2026-03-29 22:07:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70ca5cba-185e-521d-a3da-10f6c18734b3 with scrape type 2
2026-03-29 22:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70ca5cba-185e-521d-a3da-10f6c18734b3 with scrape type 2
2026-03-29 22:07:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 70ca5cba-185e-521d-a3da-10f6c18734b3, identifier: L4%20VSX
2026-03-29 22:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f1a765bb-ac90-5abf-b113-fb4f48614ee7 with identifier: VO62%20VVP
2026-03-29 22:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f1a765bb-ac90-5abf-b113-fb4f48614ee7 with identifier: VO62%20VVP
2026-03-29 22:07:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f1a765bb-ac90-5abf-b113-fb4f48614ee7 with identifier: VO62%20VVP to the API
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO62%20VVP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': 'f1a765bb-ac90-5abf-b113-fb4f48614ee7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO62 VVP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO62%20VVP&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'NISSAN',
'model': 'LEAF',
'odometer': 80987,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'NISSAN LEAF Hatchback',
'transmission': 'automatic',
'trim': '',
'vin': 'JN1FAAZE0U0013252',
'year': 2012}
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO62%2520VVP%27 HTTP/1.1" 200 None
2026-03-29 22:07:39 [bca.uk] INFO: Saving data for VO62%20VVP: {'auction_closing_time': 1774864800.0, 'created_time': 1774352680.721232, 'last_price_update_time': 1774822059.665889}
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO62%2520VVP') HTTP/1.1" 204 0
2026-03-29 22:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 70ca5cba-185e-521d-a3da-10f6c18734b3 with identifier: L4%20VSX
2026-03-29 22:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 70ca5cba-185e-521d-a3da-10f6c18734b3 with identifier: L4%20VSX
2026-03-29 22:07:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 70ca5cba-185e-521d-a3da-10f6c18734b3 with identifier: L4%20VSX to the API
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=L4%20VSX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '70ca5cba-185e-521d-a3da-10f6c18734b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'L4 VSX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=L4%20VSX&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 91557,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'ZETEC',
'vin': 'WF0PXXWPDP8B53141',
'year': 2008}
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L4%2520VSX%27 HTTP/1.1" 200 None
2026-03-29 22:07:39 [bca.uk] INFO: Saving data for L4%20VSX: {'auction_closing_time': 1774864800.0, 'created_time': 1774735547.169539, 'last_price_update_time': 1774822059.941311}
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='L4%2520VSX') HTTP/1.1" 204 0
2026-03-29 22:07:39 [bca.uk] INFO: Found listing with ID: YA18%20UVB
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA18%2520UVB%27 HTTP/1.1" 200 None
2026-03-29 22:07:39 [bca.uk] INFO: Scrape type for YA18%20UVB: 0
2026-03-29 22:07:39 [bca.uk] INFO: Found listing with ID: GF23%20TXO
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF23%2520TXO%27 HTTP/1.1" 200 None
2026-03-29 22:07:39 [bca.uk] INFO: Scrape type for GF23%20TXO: 2
2026-03-29 22:07:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 109c3b58-7203-5f87-be6e-0298d47e2ce7 with identifier: GF23%20TXO
2026-03-29 22:07:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 109c3b58-7203-5f87-be6e-0298d47e2ce7 with scrape type 2
2026-03-29 22:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 109c3b58-7203-5f87-be6e-0298d47e2ce7 with scrape type 2
2026-03-29 22:07:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 109c3b58-7203-5f87-be6e-0298d47e2ce7, identifier: GF23%20TXO
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: BJ07%20JAO
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ07%2520JAO%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for BJ07%20JAO: 0
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: YY62%20EHO
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY62%2520EHO%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for YY62%20EHO: 0
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: NU62%20FVV
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU62%2520FVV%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for NU62%20FVV: 0
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: YR60%20HSF
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR60%2520HSF%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for YR60%20HSF: 0
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: YE15%20JYC
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE15%2520JYC%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for YE15%20JYC: 0
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: VO63%20XSD
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO63%2520XSD%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for VO63%20XSD: 0
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: VK16%20BTV
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK16%2520BTV%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for VK16%20BTV: 0
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: RV60%20TZO
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV60%2520TZO%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for RV60%20TZO: 0
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: LG08%20RMU
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG08%2520RMU%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for LG08%20RMU: 0
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: HY60%20RUC
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY60%2520RUC%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for HY60%20RUC: 0
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: HV08%20XHP
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV08%2520XHP%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for HV08%20XHP: 0
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: GL11%20XOW
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL11%2520XOW%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for GL11%20XOW: 0
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: LN10%20VMY
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN10%2520VMY%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for LN10%20VMY: 0
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: LK64%20NEJ
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK64%2520NEJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for LK64%20NEJ: 2
2026-03-29 22:07:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb105475-65fd-5601-86d0-a8590c56bf0b with identifier: LK64%20NEJ
2026-03-29 22:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb105475-65fd-5601-86d0-a8590c56bf0b with scrape type 2
2026-03-29 22:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb105475-65fd-5601-86d0-a8590c56bf0b with scrape type 2
2026-03-29 22:07:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bb105475-65fd-5601-86d0-a8590c56bf0b, identifier: LK64%20NEJ
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: LR70%20AHN
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR70%2520AHN%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for LR70%20AHN: 0
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: GV69%20EKK
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV69%2520EKK%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for GV69%20EKK: 0
2026-03-29 22:07:40 [bca.uk] INFO: Found listing with ID: EJ14%20PYU
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ14%2520PYU%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Scrape type for EJ14%20PYU: 2
2026-03-29 22:07:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2faac3c-f66f-5c6b-825e-332b835cca02 with identifier: EJ14%20PYU
2026-03-29 22:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2faac3c-f66f-5c6b-825e-332b835cca02 with scrape type 2
2026-03-29 22:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2faac3c-f66f-5c6b-825e-332b835cca02 with scrape type 2
2026-03-29 22:07:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c2faac3c-f66f-5c6b-825e-332b835cca02, identifier: EJ14%20PYU
2026-03-29 22:07:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 109c3b58-7203-5f87-be6e-0298d47e2ce7 with identifier: GF23%20TXO
2026-03-29 22:07:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 109c3b58-7203-5f87-be6e-0298d47e2ce7 with identifier: GF23%20TXO
2026-03-29 22:07:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 109c3b58-7203-5f87-be6e-0298d47e2ce7 with identifier: GF23%20TXO to the API
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF23%20TXO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '109c3b58-7203-5f87-be6e-0298d47e2ce7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF23 TXO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF23%20TXO&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 41315,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B MHEV 155 ST-LINE X Hatchback',
'transmission': 'manual',
'trim': 'E/B MHEV 155 ST-LINE X',
'vin': 'WF0NXXGCHNPK50935',
'year': 2023}
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF23%2520TXO%27 HTTP/1.1" 200 None
2026-03-29 22:07:40 [bca.uk] INFO: Saving data for GF23%20TXO: {'auction_closing_time': 1774864800.0, 'created_time': 1774048159.294143, 'last_price_update_time': 1774822060.820492}
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF23%2520TXO') HTTP/1.1" 204 0
2026-03-29 22:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435182/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ58SFX/42812168?sv=2020-08-04&st=2026-03-29T22%3A06%3A32Z&se=2026-03-29T22%3A31%3A32Z&sr=b&sp=r&sig=qiTgzjDZ%2FB1Y9Jc9LI61o7EdjHjaU8RNz%2BEzvH34f2o%3D)
2026-03-29 22:07:40 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:07:40 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:07:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bb105475-65fd-5601-86d0-a8590c56bf0b with identifier: LK64%20NEJ
2026-03-29 22:07:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bb105475-65fd-5601-86d0-a8590c56bf0b with identifier: LK64%20NEJ
2026-03-29 22:07:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bb105475-65fd-5601-86d0-a8590c56bf0b with identifier: LK64%20NEJ to the API
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LK64%20NEJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'bb105475-65fd-5601-86d0-a8590c56bf0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LK64 NEJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LK64%20NEJ&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'MERCEDES-BENZ',
'model': 'C220',
'odometer': 175438,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C220 2.1 B/T AMG LINE PREMIUM Saloon',
'transmission': 'manual',
'trim': 'B/T AMG LINE PREMIUM',
'vin': 'WDD2050042R002325',
'year': 2014}
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK64%2520NEJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:41 [bca.uk] INFO: Saving data for LK64%20NEJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774706858.491858, 'last_price_update_time': 1774822061.297199}
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LK64%2520NEJ') HTTP/1.1" 204 0
2026-03-29 22:07:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c2faac3c-f66f-5c6b-825e-332b835cca02 with identifier: EJ14%20PYU
2026-03-29 22:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c2faac3c-f66f-5c6b-825e-332b835cca02 with identifier: EJ14%20PYU
2026-03-29 22:07:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c2faac3c-f66f-5c6b-825e-332b835cca02 with identifier: EJ14%20PYU to the API
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ14%20PYU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c2faac3c-f66f-5c6b-825e-332b835cca02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EJ14 PYU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EJ14%20PYU&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 82620,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.6 E-HDI ACTIVE EGC MPV',
'transmission': 'automatic',
'trim': 'E-HDI ACTIVE EGC',
'vin': 'VF3CU9HP8EY069706',
'year': 2014}
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ14%2520PYU%27 HTTP/1.1" 200 None
2026-03-29 22:07:41 [bca.uk] INFO: Saving data for EJ14%20PYU: {'auction_closing_time': 1774864800.0, 'created_time': 1774735579.469298, 'last_price_update_time': 1774822061.58608}
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EJ14%2520PYU') HTTP/1.1" 204 0
2026-03-29 22:07:41 [bca.uk] INFO: Found listing with ID: RE22%20ECV
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE22%2520ECV%27 HTTP/1.1" 200 None
2026-03-29 22:07:41 [bca.uk] INFO: Scrape type for RE22%20ECV: 0
2026-03-29 22:07:41 [bca.uk] INFO: Found listing with ID: AE69%20GWW
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE69%2520GWW%27 HTTP/1.1" 200 None
2026-03-29 22:07:41 [bca.uk] INFO: Scrape type for AE69%20GWW: 0
2026-03-29 22:07:41 [bca.uk] INFO: Found listing with ID: EJ69%20TFF
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ69%2520TFF%27 HTTP/1.1" 200 None
2026-03-29 22:07:41 [bca.uk] INFO: Scrape type for EJ69%20TFF: 2
2026-03-29 22:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0000ca0-cda2-564a-a588-b58706c95283 with identifier: EJ69%20TFF
2026-03-29 22:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0000ca0-cda2-564a-a588-b58706c95283 with scrape type 2
2026-03-29 22:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0000ca0-cda2-564a-a588-b58706c95283 with scrape type 2
2026-03-29 22:07:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a0000ca0-cda2-564a-a588-b58706c95283, identifier: EJ69%20TFF
2026-03-29 22:07:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146934/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR60HNV/42810656?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=iTeyX7WgAxvLftpE%2F2dkTmhR4Qwoz4r3xCUieQTYJOM%3D)
2026-03-29 22:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146962/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR60HNV/42810656?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=iTeyX7WgAxvLftpE%2F2dkTmhR4Qwoz4r3xCUieQTYJOM%3D)
2026-03-29 22:07:41 [bca.uk] INFO: Found listing with ID: LD62%20NNR
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD62%2520NNR%27 HTTP/1.1" 200 None
2026-03-29 22:07:41 [bca.uk] INFO: Scrape type for LD62%20NNR: 0
2026-03-29 22:07:41 [bca.uk] INFO: Found listing with ID: KM11%20UUD
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM11%2520UUD%27 HTTP/1.1" 200 None
2026-03-29 22:07:41 [bca.uk] INFO: Scrape type for KM11%20UUD: 0
2026-03-29 22:07:41 [bca.uk] INFO: Found listing with ID: GK61%20NMX
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK61%2520NMX%27 HTTP/1.1" 200 None
2026-03-29 22:07:41 [bca.uk] INFO: Scrape type for GK61%20NMX: 0
2026-03-29 22:07:41 [bca.uk] INFO: Found listing with ID: EN10%20PWV
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN10%2520PWV%27 HTTP/1.1" 200 None
2026-03-29 22:07:41 [bca.uk] INFO: Scrape type for EN10%20PWV: 0
2026-03-29 22:07:41 [bca.uk] INFO: Found listing with ID: BN10%20FFD
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN10%2520FFD%27 HTTP/1.1" 200 None
2026-03-29 22:07:41 [bca.uk] INFO: Scrape type for BN10%20FFD: 0
2026-03-29 22:07:41 [bca.uk] INFO: Found listing with ID: AV13%20PZZ
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV13%2520PZZ%27 HTTP/1.1" 200 None
2026-03-29 22:07:41 [bca.uk] INFO: Scrape type for AV13%20PZZ: 0
2026-03-29 22:07:41 [bca.uk] INFO: Found listing with ID: CV62%20UAZ
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV62%2520UAZ%27 HTTP/1.1" 200 None
2026-03-29 22:07:41 [bca.uk] INFO: Scrape type for CV62%20UAZ: 0
2026-03-29 22:07:41 [bca.uk] INFO: Found listing with ID: MV07%20KUJ
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV07%2520KUJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:41 [bca.uk] INFO: Scrape type for MV07%20KUJ: 0
2026-03-29 22:07:41 [bca.uk] INFO: Found listing with ID: KU57%20WZP
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU57%2520WZP%27 HTTP/1.1" 200 None
2026-03-29 22:07:41 [bca.uk] INFO: Scrape type for KU57%20WZP: 2
2026-03-29 22:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbb13ef4-19c8-586c-a4d2-93af637cef56 with identifier: KU57%20WZP
2026-03-29 22:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbb13ef4-19c8-586c-a4d2-93af637cef56 with scrape type 2
2026-03-29 22:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbb13ef4-19c8-586c-a4d2-93af637cef56 with scrape type 2
2026-03-29 22:07:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bbb13ef4-19c8-586c-a4d2-93af637cef56, identifier: KU57%20WZP
2026-03-29 22:07:41 [bca.uk] INFO: Found listing with ID: FG68%20SFY
2026-03-29 22:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG68%2520SFY%27 HTTP/1.1" 200 None
2026-03-29 22:07:42 [bca.uk] INFO: Scrape type for FG68%20SFY: 0
2026-03-29 22:07:42 [bca.uk] INFO: Found listing with ID: EX71%20JPO
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX71%2520JPO%27 HTTP/1.1" 200 None
2026-03-29 22:07:42 [bca.uk] INFO: Scrape type for EX71%20JPO: 2
2026-03-29 22:07:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b97ea534-9544-5066-9940-a3af577b97fd with identifier: EX71%20JPO
2026-03-29 22:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b97ea534-9544-5066-9940-a3af577b97fd with scrape type 2
2026-03-29 22:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b97ea534-9544-5066-9940-a3af577b97fd with scrape type 2
2026-03-29 22:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b97ea534-9544-5066-9940-a3af577b97fd, identifier: EX71%20JPO
2026-03-29 22:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a0000ca0-cda2-564a-a588-b58706c95283 with identifier: EJ69%20TFF
2026-03-29 22:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a0000ca0-cda2-564a-a588-b58706c95283 with identifier: EJ69%20TFF
2026-03-29 22:07:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a0000ca0-cda2-564a-a588-b58706c95283 with identifier: EJ69%20TFF to the API
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 96,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ69%20TFF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a0000ca0-cda2-564a-a588-b58706c95283',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EJ69 TFF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EJ69%20TFF&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 59551,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 125 ST-LINE ED. Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 ST-LINE ED.',
'vin': 'WF0JXXGAHJKM13690',
'year': 2019}
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ69%2520TFF%27 HTTP/1.1" 200 None
2026-03-29 22:07:42 [bca.uk] INFO: Saving data for EJ69%20TFF: {'auction_closing_time': 1774864800.0, 'created_time': 1774735563.72918, 'last_price_update_time': 1774822062.385637}
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EJ69%2520TFF') HTTP/1.1" 204 0
2026-03-29 22:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430310/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ08SVR/42812103?sv=2020-08-04&st=2026-03-29T22%3A06%3A29Z&se=2026-03-29T22%3A31%3A29Z&sr=b&sp=r&sig=MlBD76Nciq6xfGWS8ogzePQWya6I7akYbscBXB2PpJI%3D)
2026-03-29 22:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146948/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR60HNV/42810656?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=iTeyX7WgAxvLftpE%2F2dkTmhR4Qwoz4r3xCUieQTYJOM%3D)
2026-03-29 22:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124407/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM09CVU/42809722?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=IVQHrCG530q4ZNE7GeniJ3%2F1vLzKHgZru4jgYYDb%2BSY%3D)
2026-03-29 22:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124400/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM09CVU/42809722?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=IVQHrCG530q4ZNE7GeniJ3%2F1vLzKHgZru4jgYYDb%2BSY%3D)
2026-03-29 22:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435175/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ58SFX/42812168?sv=2020-08-04&st=2026-03-29T22%3A06%3A32Z&se=2026-03-29T22%3A31%3A32Z&sr=b&sp=r&sig=qiTgzjDZ%2FB1Y9Jc9LI61o7EdjHjaU8RNz%2BEzvH34f2o%3D)
2026-03-29 22:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bbb13ef4-19c8-586c-a4d2-93af637cef56 with identifier: KU57%20WZP
2026-03-29 22:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bbb13ef4-19c8-586c-a4d2-93af637cef56 with identifier: KU57%20WZP
2026-03-29 22:07:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bbb13ef4-19c8-586c-a4d2-93af637cef56 with identifier: KU57%20WZP to the API
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 193,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU57%20WZP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bbb13ef4-19c8-586c-a4d2-93af637cef56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU57 WZP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KU57%20WZP&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'C180',
'odometer': 159984,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C180 1.8 K CLASSIC SE Saloon',
'transmission': 'manual',
'trim': 'K CLASSIC SE',
'vin': 'WDC2030462R257577',
'year': 2007}
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU57%2520WZP%27 HTTP/1.1" 200 None
2026-03-29 22:07:42 [bca.uk] INFO: Saving data for KU57%20WZP: {'auction_closing_time': 1774864800.0, 'created_time': 1774735461.214874, 'last_price_update_time': 1774822062.780905}
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KU57%2520WZP') HTTP/1.1" 204 0
2026-03-29 22:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b97ea534-9544-5066-9940-a3af577b97fd with identifier: EX71%20JPO
2026-03-29 22:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b97ea534-9544-5066-9940-a3af577b97fd with identifier: EX71%20JPO
2026-03-29 22:07:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b97ea534-9544-5066-9940-a3af577b97fd with identifier: EX71%20JPO to the API
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EX71%20JPO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b97ea534-9544-5066-9940-a3af577b97fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EX71 JPO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EX71%20JPO&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'HYUNDAI',
'model': 'I20',
'odometer': 19095,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'HYUNDAI I20 1.0 T-GDI 100 ELEMENT Hatchback',
'transmission': 'manual',
'trim': 'T-GDI 100 ELEMENT',
'vin': 'NLHBN51GLNZ105553',
'year': 2022}
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX71%2520JPO%27 HTTP/1.1" 200 None
2026-03-29 22:07:43 [bca.uk] INFO: Saving data for EX71%20JPO: {'auction_closing_time': 1774864800.0, 'created_time': 1774735559.7992449, 'last_price_update_time': 1774822063.062647}
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EX71%2520JPO') HTTP/1.1" 204 0
2026-03-29 22:07:43 [bca.uk] INFO: Found listing with ID: CK18%20NWF
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520NWF%27 HTTP/1.1" 200 None
2026-03-29 22:07:43 [bca.uk] INFO: Scrape type for CK18%20NWF: 0
2026-03-29 22:07:43 [bca.uk] INFO: Found listing with ID: KS69%20HBC
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520HBC%27 HTTP/1.1" 200 None
2026-03-29 22:07:43 [bca.uk] INFO: Scrape type for KS69%20HBC: 2
2026-03-29 22:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 567b92e4-538d-5dfd-a509-01ee1c685e60 with identifier: KS69%20HBC
2026-03-29 22:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 567b92e4-538d-5dfd-a509-01ee1c685e60 with scrape type 2
2026-03-29 22:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 567b92e4-538d-5dfd-a509-01ee1c685e60 with scrape type 2
2026-03-29 22:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 567b92e4-538d-5dfd-a509-01ee1c685e60, identifier: KS69%20HBC
2026-03-29 22:07:43 [bca.uk] INFO: Found listing with ID: KY58%20DDF
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY58%2520DDF%27 HTTP/1.1" 200 None
2026-03-29 22:07:43 [bca.uk] INFO: Scrape type for KY58%20DDF: 2
2026-03-29 22:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b93e7f6f-f9b0-5da5-bcd2-2f4822ea58df with identifier: KY58%20DDF
2026-03-29 22:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b93e7f6f-f9b0-5da5-bcd2-2f4822ea58df with scrape type 2
2026-03-29 22:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b93e7f6f-f9b0-5da5-bcd2-2f4822ea58df with scrape type 2
2026-03-29 22:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b93e7f6f-f9b0-5da5-bcd2-2f4822ea58df, identifier: KY58%20DDF
2026-03-29 22:07:43 [bca.uk] INFO: Found listing with ID: EF22%20THK
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF22%2520THK%27 HTTP/1.1" 200 None
2026-03-29 22:07:43 [bca.uk] INFO: Scrape type for EF22%20THK: 0
2026-03-29 22:07:43 [bca.uk] INFO: Found listing with ID: DU68%20LVG
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU68%2520LVG%27 HTTP/1.1" 200 None
2026-03-29 22:07:43 [bca.uk] INFO: Scrape type for DU68%20LVG: 2
2026-03-29 22:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc with identifier: DU68%20LVG
2026-03-29 22:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc with scrape type 2
2026-03-29 22:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc with scrape type 2
2026-03-29 22:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc, identifier: DU68%20LVG
2026-03-29 22:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 567b92e4-538d-5dfd-a509-01ee1c685e60 with identifier: KS69%20HBC
2026-03-29 22:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 567b92e4-538d-5dfd-a509-01ee1c685e60 with identifier: KS69%20HBC
2026-03-29 22:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 567b92e4-538d-5dfd-a509-01ee1c685e60 with identifier: KS69%20HBC to the API
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS69%20HBC-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '567b92e4-538d-5dfd-a509-01ee1c685e60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS69 HBC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KS69%20HBC&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 98690,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 90 GRIFFIN Hatchback',
'transmission': 'manual',
'trim': '90 GRIFFIN',
'vin': 'W0V0XEP68K4508415',
'year': 2019}
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520HBC%27 HTTP/1.1" 200 None
2026-03-29 22:07:43 [bca.uk] INFO: Saving data for KS69%20HBC: {'auction_closing_time': 1774864800.0, 'created_time': 1774735562.45809, 'last_price_update_time': 1774822063.698316}
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KS69%2520HBC') HTTP/1.1" 204 0
2026-03-29 22:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430284/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ08SVR/42812103?sv=2020-08-04&st=2026-03-29T22%3A06%3A29Z&se=2026-03-29T22%3A31%3A29Z&sr=b&sp=r&sig=MlBD76Nciq6xfGWS8ogzePQWya6I7akYbscBXB2PpJI%3D)
2026-03-29 22:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b93e7f6f-f9b0-5da5-bcd2-2f4822ea58df with identifier: KY58%20DDF
2026-03-29 22:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b93e7f6f-f9b0-5da5-bcd2-2f4822ea58df with identifier: KY58%20DDF
2026-03-29 22:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b93e7f6f-f9b0-5da5-bcd2-2f4822ea58df with identifier: KY58%20DDF to the API
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 186,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY58%20DDF-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b93e7f6f-f9b0-5da5-bcd2-2f4822ea58df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY58 DDF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KY58%20DDF&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 97055,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.8 VVT DESIGN Hatchback',
'transmission': 'automatic',
'trim': 'VVT DESIGN',
'vin': 'W0L0AHL4888123037',
'year': 2008}
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY58%2520DDF%27 HTTP/1.1" 200 None
2026-03-29 22:07:43 [bca.uk] INFO: Saving data for KY58%20DDF: {'auction_closing_time': 1774864800.0, 'created_time': 1774505153.943372, 'last_price_update_time': 1774822063.978824}
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KY58%2520DDF') HTTP/1.1" 204 0
2026-03-29 22:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc with identifier: DU68%20LVG
2026-03-29 22:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc with identifier: DU68%20LVG
2026-03-29 22:07:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 73e9fcad-8a90-5e2f-8b8b-a9df139e02bc with identifier: DU68%20LVG to the API
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 160,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DU68%20LVG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '73e9fcad-8a90-5e2f-8b8b-a9df139e02bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DU68 LVG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DU68%20LVG&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'KUGA',
'odometer': 73497,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 180 4WD ST-LINE X P/S StationWagon',
'transmission': 'automatic',
'trim': 'TDCI 180 4WD ST-LINE X P/S',
'vin': 'WF0AXXWPMAJM87964',
'year': 2018}
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU68%2520LVG%27 HTTP/1.1" 200 None
2026-03-29 22:07:44 [bca.uk] INFO: Saving data for DU68%20LVG: {'auction_closing_time': 1774864800.0, 'created_time': 1774735596.812727, 'last_price_update_time': 1774822064.259075}
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DU68%2520LVG') HTTP/1.1" 204 0
2026-03-29 22:07:44 [bca.uk] INFO: Found listing with ID: BC04%20RGC
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC04%2520RGC%27 HTTP/1.1" 200 None
2026-03-29 22:07:44 [bca.uk] INFO: Scrape type for BC04%20RGC: 0
2026-03-29 22:07:44 [bca.uk] INFO: Found listing with ID: LO66%20DDN
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO66%2520DDN%27 HTTP/1.1" 200 None
2026-03-29 22:07:44 [bca.uk] INFO: Scrape type for LO66%20DDN: 2
2026-03-29 22:07:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d766950d-ff42-51aa-9795-cabfbea85c7a with identifier: LO66%20DDN
2026-03-29 22:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d766950d-ff42-51aa-9795-cabfbea85c7a with scrape type 2
2026-03-29 22:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d766950d-ff42-51aa-9795-cabfbea85c7a with scrape type 2
2026-03-29 22:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d766950d-ff42-51aa-9795-cabfbea85c7a, identifier: LO66%20DDN
2026-03-29 22:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61727850>
2026-03-29 22:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ58SFX%252F699435182%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435182/600 saved to cache
2026-03-29 22:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5063d79c-4147-5ce9-b414-8b0ccabfea0d
2026-03-29 22:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61988bd0>
2026-03-29 22:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR60HNV%252F699146934%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146934/600 saved to cache
2026-03-29 22:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a63c92f-88a3-5364-8028-ccaa89112c46
2026-03-29 22:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61070cd0>
2026-03-29 22:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR60HNV%252F699146962%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146962/600 saved to cache
2026-03-29 22:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a63c92f-88a3-5364-8028-ccaa89112c46
2026-03-29 22:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430199/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE56AOD/42812125?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=jYNw1fNPOU4PCeqA8yT%2FgW%2F2lYqFTt1ML7YNy%2BQkkpE%3D)
2026-03-29 22:07:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699427784/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427784>
2026-03-29 22:07:44 [bca.uk] INFO: Found listing with ID: LT55%20XAG
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT55%2520XAG%27 HTTP/1.1" 200 None
2026-03-29 22:07:44 [bca.uk] INFO: Scrape type for LT55%20XAG: 0
2026-03-29 22:07:44 [bca.uk] INFO: Found listing with ID: RO59%20VYY
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO59%2520VYY%27 HTTP/1.1" 200 None
2026-03-29 22:07:44 [bca.uk] INFO: Scrape type for RO59%20VYY: 0
2026-03-29 22:07:44 [bca.uk] INFO: Found listing with ID: EA59%20HXN
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA59%2520HXN%27 HTTP/1.1" 200 None
2026-03-29 22:07:44 [bca.uk] INFO: Scrape type for EA59%20HXN: 2
2026-03-29 22:07:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7fedd12-6fbb-5184-a0b0-01f166ed4c7b with identifier: EA59%20HXN
2026-03-29 22:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7fedd12-6fbb-5184-a0b0-01f166ed4c7b with scrape type 2
2026-03-29 22:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7fedd12-6fbb-5184-a0b0-01f166ed4c7b with scrape type 2
2026-03-29 22:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f7fedd12-6fbb-5184-a0b0-01f166ed4c7b, identifier: EA59%20HXN
2026-03-29 22:07:44 [bca.uk] INFO: Found listing with ID: CK70%20OSX
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK70%2520OSX%27 HTTP/1.1" 200 None
2026-03-29 22:07:44 [bca.uk] INFO: Scrape type for CK70%20OSX: 0
2026-03-29 22:07:44 [bca.uk] INFO: Found listing with ID: RF22%20LPJ
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF22%2520LPJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:44 [bca.uk] INFO: Scrape type for RF22%20LPJ: 0
2026-03-29 22:07:44 [bca.uk] INFO: Found listing with ID: YH22%20TPO
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH22%2520TPO%27 HTTP/1.1" 200 None
2026-03-29 22:07:44 [bca.uk] INFO: Scrape type for YH22%20TPO: 0
2026-03-29 22:07:44 [bca.uk] INFO: Found listing with ID: WR74%20UNV
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR74%2520UNV%27 HTTP/1.1" 200 None
2026-03-29 22:07:44 [bca.uk] INFO: Scrape type for WR74%20UNV: 0
2026-03-29 22:07:44 [bca.uk] INFO: Found listing with ID: OU66%20YVP
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU66%2520YVP%27 HTTP/1.1" 200 None
2026-03-29 22:07:44 [bca.uk] INFO: Scrape type for OU66%20YVP: 0
2026-03-29 22:07:44 [bca.uk] INFO: Found listing with ID: BV18%20MMU
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV18%2520MMU%27 HTTP/1.1" 200 None
2026-03-29 22:07:44 [bca.uk] INFO: Scrape type for BV18%20MMU: 2
2026-03-29 22:07:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bab00141-98d7-507d-a35a-585edf20fde4 with identifier: BV18%20MMU
2026-03-29 22:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bab00141-98d7-507d-a35a-585edf20fde4 with scrape type 2
2026-03-29 22:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bab00141-98d7-507d-a35a-585edf20fde4 with scrape type 2
2026-03-29 22:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bab00141-98d7-507d-a35a-585edf20fde4, identifier: BV18%20MMU
2026-03-29 22:07:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d766950d-ff42-51aa-9795-cabfbea85c7a with identifier: LO66%20DDN
2026-03-29 22:07:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d766950d-ff42-51aa-9795-cabfbea85c7a with identifier: LO66%20DDN
2026-03-29 22:07:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d766950d-ff42-51aa-9795-cabfbea85c7a with identifier: LO66%20DDN to the API
2026-03-29 22:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO66%20DDN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.8L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd766950d-ff42-51aa-9795-cabfbea85c7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LO66 DDN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LO66%20DDN&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'AUDI',
'model': 'TT',
'odometer': 95178,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'AUDI TT 1.8 TFSI 180 S LINE Coupe',
'transmission': 'manual',
'trim': 'TFSI 180 S LINE',
'vin': 'TRUZZZFV9H1010686',
'year': 2016}
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO66%2520DDN%27 HTTP/1.1" 200 None
2026-03-29 22:07:45 [bca.uk] INFO: Saving data for LO66%20DDN: {'auction_closing_time': 1774951200.0, 'created_time': 1774353575.223653, 'last_price_update_time': 1774822065.162036}
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LO66%2520DDN') HTTP/1.1" 204 0
2026-03-29 22:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146921/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR60HNV/42810656?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=iTeyX7WgAxvLftpE%2F2dkTmhR4Qwoz4r3xCUieQTYJOM%3D)
2026-03-29 22:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139576/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP66PGE/42809943?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=WoZ%2FTTd8%2FUTJlWN%2B%2FNq0hoqMOCTHwgwo3OayCCjYYF0%3D)
2026-03-29 22:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435168/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ58SFX/42812168?sv=2020-08-04&st=2026-03-29T22%3A06%3A32Z&se=2026-03-29T22%3A31%3A32Z&sr=b&sp=r&sig=qiTgzjDZ%2FB1Y9Jc9LI61o7EdjHjaU8RNz%2BEzvH34f2o%3D)
2026-03-29 22:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124388/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM09CVU/42809722?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=IVQHrCG530q4ZNE7GeniJ3%2F1vLzKHgZru4jgYYDb%2BSY%3D)
2026-03-29 22:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139586/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP66PGE/42809943?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=WoZ%2FTTd8%2FUTJlWN%2B%2FNq0hoqMOCTHwgwo3OayCCjYYF0%3D)
2026-03-29 22:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f7fedd12-6fbb-5184-a0b0-01f166ed4c7b with identifier: EA59%20HXN
2026-03-29 22:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f7fedd12-6fbb-5184-a0b0-01f166ed4c7b with identifier: EA59%20HXN
2026-03-29 22:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f7fedd12-6fbb-5184-a0b0-01f166ed4c7b with identifier: EA59%20HXN to the API
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA59%20HXN-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f7fedd12-6fbb-5184-a0b0-01f166ed4c7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA59 HXN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA59%20HXN&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 75615,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 VVT 115 SXI Hatchback',
'transmission': 'manual',
'trim': 'VVT 115 SXI',
'vin': 'W0L0AHL08A5014141',
'year': 2009}
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA59%2520HXN%27 HTTP/1.1" 200 None
2026-03-29 22:07:45 [bca.uk] INFO: Saving data for EA59%20HXN: {'auction_closing_time': 1774864800.0, 'created_time': 1774621543.408677, 'last_price_update_time': 1774822065.545481}
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA59%2520HXN') HTTP/1.1" 204 0
2026-03-29 22:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bab00141-98d7-507d-a35a-585edf20fde4 with identifier: BV18%20MMU
2026-03-29 22:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bab00141-98d7-507d-a35a-585edf20fde4 with identifier: BV18%20MMU
2026-03-29 22:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bab00141-98d7-507d-a35a-585edf20fde4 with identifier: BV18%20MMU to the API
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV18%20MMU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bab00141-98d7-507d-a35a-585edf20fde4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BV18 MMU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BV18%20MMU&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'SEAT',
'model': 'LEON',
'odometer': 71532,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'SEAT LEON 1.8 TSI 180 FR TECHNOLOGY DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI 180 FR TECHNOLOGY DSG',
'vin': 'VSSZZZ5FZJR175567',
'year': 2018}
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV18%2520MMU%27 HTTP/1.1" 200 None
2026-03-29 22:07:45 [bca.uk] INFO: Saving data for BV18%20MMU: {'auction_closing_time': 1774864800.0, 'created_time': 1774735608.481855, 'last_price_update_time': 1774822065.824513}
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BV18%2520MMU') HTTP/1.1" 204 0
2026-03-29 22:07:45 [bca.uk] INFO: Found listing with ID: RJ60%20UUD
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ60%2520UUD%27 HTTP/1.1" 200 None
2026-03-29 22:07:45 [bca.uk] INFO: Scrape type for RJ60%20UUD: 0
2026-03-29 22:07:45 [bca.uk] INFO: Found listing with ID: OV61%20DEU
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV61%2520DEU%27 HTTP/1.1" 200 None
2026-03-29 22:07:45 [bca.uk] INFO: Scrape type for OV61%20DEU: 2
2026-03-29 22:07:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d05f8db-32fe-5a7f-ab19-58c0c8cdeb5e with identifier: OV61%20DEU
2026-03-29 22:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d05f8db-32fe-5a7f-ab19-58c0c8cdeb5e with scrape type 2
2026-03-29 22:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d05f8db-32fe-5a7f-ab19-58c0c8cdeb5e with scrape type 2
2026-03-29 22:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8d05f8db-32fe-5a7f-ab19-58c0c8cdeb5e, identifier: OV61%20DEU
2026-03-29 22:07:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63739190>
2026-03-29 22:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ08SVR%252F699430310%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430310/600 saved to cache
2026-03-29 22:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4de1def5-9fea-59aa-8472-dafc14cac3a1
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6185f290>
2026-03-29 22:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR60HNV%252F699146948%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146948/600 saved to cache
2026-03-29 22:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a63c92f-88a3-5364-8028-ccaa89112c46
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620c1c90>
2026-03-29 22:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM09CVU%252F699124407%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124407/600 saved to cache
2026-03-29 22:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad76e9a4-0e7d-56af-9a84-3fd65281fde6
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61756950>
2026-03-29 22:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM09CVU%252F699124400%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124400/600 saved to cache
2026-03-29 22:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad76e9a4-0e7d-56af-9a84-3fd65281fde6
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac636d0790>
2026-03-29 22:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ58SFX%252F699435175%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435175/600 saved to cache
2026-03-29 22:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5063d79c-4147-5ce9-b414-8b0ccabfea0d
2026-03-29 22:07:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103856/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103856>
2026-03-29 22:07:46 [bca.uk] INFO: Found listing with ID: DE57%20JFF
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE57%2520JFF%27 HTTP/1.1" 200 None
2026-03-29 22:07:46 [bca.uk] INFO: Scrape type for DE57%20JFF: 0
2026-03-29 22:07:46 [bca.uk] INFO: Found listing with ID: SB15%20DHF
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB15%2520DHF%27 HTTP/1.1" 200 None
2026-03-29 22:07:46 [bca.uk] INFO: Scrape type for SB15%20DHF: 2
2026-03-29 22:07:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d with identifier: SB15%20DHF
2026-03-29 22:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d with scrape type 2
2026-03-29 22:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d with scrape type 2
2026-03-29 22:07:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d, identifier: SB15%20DHF
2026-03-29 22:07:46 [bca.uk] INFO: Found listing with ID: EJ72%20YOX
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ72%2520YOX%27 HTTP/1.1" 200 None
2026-03-29 22:07:46 [bca.uk] INFO: Scrape type for EJ72%20YOX: 0
2026-03-29 22:07:46 [bca.uk] INFO: Found listing with ID: GX69%20OHK
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX69%2520OHK%27 HTTP/1.1" 200 None
2026-03-29 22:07:46 [bca.uk] INFO: Scrape type for GX69%20OHK: 2
2026-03-29 22:07:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd277234-4dc4-5636-a402-27f6b3385c96 with identifier: GX69%20OHK
2026-03-29 22:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd277234-4dc4-5636-a402-27f6b3385c96 with scrape type 2
2026-03-29 22:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd277234-4dc4-5636-a402-27f6b3385c96 with scrape type 2
2026-03-29 22:07:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cd277234-4dc4-5636-a402-27f6b3385c96, identifier: GX69%20OHK
2026-03-29 22:07:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8d05f8db-32fe-5a7f-ab19-58c0c8cdeb5e with identifier: OV61%20DEU
2026-03-29 22:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8d05f8db-32fe-5a7f-ab19-58c0c8cdeb5e with identifier: OV61%20DEU
2026-03-29 22:07:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8d05f8db-32fe-5a7f-ab19-58c0c8cdeb5e with identifier: OV61%20DEU to the API
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 292,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV61%20DEU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '5.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8d05f8db-32fe-5a7f-ab19-58c0c8cdeb5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV61 DEU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV61%20DEU&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'JAGUAR',
'model': 'XFR',
'odometer': 100208,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'JAGUAR XFR 5.0 V8 SUPERCHARGED Saloon',
'transmission': 'automatic',
'trim': 'V8 SUPERCHARGED',
'vin': 'SAJAC08R4CMS28564',
'year': 2011}
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV61%2520DEU%27 HTTP/1.1" 200 None
2026-03-29 22:07:46 [bca.uk] INFO: Saving data for OV61%20DEU: {'auction_closing_time': 1774951200.0, 'created_time': 1774534271.278876, 'last_price_update_time': 1774822066.762056}
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV61%2520DEU') HTTP/1.1" 204 0
2026-03-29 22:07:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d with identifier: SB15%20DHF
2026-03-29 22:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d with identifier: SB15%20DHF
2026-03-29 22:07:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d452a1ca-e21b-5f2d-9b7b-38f4747f9c3d with identifier: SB15%20DHF to the API
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB15%20DHF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd452a1ca-e21b-5f2d-9b7b-38f4747f9c3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB15 DHF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB15%20DHF&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 89230,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TI-VCT 125 TITANIUM P/S Hatchback',
'transmission': 'automatic',
'trim': 'TI-VCT 125 TITANIUM P/S',
'vin': 'WF05XXGCC5FE34305',
'year': 2015}
2026-03-29 22:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB15%2520DHF%27 HTTP/1.1" 200 None
2026-03-29 22:07:47 [bca.uk] INFO: Saving data for SB15%20DHF: {'auction_closing_time': 1774864800.0, 'created_time': 1774735633.535693, 'last_price_update_time': 1774822067.074526}
2026-03-29 22:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB15%2520DHF') HTTP/1.1" 204 0
2026-03-29 22:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cd277234-4dc4-5636-a402-27f6b3385c96 with identifier: GX69%20OHK
2026-03-29 22:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cd277234-4dc4-5636-a402-27f6b3385c96 with identifier: GX69%20OHK
2026-03-29 22:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cd277234-4dc4-5636-a402-27f6b3385c96 with identifier: GX69%20OHK to the API
2026-03-29 22:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GX69%20OHK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cd277234-4dc4-5636-a402-27f6b3385c96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GX69 OHK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GX69%20OHK&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MERCEDES-BENZ',
'model': 'A200',
'odometer': 37404,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A200 1.3 AMG LINE DCT Saloon',
'transmission': 'automatic',
'trim': 'AMG LINE DCT',
'vin': 'WDD1771872J134679',
'year': 2019}
2026-03-29 22:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX69%2520OHK%27 HTTP/1.1" 200 None
2026-03-29 22:07:48 [bca.uk] INFO: Saving data for GX69%20OHK: {'auction_closing_time': 1774864800.0, 'created_time': 1774735608.871115, 'last_price_update_time': 1774822068.880718}
2026-03-29 22:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GX69%2520OHK') HTTP/1.1" 204 0
2026-03-29 22:07:48 [bca.uk] INFO: Found listing with ID: BV62%20UHD
2026-03-29 22:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV62%2520UHD%27 HTTP/1.1" 200 None
2026-03-29 22:07:48 [bca.uk] INFO: Scrape type for BV62%20UHD: 0
2026-03-29 22:07:48 [bca.uk] INFO: Found listing with ID: KJ08%20EHN
2026-03-29 22:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ08%2520EHN%27 HTTP/1.1" 200 None
2026-03-29 22:07:48 [bca.uk] INFO: Scrape type for KJ08%20EHN: 0
2026-03-29 22:07:48 [bca.uk] INFO: Found listing with ID: AD16%20JOV
2026-03-29 22:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD16%2520JOV%27 HTTP/1.1" 200 None
2026-03-29 22:07:48 [bca.uk] INFO: Scrape type for AD16%20JOV: 0
2026-03-29 22:07:48 [bca.uk] INFO: Found listing with ID: YB73%20OAS
2026-03-29 22:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB73%2520OAS%27 HTTP/1.1" 200 None
2026-03-29 22:07:48 [bca.uk] INFO: Scrape type for YB73%20OAS: 0
2026-03-29 22:07:48 [bca.uk] INFO: Found listing with ID: MV69%20AWO
2026-03-29 22:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV69%2520AWO%27 HTTP/1.1" 200 None
2026-03-29 22:07:48 [bca.uk] INFO: Scrape type for MV69%20AWO: 2
2026-03-29 22:07:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5172ad7b-a663-5860-962a-f840822640a8 with identifier: MV69%20AWO
2026-03-29 22:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5172ad7b-a663-5860-962a-f840822640a8 with scrape type 2
2026-03-29 22:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5172ad7b-a663-5860-962a-f840822640a8 with scrape type 2
2026-03-29 22:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5172ad7b-a663-5860-962a-f840822640a8, identifier: MV69%20AWO
2026-03-29 22:07:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146908/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146908>
2026-03-29 22:07:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430178/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430178>
2026-03-29 22:07:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435161/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435161>
2026-03-29 22:07:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139564/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139564>
2026-03-29 22:07:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103853/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103853>
2026-03-29 22:07:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124379/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124379>
2026-03-29 22:07:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430255/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430255>
2026-03-29 22:07:49 [bca.uk] INFO: Found listing with ID: DN60%20UOP
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN60%2520UOP%27 HTTP/1.1" 200 None
2026-03-29 22:07:49 [bca.uk] INFO: Scrape type for DN60%20UOP: 0
2026-03-29 22:07:49 [bca.uk] INFO: Found listing with ID: LD20%20VFR
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD20%2520VFR%27 HTTP/1.1" 200 None
2026-03-29 22:07:49 [bca.uk] INFO: Scrape type for LD20%20VFR: 2
2026-03-29 22:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e42f65-62fc-5369-aa50-0828074023cd with identifier: LD20%20VFR
2026-03-29 22:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e42f65-62fc-5369-aa50-0828074023cd with scrape type 2
2026-03-29 22:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2e42f65-62fc-5369-aa50-0828074023cd with scrape type 2
2026-03-29 22:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e2e42f65-62fc-5369-aa50-0828074023cd, identifier: LD20%20VFR
2026-03-29 22:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5172ad7b-a663-5860-962a-f840822640a8 with identifier: MV69%20AWO
2026-03-29 22:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5172ad7b-a663-5860-962a-f840822640a8 with identifier: MV69%20AWO
2026-03-29 22:07:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5172ad7b-a663-5860-962a-f840822640a8 with identifier: MV69%20AWO to the API
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 162,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MV69%20AWO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5172ad7b-a663-5860-962a-f840822640a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MV69 AWO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MV69%20AWO&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'GLE 300 D',
'odometer': 36746,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ GLE 300 D 2.0 AMG LINE PREMIUM 4M 9G StationWagon',
'transmission': 'manual',
'trim': 'AMG LINE PREMIUM 4M 9G',
'vin': 'WDC1671192A081919',
'year': 2019}
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV69%2520AWO%27 HTTP/1.1" 200 None
2026-03-29 22:07:49 [bca.uk] INFO: Saving data for MV69%20AWO: {'auction_closing_time': 1774951200.0, 'created_time': 1774534217.059137, 'last_price_update_time': 1774822069.588503}
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MV69%2520AWO') HTTP/1.1" 204 0
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6185cb90>
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ08SVR%252F699430284%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430284/600 saved to cache
2026-03-29 22:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4de1def5-9fea-59aa-8472-dafc14cac3a1
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62072b90>
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE56AOD%252F699430199%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430199/600 saved to cache
2026-03-29 22:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5674dd98-879a-5bc0-92a6-049abdc5f932
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61929e90>
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR60HNV%252F699146921%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146921/600 saved to cache
2026-03-29 22:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a63c92f-88a3-5364-8028-ccaa89112c46
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6101ec10>
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP66PGE%252F699139576%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139576/600 saved to cache
2026-03-29 22:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49025c6e-c82c-5ad9-a984-dc586f875105
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618747d0>
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ58SFX%252F699435168%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435168/600 saved to cache
2026-03-29 22:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5063d79c-4147-5ce9-b414-8b0ccabfea0d
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61a24250>
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM09CVU%252F699124388%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124388/600 saved to cache
2026-03-29 22:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad76e9a4-0e7d-56af-9a84-3fd65281fde6
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611bc110>
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP66PGE%252F699139586%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139586/600 saved to cache
2026-03-29 22:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49025c6e-c82c-5ad9-a984-dc586f875105
2026-03-29 22:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699427784/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE56AOD/42812125?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=jYNw1fNPOU4PCeqA8yT%2FgW%2F2lYqFTt1ML7YNy%2BQkkpE%3D)
2026-03-29 22:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e2e42f65-62fc-5369-aa50-0828074023cd with identifier: LD20%20VFR
2026-03-29 22:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e2e42f65-62fc-5369-aa50-0828074023cd with identifier: LD20%20VFR
2026-03-29 22:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e2e42f65-62fc-5369-aa50-0828074023cd with identifier: LD20%20VFR to the API
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD20%20VFR-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e2e42f65-62fc-5369-aa50-0828074023cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD20 VFR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD20%20VFR&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'KIA',
'model': 'CEED',
'odometer': 9791,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'KIA CEED 1.0 T GDI 120 2 ISG Hatchback',
'transmission': 'manual',
'trim': 'T GDI 120 2 ISG',
'vin': 'U5YH2511LLL095077',
'year': 2020}
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD20%2520VFR%27 HTTP/1.1" 200 None
2026-03-29 22:07:50 [bca.uk] INFO: Saving data for LD20%20VFR: {'auction_closing_time': 1774864800.0, 'created_time': 1774735587.906265, 'last_price_update_time': 1774822070.262711}
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD20%2520VFR') HTTP/1.1" 204 0
2026-03-29 22:07:50 [bca.uk] INFO: Found listing with ID: BT69%20OOB
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT69%2520OOB%27 HTTP/1.1" 200 None
2026-03-29 22:07:50 [bca.uk] INFO: Scrape type for BT69%20OOB: 0
2026-03-29 22:07:50 [bca.uk] INFO: Found listing with ID: GF23%20SBY
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF23%2520SBY%27 HTTP/1.1" 200 None
2026-03-29 22:07:50 [bca.uk] INFO: Scrape type for GF23%20SBY: 0
2026-03-29 22:07:50 [bca.uk] INFO: Found listing with ID: LK74%20JRO
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK74%2520JRO%27 HTTP/1.1" 200 None
2026-03-29 22:07:50 [bca.uk] INFO: Scrape type for LK74%20JRO: 0
2026-03-29 22:07:50 [bca.uk] INFO: Found listing with ID: WJ24%20BNZ
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ24%2520BNZ%27 HTTP/1.1" 200 None
2026-03-29 22:07:50 [bca.uk] INFO: Scrape type for WJ24%20BNZ: 0
2026-03-29 22:07:50 [bca.uk] INFO: Found listing with ID: LR14%20LYD
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR14%2520LYD%27 HTTP/1.1" 200 None
2026-03-29 22:07:50 [bca.uk] INFO: Scrape type for LR14%20LYD: 0
2026-03-29 22:07:50 [bca.uk] INFO: Found listing with ID: GF16%20PNK
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF16%2520PNK%27 HTTP/1.1" 200 None
2026-03-29 22:07:50 [bca.uk] INFO: Scrape type for GF16%20PNK: 0
2026-03-29 22:07:50 [bca.uk] INFO: Found listing with ID: BG65%20DZL
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG65%2520DZL%27 HTTP/1.1" 200 None
2026-03-29 22:07:50 [bca.uk] INFO: Scrape type for BG65%20DZL: 0
2026-03-29 22:07:50 [bca.uk] INFO: Found listing with ID: WM14%20VDJ
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM14%2520VDJ%27 HTTP/1.1" 200 None
2026-03-29 22:07:50 [bca.uk] INFO: Scrape type for WM14%20VDJ: 0
2026-03-29 22:07:50 [bca.uk] INFO: Found listing with ID: MW19%20MTX
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW19%2520MTX%27 HTTP/1.1" 200 None
2026-03-29 22:07:50 [bca.uk] INFO: Scrape type for MW19%20MTX: 0
2026-03-29 22:07:50 [bca.uk] INFO: Found listing with ID: ST24%20XOE
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST24%2520XOE%27 HTTP/1.1" 200 None
2026-03-29 22:07:50 [bca.uk] INFO: Scrape type for ST24%20XOE: 0
2026-03-29 22:07:50 [bca.uk] INFO: Found listing with ID: FX70%20HCZ
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX70%2520HCZ%27 HTTP/1.1" 200 None
2026-03-29 22:07:50 [bca.uk] INFO: Scrape type for FX70%20HCZ: 2
2026-03-29 22:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba6e6e14-e7c6-548a-809e-e0544d6394d9 with identifier: FX70%20HCZ
2026-03-29 22:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba6e6e14-e7c6-548a-809e-e0544d6394d9 with scrape type 2
2026-03-29 22:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba6e6e14-e7c6-548a-809e-e0544d6394d9 with scrape type 2
2026-03-29 22:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ba6e6e14-e7c6-548a-809e-e0544d6394d9, identifier: FX70%20HCZ
2026-03-29 22:07:50 [bca.uk] INFO: Found listing with ID: WK69%20XPD
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK69%2520XPD%27 HTTP/1.1" 200 None
2026-03-29 22:07:50 [bca.uk] INFO: Scrape type for WK69%20XPD: 2
2026-03-29 22:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5ea448e-ce7a-5663-b1ff-9cff4b82d356 with identifier: WK69%20XPD
2026-03-29 22:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5ea448e-ce7a-5663-b1ff-9cff4b82d356 with scrape type 2
2026-03-29 22:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5ea448e-ce7a-5663-b1ff-9cff4b82d356 with scrape type 2
2026-03-29 22:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e5ea448e-ce7a-5663-b1ff-9cff4b82d356, identifier: WK69%20XPD
2026-03-29 22:07:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ba6e6e14-e7c6-548a-809e-e0544d6394d9 with identifier: FX70%20HCZ
2026-03-29 22:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ba6e6e14-e7c6-548a-809e-e0544d6394d9 with identifier: FX70%20HCZ
2026-03-29 22:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ba6e6e14-e7c6-548a-809e-e0544d6394d9 with identifier: FX70%20HCZ to the API
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 167,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FX70%20HCZ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ba6e6e14-e7c6-548a-809e-e0544d6394d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FX70 HCZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FX70%20HCZ&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'ABARTH',
'model': '595',
'odometer': 18675,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'ABARTH 595 1.4 T-JET 165 TURISMO 70TH ANNIV. Hatchback',
'transmission': 'manual',
'trim': 'T-JET 165 TURISMO 70TH ANNIV.',
'vin': 'ZFA3120000JD46346',
'year': 2020}
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX70%2520HCZ%27 HTTP/1.1" 200 None
2026-03-29 22:07:50 [bca.uk] INFO: Saving data for FX70%20HCZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774621269.882943, 'last_price_update_time': 1774822070.935024}
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FX70%2520HCZ') HTTP/1.1" 204 0
2026-03-29 22:07:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699427769/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427769>
2026-03-29 22:07:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435152/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435152>
2026-03-29 22:07:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124373/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124373>
2026-03-29 22:07:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146901/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146901>
2026-03-29 22:07:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139551/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139551>
2026-03-29 22:07:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430227/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430227>
2026-03-29 22:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103856/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AP12HDL/42809882?sv=2020-08-04&st=2026-03-29T22%3A06%3A24Z&se=2026-03-29T22%3A31%3A24Z&sr=b&sp=r&sig=DviGem8rLk3txiS7kcWiSVUINF67ojRtTzL1ranpKKA%3D)
2026-03-29 22:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e5ea448e-ce7a-5663-b1ff-9cff4b82d356 with identifier: WK69%20XPD
2026-03-29 22:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e5ea448e-ce7a-5663-b1ff-9cff4b82d356 with identifier: WK69%20XPD
2026-03-29 22:07:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e5ea448e-ce7a-5663-b1ff-9cff4b82d356 with identifier: WK69%20XPD to the API
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 126,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WK69%20XPD-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e5ea448e-ce7a-5663-b1ff-9cff4b82d356',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WK69 XPD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WK69%20XPD&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'DACIA',
'model': 'DUSTER',
'odometer': 4538,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'DACIA DUSTER 1.0 TCE 100 ESSENTIAL StationWagon',
'transmission': 'manual',
'trim': 'TCE 100 ESSENTIAL',
'vin': 'VF1HJD20364254290',
'year': 2019}
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK69%2520XPD%27 HTTP/1.1" 200 None
2026-03-29 22:07:51 [bca.uk] INFO: Saving data for WK69%20XPD: {'auction_closing_time': 1774864800.0, 'created_time': 1774621259.948892, 'last_price_update_time': 1774822071.328717}
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WK69%2520XPD') HTTP/1.1" 204 0
2026-03-29 22:07:51 [bca.uk] INFO: Found listing with ID: EN19%20JGV
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN19%2520JGV%27 HTTP/1.1" 200 None
2026-03-29 22:07:51 [bca.uk] INFO: Scrape type for EN19%20JGV: 0
2026-03-29 22:07:51 [bca.uk] INFO: Found listing with ID: BT24%20LKX
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT24%2520LKX%27 HTTP/1.1" 200 None
2026-03-29 22:07:51 [bca.uk] INFO: Scrape type for BT24%20LKX: 0
2026-03-29 22:07:51 [bca.uk] INFO: Found listing with ID: DG23%20HXH
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG23%2520HXH%27 HTTP/1.1" 200 None
2026-03-29 22:07:51 [bca.uk] INFO: Scrape type for DG23%20HXH: 0
2026-03-29 22:07:51 [bca.uk] INFO: Found listing with ID: FY68%20WNB
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY68%2520WNB%27 HTTP/1.1" 200 None
2026-03-29 22:07:51 [bca.uk] INFO: Scrape type for FY68%20WNB: 2
2026-03-29 22:07:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8436e02-8218-5d88-bcc5-e01ffac7eb8e with identifier: FY68%20WNB
2026-03-29 22:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8436e02-8218-5d88-bcc5-e01ffac7eb8e with scrape type 2
2026-03-29 22:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8436e02-8218-5d88-bcc5-e01ffac7eb8e with scrape type 2
2026-03-29 22:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d8436e02-8218-5d88-bcc5-e01ffac7eb8e, identifier: FY68%20WNB
2026-03-29 22:07:51 [bca.uk] INFO: Found listing with ID: BG72%20YNH
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG72%2520YNH%27 HTTP/1.1" 200 None
2026-03-29 22:07:51 [bca.uk] INFO: Scrape type for BG72%20YNH: 0
2026-03-29 22:07:51 [bca.uk] INFO: Found listing with ID: DP69%20ZFO
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP69%2520ZFO%27 HTTP/1.1" 200 None
2026-03-29 22:07:51 [bca.uk] INFO: Scrape type for DP69%20ZFO: 2
2026-03-29 22:07:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ae84d00-f082-5222-b51d-cfbb89091e57 with identifier: DP69%20ZFO
2026-03-29 22:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ae84d00-f082-5222-b51d-cfbb89091e57 with scrape type 2
2026-03-29 22:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ae84d00-f082-5222-b51d-cfbb89091e57 with scrape type 2
2026-03-29 22:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8ae84d00-f082-5222-b51d-cfbb89091e57, identifier: DP69%20ZFO
2026-03-29 22:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d8436e02-8218-5d88-bcc5-e01ffac7eb8e with identifier: FY68%20WNB
2026-03-29 22:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d8436e02-8218-5d88-bcc5-e01ffac7eb8e with identifier: FY68%20WNB
2026-03-29 22:07:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d8436e02-8218-5d88-bcc5-e01ffac7eb8e with identifier: FY68%20WNB to the API
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY68%20WNB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd8436e02-8218-5d88-bcc5-e01ffac7eb8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY68 WNB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FY68%20WNB&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'GRANDLAND X',
'odometer': 42686,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VAUXHALL GRANDLAND X 1.2 T 130 SE Hatchback',
'transmission': 'manual',
'trim': 'T 130 SE',
'vin': 'W0VZRHNSXJS392664',
'year': 2018}
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY68%2520WNB%27 HTTP/1.1" 200 None
2026-03-29 22:07:51 [bca.uk] INFO: Saving data for FY68%20WNB: {'auction_closing_time': 1774864800.0, 'created_time': 1774706951.698628, 'last_price_update_time': 1774822071.904248}
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FY68%2520WNB') HTTP/1.1" 204 0
2026-03-29 22:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8ae84d00-f082-5222-b51d-cfbb89091e57 with identifier: DP69%20ZFO
2026-03-29 22:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8ae84d00-f082-5222-b51d-cfbb89091e57 with identifier: DP69%20ZFO
2026-03-29 22:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8ae84d00-f082-5222-b51d-cfbb89091e57 with identifier: DP69%20ZFO to the API
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 93,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DP69%20ZFO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8ae84d00-f082-5222-b51d-cfbb89091e57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DP69 ZFO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DP69%20ZFO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 25015,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'VXKUPHMHDL4067468',
'year': 2019}
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP69%2520ZFO%27 HTTP/1.1" 200 None
2026-03-29 22:07:52 [bca.uk] INFO: Saving data for DP69%20ZFO: {'auction_closing_time': 1774864800.0, 'created_time': 1774735589.131941, 'last_price_update_time': 1774822072.205568}
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DP69%2520ZFO') HTTP/1.1" 204 0
2026-03-29 22:07:52 [bca.uk] INFO: Found listing with ID: YC21%20EXV
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC21%2520EXV%27 HTTP/1.1" 200 None
2026-03-29 22:07:52 [bca.uk] INFO: Scrape type for YC21%20EXV: 0
2026-03-29 22:07:52 [bca.uk] INFO: Found listing with ID: Y200%20JDW
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y200%2520JDW%27 HTTP/1.1" 200 None
2026-03-29 22:07:52 [bca.uk] INFO: Scrape type for Y200%20JDW: 0
2026-03-29 22:07:52 [bca.uk] INFO: Found listing with ID: VX19%20OYP
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX19%2520OYP%27 HTTP/1.1" 200 None
2026-03-29 22:07:52 [bca.uk] INFO: Scrape type for VX19%20OYP: 2
2026-03-29 22:07:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7b36a17-d5d4-5e94-9bbf-8a754ca74b60 with identifier: VX19%20OYP
2026-03-29 22:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7b36a17-d5d4-5e94-9bbf-8a754ca74b60 with scrape type 2
2026-03-29 22:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7b36a17-d5d4-5e94-9bbf-8a754ca74b60 with scrape type 2
2026-03-29 22:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b7b36a17-d5d4-5e94-9bbf-8a754ca74b60, identifier: VX19%20OYP
2026-03-29 22:07:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac60ef77d0>
2026-03-29 22:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE56AOD%252F699427784%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699427784/600 saved to cache
2026-03-29 22:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5674dd98-879a-5bc0-92a6-049abdc5f932
2026-03-29 22:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146908/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR60HNV/42810656?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=iTeyX7WgAxvLftpE%2F2dkTmhR4Qwoz4r3xCUieQTYJOM%3D)
2026-03-29 22:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430178/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE56AOD/42812125?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=jYNw1fNPOU4PCeqA8yT%2FgW%2F2lYqFTt1ML7YNy%2BQkkpE%3D)
2026-03-29 22:07:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103848/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103848>
2026-03-29 22:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430255/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ08SVR/42812103?sv=2020-08-04&st=2026-03-29T22%3A06%3A29Z&se=2026-03-29T22%3A31%3A29Z&sr=b&sp=r&sig=MlBD76Nciq6xfGWS8ogzePQWya6I7akYbscBXB2PpJI%3D)
2026-03-29 22:07:52 [bca.uk] INFO: Found listing with ID: BJ20%20SFO
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ20%2520SFO%27 HTTP/1.1" 200 None
2026-03-29 22:07:52 [bca.uk] INFO: Scrape type for BJ20%20SFO: 2
2026-03-29 22:07:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0586b55a-6c26-5bef-804d-4b64e9ef9872 with identifier: BJ20%20SFO
2026-03-29 22:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0586b55a-6c26-5bef-804d-4b64e9ef9872 with scrape type 2
2026-03-29 22:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0586b55a-6c26-5bef-804d-4b64e9ef9872 with scrape type 2
2026-03-29 22:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0586b55a-6c26-5bef-804d-4b64e9ef9872, identifier: BJ20%20SFO
2026-03-29 22:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b7b36a17-d5d4-5e94-9bbf-8a754ca74b60 with identifier: VX19%20OYP
2026-03-29 22:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b7b36a17-d5d4-5e94-9bbf-8a754ca74b60 with identifier: VX19%20OYP
2026-03-29 22:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b7b36a17-d5d4-5e94-9bbf-8a754ca74b60 with identifier: VX19%20OYP to the API
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VX19%20OYP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b7b36a17-d5d4-5e94-9bbf-8a754ca74b60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VX19 OYP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VX19%20OYP&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'SMART',
'model': 'FORTWO',
'odometer': 28386,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'SMART FORTWO 1.0 71 PURE Coupe',
'transmission': 'manual',
'trim': '71 PURE',
'vin': 'WME4533422K328630',
'year': 2019}
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX19%2520OYP%27 HTTP/1.1" 200 None
2026-03-29 22:07:52 [bca.uk] INFO: Saving data for VX19%20OYP: {'auction_closing_time': 1774864800.0, 'created_time': 1774706960.110758, 'last_price_update_time': 1774822072.788958}
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VX19%2520OYP') HTTP/1.1" 204 0
2026-03-29 22:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124379/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM09CVU/42809722?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=IVQHrCG530q4ZNE7GeniJ3%2F1vLzKHgZru4jgYYDb%2BSY%3D)
2026-03-29 22:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435161/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ58SFX/42812168?sv=2020-08-04&st=2026-03-29T22%3A06%3A32Z&se=2026-03-29T22%3A31%3A32Z&sr=b&sp=r&sig=qiTgzjDZ%2FB1Y9Jc9LI61o7EdjHjaU8RNz%2BEzvH34f2o%3D)
2026-03-29 22:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139564/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP66PGE/42809943?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=WoZ%2FTTd8%2FUTJlWN%2B%2FNq0hoqMOCTHwgwo3OayCCjYYF0%3D)
2026-03-29 22:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103853/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AP12HDL/42809882?sv=2020-08-04&st=2026-03-29T22%3A06%3A24Z&se=2026-03-29T22%3A31%3A24Z&sr=b&sp=r&sig=DviGem8rLk3txiS7kcWiSVUINF67ojRtTzL1ranpKKA%3D)
2026-03-29 22:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0586b55a-6c26-5bef-804d-4b64e9ef9872 with identifier: BJ20%20SFO
2026-03-29 22:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0586b55a-6c26-5bef-804d-4b64e9ef9872 with identifier: BJ20%20SFO
2026-03-29 22:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0586b55a-6c26-5bef-804d-4b64e9ef9872 with identifier: BJ20%20SFO to the API
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ20%20SFO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0586b55a-6c26-5bef-804d-4b64e9ef9872',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ20 SFO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ20%20SFO&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'AUDI',
'model': 'Q3 SPORTBACK',
'odometer': 84581,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'AUDI Q3 SPORTBACK 1.5 35 TFSI S LINE S-T Coupe',
'transmission': 'automatic',
'trim': '35 TFSI S LINE S-T',
'vin': 'WAUZZZF31L1058696',
'year': 2020}
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ20%2520SFO%27 HTTP/1.1" 200 None
2026-03-29 22:07:53 [bca.uk] INFO: Saving data for BJ20%20SFO: {'auction_closing_time': 1774864800.0, 'created_time': 1774621241.562599, 'last_price_update_time': 1774822073.100807}
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ20%2520SFO') HTTP/1.1" 204 0
2026-03-29 22:07:53 [bca.uk] INFO: Found listing with ID: DP19%20FWW
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP19%2520FWW%27 HTTP/1.1" 200 None
2026-03-29 22:07:53 [bca.uk] INFO: Scrape type for DP19%20FWW: 2
2026-03-29 22:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b13d468-b932-5891-9e01-a66081b24d30 with identifier: DP19%20FWW
2026-03-29 22:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b13d468-b932-5891-9e01-a66081b24d30 with scrape type 2
2026-03-29 22:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b13d468-b932-5891-9e01-a66081b24d30 with scrape type 2
2026-03-29 22:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4b13d468-b932-5891-9e01-a66081b24d30, identifier: DP19%20FWW
2026-03-29 22:07:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63673f10>
2026-03-29 22:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAP12HDL%252F699103856%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103856/600 saved to cache
2026-03-29 22:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21e79e5d-2d1b-56fe-b8fb-2067f25370f7
2026-03-29 22:07:53 [bca.uk] INFO: Found listing with ID: LX70%20UWW
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX70%2520UWW%27 HTTP/1.1" 200 None
2026-03-29 22:07:53 [bca.uk] INFO: Scrape type for LX70%20UWW: 0
2026-03-29 22:07:53 [bca.uk] INFO: Found listing with ID: ML18%20JZP
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML18%2520JZP%27 HTTP/1.1" 200 None
2026-03-29 22:07:53 [bca.uk] INFO: Scrape type for ML18%20JZP: 0
2026-03-29 22:07:53 [bca.uk] INFO: Found listing with ID: AO18%20YDT
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO18%2520YDT%27 HTTP/1.1" 200 None
2026-03-29 22:07:53 [bca.uk] INFO: Scrape type for AO18%20YDT: 0
2026-03-29 22:07:53 [bca.uk] INFO: Found listing with ID: DX68%20LYY
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX68%2520LYY%27 HTTP/1.1" 200 None
2026-03-29 22:07:53 [bca.uk] INFO: Scrape type for DX68%20LYY: 0
2026-03-29 22:07:53 [bca.uk] INFO: Found listing with ID: M8%20GTB
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M8%2520GTB%27 HTTP/1.1" 200 None
2026-03-29 22:07:53 [bca.uk] INFO: Scrape type for M8%20GTB: 0
2026-03-29 22:07:53 [bca.uk] INFO: Found listing with ID: MW24%20ESU
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW24%2520ESU%27 HTTP/1.1" 200 None
2026-03-29 22:07:53 [bca.uk] INFO: Scrape type for MW24%20ESU: 0
2026-03-29 22:07:53 [bca.uk] INFO: Found listing with ID: MA22%20GUC
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA22%2520GUC%27 HTTP/1.1" 200 None
2026-03-29 22:07:53 [bca.uk] INFO: Scrape type for MA22%20GUC: 0
2026-03-29 22:07:53 [bca.uk] INFO: Found listing with ID: PX69%20SXW
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX69%2520SXW%27 HTTP/1.1" 200 None
2026-03-29 22:07:53 [bca.uk] INFO: Scrape type for PX69%20SXW: 2
2026-03-29 22:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc9a40ba-b58e-5c29-8228-ff9841f99834 with identifier: PX69%20SXW
2026-03-29 22:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc9a40ba-b58e-5c29-8228-ff9841f99834 with scrape type 2
2026-03-29 22:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc9a40ba-b58e-5c29-8228-ff9841f99834 with scrape type 2
2026-03-29 22:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dc9a40ba-b58e-5c29-8228-ff9841f99834, identifier: PX69%20SXW
2026-03-29 22:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4b13d468-b932-5891-9e01-a66081b24d30 with identifier: DP19%20FWW
2026-03-29 22:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4b13d468-b932-5891-9e01-a66081b24d30 with identifier: DP19%20FWW
2026-03-29 22:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4b13d468-b932-5891-9e01-a66081b24d30 with identifier: DP19%20FWW to the API
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DP19%20FWW-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4b13d468-b932-5891-9e01-a66081b24d30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DP19 FWW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DP19%20FWW&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'MOKKA X',
'odometer': 44335,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL MOKKA X 1.4 T 140 ECOTEC DESIGN Hatchback',
'transmission': 'manual',
'trim': 'T 140 ECOTEC DESIGN',
'vin': 'W0VJC7E88KB858722',
'year': 2019}
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP19%2520FWW%27 HTTP/1.1" 200 None
2026-03-29 22:07:53 [bca.uk] INFO: Saving data for DP19%20FWW: {'auction_closing_time': 1774864800.0, 'created_time': 1774706950.781368, 'last_price_update_time': 1774822073.773128}
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DP19%2520FWW') HTTP/1.1" 204 0
2026-03-29 22:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dc9a40ba-b58e-5c29-8228-ff9841f99834 with identifier: PX69%20SXW
2026-03-29 22:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dc9a40ba-b58e-5c29-8228-ff9841f99834 with identifier: PX69%20SXW
2026-03-29 22:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dc9a40ba-b58e-5c29-8228-ff9841f99834 with identifier: PX69%20SXW to the API
2026-03-29 22:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PX69%20SXW-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dc9a40ba-b58e-5c29-8228-ff9841f99834',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PX69 SXW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PX69%20SXW&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 35331,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'KIA PICANTO 1.0 WAVE Hatchback',
'transmission': 'manual',
'trim': 'WAVE',
'vin': 'KNAB3511LKT517517',
'year': 2019}
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX69%2520SXW%27 HTTP/1.1" 200 None
2026-03-29 22:07:54 [bca.uk] INFO: Saving data for PX69%20SXW: {'auction_closing_time': 1774864800.0, 'created_time': 1774438144.854568, 'last_price_update_time': 1774822074.150153}
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PX69%2520SXW') HTTP/1.1" 204 0
2026-03-29 22:07:54 [bca.uk] INFO: Found listing with ID: DV19%20CZY
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV19%2520CZY%27 HTTP/1.1" 200 None
2026-03-29 22:07:54 [bca.uk] INFO: Scrape type for DV19%20CZY: 2
2026-03-29 22:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e6b6ecb-2894-53b5-848f-9379a15b340b with identifier: DV19%20CZY
2026-03-29 22:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e6b6ecb-2894-53b5-848f-9379a15b340b with scrape type 2
2026-03-29 22:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e6b6ecb-2894-53b5-848f-9379a15b340b with scrape type 2
2026-03-29 22:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4e6b6ecb-2894-53b5-848f-9379a15b340b, identifier: DV19%20CZY
2026-03-29 22:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699427769/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE56AOD/42812125?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=jYNw1fNPOU4PCeqA8yT%2FgW%2F2lYqFTt1ML7YNy%2BQkkpE%3D)
2026-03-29 22:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124373/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM09CVU/42809722?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=IVQHrCG530q4ZNE7GeniJ3%2F1vLzKHgZru4jgYYDb%2BSY%3D)
2026-03-29 22:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146901/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR60HNV/42810656?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=iTeyX7WgAxvLftpE%2F2dkTmhR4Qwoz4r3xCUieQTYJOM%3D)
2026-03-29 22:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435152/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ58SFX/42812168?sv=2020-08-04&st=2026-03-29T22%3A06%3A32Z&se=2026-03-29T22%3A31%3A32Z&sr=b&sp=r&sig=qiTgzjDZ%2FB1Y9Jc9LI61o7EdjHjaU8RNz%2BEzvH34f2o%3D)
2026-03-29 22:07:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124369/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124369>
2026-03-29 22:07:54 [bca.uk] INFO: Found listing with ID: DSZ%206849
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DSZ%25206849%27 HTTP/1.1" 200 None
2026-03-29 22:07:54 [bca.uk] INFO: Scrape type for DSZ%206849: 0
2026-03-29 22:07:54 [bca.uk] INFO: Found listing with ID: MF20%20LKN
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF20%2520LKN%27 HTTP/1.1" 200 None
2026-03-29 22:07:54 [bca.uk] INFO: Scrape type for MF20%20LKN: 0
2026-03-29 22:07:54 [bca.uk] INFO: Found listing with ID: OE70%20CVW
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE70%2520CVW%27 HTTP/1.1" 200 None
2026-03-29 22:07:54 [bca.uk] INFO: Scrape type for OE70%20CVW: 0
2026-03-29 22:07:54 [bca.uk] INFO: Found listing with ID: WG22%20UOD
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG22%2520UOD%27 HTTP/1.1" 200 None
2026-03-29 22:07:54 [bca.uk] INFO: Scrape type for WG22%20UOD: 0
2026-03-29 22:07:54 [bca.uk] INFO: Found listing with ID: WV70%20FXU
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV70%2520FXU%27 HTTP/1.1" 200 None
2026-03-29 22:07:54 [bca.uk] INFO: Scrape type for WV70%20FXU: 2
2026-03-29 22:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c91238b-60eb-5c43-b2e1-23b211f67d90 with identifier: WV70%20FXU
2026-03-29 22:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c91238b-60eb-5c43-b2e1-23b211f67d90 with scrape type 2
2026-03-29 22:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c91238b-60eb-5c43-b2e1-23b211f67d90 with scrape type 2
2026-03-29 22:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1c91238b-60eb-5c43-b2e1-23b211f67d90, identifier: WV70%20FXU
2026-03-29 22:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4e6b6ecb-2894-53b5-848f-9379a15b340b with identifier: DV19%20CZY
2026-03-29 22:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4e6b6ecb-2894-53b5-848f-9379a15b340b with identifier: DV19%20CZY
2026-03-29 22:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4e6b6ecb-2894-53b5-848f-9379a15b340b with identifier: DV19%20CZY to the API
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DV19%20CZY-GB',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4e6b6ecb-2894-53b5-848f-9379a15b340b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DV19 CZY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DV19%20CZY&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VOLKSWAGEN',
'model': 'CADDY LIFE',
'odometer': 7299,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN CADDY LIFE 2.0 TDI 102 DSG MPV',
'transmission': 'automatic',
'trim': 'TDI 102 DSG',
'vin': 'WV2ZZZ2KZKX070582',
'year': 2019}
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV19%2520CZY%27 HTTP/1.1" 200 None
2026-03-29 22:07:54 [bca.uk] INFO: Saving data for DV19%20CZY: {'auction_closing_time': 1774864800.0, 'created_time': 1773831795.590718, 'last_price_update_time': 1774822074.912271}
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DV19%2520CZY') HTTP/1.1" 204 0
2026-03-29 22:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619296d0>
2026-03-29 22:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR60HNV%252F699146908%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146908/600 saved to cache
2026-03-29 22:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a63c92f-88a3-5364-8028-ccaa89112c46
2026-03-29 22:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac63615450>
2026-03-29 22:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE56AOD%252F699430178%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430178/600 saved to cache
2026-03-29 22:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5674dd98-879a-5bc0-92a6-049abdc5f932
2026-03-29 22:07:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620bb190>
2026-03-29 22:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ08SVR%252F699430255%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430255/600 saved to cache
2026-03-29 22:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4de1def5-9fea-59aa-8472-dafc14cac3a1
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6151ba50>
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM09CVU%252F699124379%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124379/600 saved to cache
2026-03-29 22:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad76e9a4-0e7d-56af-9a84-3fd65281fde6
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62152010>
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ58SFX%252F699435161%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435161/600 saved to cache
2026-03-29 22:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5063d79c-4147-5ce9-b414-8b0ccabfea0d
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac610f7990>
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP66PGE%252F699139564%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139564/600 saved to cache
2026-03-29 22:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49025c6e-c82c-5ad9-a984-dc586f875105
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616b4210>
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAP12HDL%252F699103853%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103853/600 saved to cache
2026-03-29 22:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21e79e5d-2d1b-56fe-b8fb-2067f25370f7
2026-03-29 22:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430227/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ08SVR/42812103?sv=2020-08-04&st=2026-03-29T22%3A06%3A29Z&se=2026-03-29T22%3A31%3A29Z&sr=b&sp=r&sig=MlBD76Nciq6xfGWS8ogzePQWya6I7akYbscBXB2PpJI%3D)
2026-03-29 22:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139551/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP66PGE/42809943?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=WoZ%2FTTd8%2FUTJlWN%2B%2FNq0hoqMOCTHwgwo3OayCCjYYF0%3D)
2026-03-29 22:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1c91238b-60eb-5c43-b2e1-23b211f67d90 with identifier: WV70%20FXU
2026-03-29 22:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1c91238b-60eb-5c43-b2e1-23b211f67d90 with identifier: WV70%20FXU
2026-03-29 22:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1c91238b-60eb-5c43-b2e1-23b211f67d90 with identifier: WV70%20FXU to the API
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV70%20FXU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': '1c91238b-60eb-5c43-b2e1-23b211f67d90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WV70 FXU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WV70%20FXU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'CORSA-E',
'odometer': 75689,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA-E 100KW 50KWH SE (LAUNCH)(7.4) Hatchback',
'transmission': 'automatic',
'trim': '100KW 50KWH SE (LAUNCH)(7.4)',
'vin': 'VXKUHZKXZL4261217',
'year': 2020}
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV70%2520FXU%27 HTTP/1.1" 200 None
2026-03-29 22:07:55 [bca.uk] INFO: Saving data for WV70%20FXU: {'auction_closing_time': 1774864800.0, 'created_time': 1774735591.633935, 'last_price_update_time': 1774822075.456016}
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WV70%2520FXU') HTTP/1.1" 204 0
2026-03-29 22:07:55 [bca.uk] INFO: Found listing with ID: DV68%20TGN
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV68%2520TGN%27 HTTP/1.1" 200 None
2026-03-29 22:07:55 [bca.uk] INFO: Scrape type for DV68%20TGN: 0
2026-03-29 22:07:55 [bca.uk] INFO: Found listing with ID: EA24%20TKX
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA24%2520TKX%27 HTTP/1.1" 200 None
2026-03-29 22:07:55 [bca.uk] INFO: Scrape type for EA24%20TKX: 0
2026-03-29 22:07:55 [bca.uk] INFO: Found listing with ID: J300%20WTY
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J300%2520WTY%27 HTTP/1.1" 200 None
2026-03-29 22:07:55 [bca.uk] INFO: Scrape type for J300%20WTY: 0
2026-03-29 22:07:55 [bca.uk] INFO: Found listing with ID: MA72%20VWE
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA72%2520VWE%27 HTTP/1.1" 200 None
2026-03-29 22:07:55 [bca.uk] INFO: Scrape type for MA72%20VWE: 0
2026-03-29 22:07:55 [bca.uk] INFO: Found listing with ID: MJ19%20UMV
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ19%2520UMV%27 HTTP/1.1" 200 None
2026-03-29 22:07:55 [bca.uk] INFO: Scrape type for MJ19%20UMV: 0
2026-03-29 22:07:55 [bca.uk] INFO: Found listing with ID: YR64%20UNS
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR64%2520UNS%27 HTTP/1.1" 200 None
2026-03-29 22:07:55 [bca.uk] INFO: Scrape type for YR64%20UNS: 2
2026-03-29 22:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3934dfb8-a543-5520-9689-2c2abcde4923 with identifier: YR64%20UNS
2026-03-29 22:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3934dfb8-a543-5520-9689-2c2abcde4923 with scrape type 2
2026-03-29 22:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3934dfb8-a543-5520-9689-2c2abcde4923 with scrape type 2
2026-03-29 22:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3934dfb8-a543-5520-9689-2c2abcde4923, identifier: YR64%20UNS
2026-03-29 22:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103848/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AP12HDL/42809882?sv=2020-08-04&st=2026-03-29T22%3A06%3A24Z&se=2026-03-29T22%3A31%3A24Z&sr=b&sp=r&sig=DviGem8rLk3txiS7kcWiSVUINF67ojRtTzL1ranpKKA%3D)
2026-03-29 22:07:55 [bca.uk] INFO: Found listing with ID: YS70%20CXD
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS70%2520CXD%27 HTTP/1.1" 200 None
2026-03-29 22:07:55 [bca.uk] INFO: Scrape type for YS70%20CXD: 0
2026-03-29 22:07:55 [bca.uk] INFO: Found listing with ID: GJ71%20WSN
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ71%2520WSN%27 HTTP/1.1" 200 None
2026-03-29 22:07:55 [bca.uk] INFO: Scrape type for GJ71%20WSN: 2
2026-03-29 22:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce69b670-8852-55c2-be68-a54396142524 with identifier: GJ71%20WSN
2026-03-29 22:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce69b670-8852-55c2-be68-a54396142524 with scrape type 2
2026-03-29 22:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce69b670-8852-55c2-be68-a54396142524 with scrape type 2
2026-03-29 22:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ce69b670-8852-55c2-be68-a54396142524, identifier: GJ71%20WSN
2026-03-29 22:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3934dfb8-a543-5520-9689-2c2abcde4923 with identifier: YR64%20UNS
2026-03-29 22:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3934dfb8-a543-5520-9689-2c2abcde4923 with identifier: YR64%20UNS
2026-03-29 22:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3934dfb8-a543-5520-9689-2c2abcde4923 with identifier: YR64%20UNS to the API
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YR64%20UNS-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3934dfb8-a543-5520-9689-2c2abcde4923',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YR64 UNS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YR64%20UNS&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'PORSCHE',
'model': 'CAYENNE',
'odometer': 63660,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PORSCHE CAYENNE 3.0 V6 D 260 TIPTRONIC S Estate',
'transmission': 'manual',
'trim': 'V6 D 260 TIPTRONIC S',
'vin': 'WP1ZZZ92ZFLA31185',
'year': 2014}
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR64%2520UNS%27 HTTP/1.1" 200 None
2026-03-29 22:07:56 [bca.uk] INFO: Saving data for YR64%20UNS: {'auction_closing_time': 1774951200.0, 'created_time': 1774706977.098917, 'last_price_update_time': 1774822076.095362}
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YR64%2520UNS') HTTP/1.1" 204 0
2026-03-29 22:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:07:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430193/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430193>
2026-03-29 22:07:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435148/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435148>
2026-03-29 22:07:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139535>
2026-03-29 22:07:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430157/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430157>
2026-03-29 22:07:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146896/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146896>
2026-03-29 22:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ce69b670-8852-55c2-be68-a54396142524 with identifier: GJ71%20WSN
2026-03-29 22:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ce69b670-8852-55c2-be68-a54396142524 with identifier: GJ71%20WSN
2026-03-29 22:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ce69b670-8852-55c2-be68-a54396142524 with identifier: GJ71%20WSN to the API
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ71%20WSN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ce69b670-8852-55c2-be68-a54396142524',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ71 WSN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ71%20WSN&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'AUDI',
'model': 'Q2',
'odometer': 43879,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'AUDI Q2 1.5 35 TFSI SPORT S-T Hatchback',
'transmission': 'automatic',
'trim': '35 TFSI SPORT S-T',
'vin': 'WAUZZZGA5NA009257',
'year': 2021}
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ71%2520WSN%27 HTTP/1.1" 200 None
2026-03-29 22:07:56 [bca.uk] INFO: Saving data for GJ71%20WSN: {'auction_closing_time': 1774864800.0, 'created_time': 1774735592.400705, 'last_price_update_time': 1774822076.487319}
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ71%2520WSN') HTTP/1.1" 204 0
2026-03-29 22:07:56 [bca.uk] INFO: Found listing with ID: BN15%20PYS
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN15%2520PYS%27 HTTP/1.1" 200 None
2026-03-29 22:07:56 [bca.uk] INFO: Scrape type for BN15%20PYS: 2
2026-03-29 22:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e72fc19-6ef7-5735-a5b3-76a17aaa3159 with identifier: BN15%20PYS
2026-03-29 22:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e72fc19-6ef7-5735-a5b3-76a17aaa3159 with scrape type 2
2026-03-29 22:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e72fc19-6ef7-5735-a5b3-76a17aaa3159 with scrape type 2
2026-03-29 22:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6e72fc19-6ef7-5735-a5b3-76a17aaa3159, identifier: BN15%20PYS
2026-03-29 22:07:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac697ecb10>
2026-03-29 22:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE56AOD%252F699427769%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699427769/600 saved to cache
2026-03-29 22:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5674dd98-879a-5bc0-92a6-049abdc5f932
2026-03-29 22:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6176e590>
2026-03-29 22:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM09CVU%252F699124373%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124373/600 saved to cache
2026-03-29 22:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad76e9a4-0e7d-56af-9a84-3fd65281fde6
2026-03-29 22:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac616def90>
2026-03-29 22:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR60HNV%252F699146901%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146901/600 saved to cache
2026-03-29 22:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a63c92f-88a3-5364-8028-ccaa89112c46
2026-03-29 22:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac60ffc650>
2026-03-29 22:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ58SFX%252F699435152%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435152/600 saved to cache
2026-03-29 22:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5063d79c-4147-5ce9-b414-8b0ccabfea0d
2026-03-29 22:07:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103842/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103842>
2026-03-29 22:07:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124365/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124365>
2026-03-29 22:07:56 [bca.uk] INFO: Found listing with ID: HT70%20DMF
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT70%2520DMF%27 HTTP/1.1" 200 None
2026-03-29 22:07:56 [bca.uk] INFO: Scrape type for HT70%20DMF: 2
2026-03-29 22:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16 with identifier: HT70%20DMF
2026-03-29 22:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16 with scrape type 2
2026-03-29 22:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16 with scrape type 2
2026-03-29 22:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16, identifier: HT70%20DMF
2026-03-29 22:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6e72fc19-6ef7-5735-a5b3-76a17aaa3159 with identifier: BN15%20PYS
2026-03-29 22:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6e72fc19-6ef7-5735-a5b3-76a17aaa3159 with identifier: BN15%20PYS
2026-03-29 22:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6e72fc19-6ef7-5735-a5b3-76a17aaa3159 with identifier: BN15%20PYS to the API
2026-03-29 22:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 199,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BN15%20PYS-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6e72fc19-6ef7-5735-a5b3-76a17aaa3159',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BN15 PYS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BN15%20PYS&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'SSANGYONG',
'model': 'KORANDO',
'odometer': 60389,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'SSANGYONG KORANDO 2.0 175 ELX 4WD StationWagon',
'transmission': 'automatic',
'trim': '175 ELX 4WD',
'vin': 'KPTB0B1SSEP178759',
'year': 2015}
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN15%2520PYS%27 HTTP/1.1" 200 None
2026-03-29 22:07:57 [bca.uk] INFO: Saving data for BN15%20PYS: {'auction_closing_time': 1774864800.0, 'created_time': 1774706979.270703, 'last_price_update_time': 1774822077.130599}
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BN15%2520PYS') HTTP/1.1" 204 0
2026-03-29 22:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16 with identifier: HT70%20DMF
2026-03-29 22:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16 with identifier: HT70%20DMF
2026-03-29 22:07:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 357d0336-8e2f-5d0b-a0f0-a805d9cf3c16 with identifier: HT70%20DMF to the API
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 177,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HT70%20DMF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '357d0336-8e2f-5d0b-a0f0-a805d9cf3c16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HT70 DMF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HT70%20DMF&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MG MOTOR UK',
'model': 'HS',
'odometer': 34482,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'MG MOTOR UK HS 1.5 TGI EXCITE DCT Hatchback',
'transmission': 'automatic',
'trim': 'TGI EXCITE DCT',
'vin': 'SDPA2BBFDLN027624',
'year': 2021}
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT70%2520DMF%27 HTTP/1.1" 200 None
2026-03-29 22:07:57 [bca.uk] INFO: Saving data for HT70%20DMF: {'auction_closing_time': 1774864800.0, 'created_time': 1774735573.696981, 'last_price_update_time': 1774822077.410466}
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HT70%2520DMF') HTTP/1.1" 204 0
2026-03-29 22:07:57 [bca.uk] INFO: Found listing with ID: FE64%20YJN
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE64%2520YJN%27 HTTP/1.1" 200 None
2026-03-29 22:07:57 [bca.uk] INFO: Scrape type for FE64%20YJN: 2
2026-03-29 22:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97eff0e6-5412-5368-b0a5-9cecd68061fb with identifier: FE64%20YJN
2026-03-29 22:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97eff0e6-5412-5368-b0a5-9cecd68061fb with scrape type 2
2026-03-29 22:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97eff0e6-5412-5368-b0a5-9cecd68061fb with scrape type 2
2026-03-29 22:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 97eff0e6-5412-5368-b0a5-9cecd68061fb, identifier: FE64%20YJN
2026-03-29 22:07:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac77450f90>
2026-03-29 22:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ08SVR%252F699430227%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430227/600 saved to cache
2026-03-29 22:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4de1def5-9fea-59aa-8472-dafc14cac3a1
2026-03-29 22:07:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61635790>
2026-03-29 22:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP66PGE%252F699139551%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139551/600 saved to cache
2026-03-29 22:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49025c6e-c82c-5ad9-a984-dc586f875105
2026-03-29 22:07:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:07:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618f7810>
2026-03-29 22:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAP12HDL%252F699103848%252F600') HTTP/1.1" 204 0
2026-03-29 22:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103848/600 saved to cache
2026-03-29 22:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21e79e5d-2d1b-56fe-b8fb-2067f25370f7
2026-03-29 22:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124369/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM09CVU/42809722?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=IVQHrCG530q4ZNE7GeniJ3%2F1vLzKHgZru4jgYYDb%2BSY%3D)
2026-03-29 22:07:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435142/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435142>
2026-03-29 22:07:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430171/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430171>
2026-03-29 22:07:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146888/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146888>
2026-03-29 22:07:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699427731/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427731>
2026-03-29 22:07:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139527/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139527>
2026-03-29 22:07:57 [bca.uk] INFO: Found listing with ID: KM20%20TSZ
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM20%2520TSZ%27 HTTP/1.1" 200 None
2026-03-29 22:07:57 [bca.uk] INFO: Scrape type for KM20%20TSZ: 2
2026-03-29 22:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c73d75d1-bd0a-5743-8d24-444e4cdb7552 with identifier: KM20%20TSZ
2026-03-29 22:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c73d75d1-bd0a-5743-8d24-444e4cdb7552 with scrape type 2
2026-03-29 22:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c73d75d1-bd0a-5743-8d24-444e4cdb7552 with scrape type 2
2026-03-29 22:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c73d75d1-bd0a-5743-8d24-444e4cdb7552, identifier: KM20%20TSZ
2026-03-29 22:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 97eff0e6-5412-5368-b0a5-9cecd68061fb with identifier: FE64%20YJN
2026-03-29 22:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 97eff0e6-5412-5368-b0a5-9cecd68061fb with identifier: FE64%20YJN
2026-03-29 22:07:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 97eff0e6-5412-5368-b0a5-9cecd68061fb with identifier: FE64%20YJN to the API
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE64%20YJN-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '97eff0e6-5412-5368-b0a5-9cecd68061fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FE64 YJN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FE64%20YJN&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'AUDI',
'model': 'Q5',
'odometer': 101485,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'AUDI Q5 2.0 TDI 177 QUATTRO S LINE+ S-T StationWagon',
'transmission': 'automatic',
'trim': 'TDI 177 QUATTRO S LINE+ S-T',
'vin': 'WAUZZZ8R9EA131737',
'year': 2014}
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE64%2520YJN%27 HTTP/1.1" 200 None
2026-03-29 22:07:58 [bca.uk] INFO: Saving data for FE64%20YJN: {'auction_closing_time': 1774864800.0, 'created_time': 1774706986.678722, 'last_price_update_time': 1774822078.075032}
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FE64%2520YJN') HTTP/1.1" 204 0
2026-03-29 22:07:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c73d75d1-bd0a-5743-8d24-444e4cdb7552 with identifier: KM20%20TSZ
2026-03-29 22:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c73d75d1-bd0a-5743-8d24-444e4cdb7552 with identifier: KM20%20TSZ
2026-03-29 22:07:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c73d75d1-bd0a-5743-8d24-444e4cdb7552 with identifier: KM20%20TSZ to the API
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM20%20TSZ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c73d75d1-bd0a-5743-8d24-444e4cdb7552',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM20 TSZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM20%20TSZ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'E220 D',
'odometer': 68391,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ E220 D 2.0 AMG LINE NIGHT ED.PREM.PLUS 9G Saloon',
'transmission': 'manual',
'trim': 'AMG LINE NIGHT ED.PREM.PLUS 9G',
'vin': 'W1K2130042A817018',
'year': 2020}
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM20%2520TSZ%27 HTTP/1.1" 200 None
2026-03-29 22:07:58 [bca.uk] INFO: Saving data for KM20%20TSZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774735575.102501, 'last_price_update_time': 1774822078.357249}
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM20%2520TSZ') HTTP/1.1" 204 0
2026-03-29 22:07:58 [bca.uk] INFO: Found listing with ID: LT03%20BYN
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT03%2520BYN%27 HTTP/1.1" 200 None
2026-03-29 22:07:58 [bca.uk] INFO: Scrape type for LT03%20BYN: 0
2026-03-29 22:07:58 [bca.uk] INFO: Found listing with ID: GM25%20OJK
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM25%2520OJK%27 HTTP/1.1" 200 None
2026-03-29 22:07:58 [bca.uk] INFO: Scrape type for GM25%20OJK: 0
2026-03-29 22:07:58 [bca.uk] INFO: Found listing with ID: KV21%20CPF
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV21%2520CPF%27 HTTP/1.1" 200 None
2026-03-29 22:07:58 [bca.uk] INFO: Scrape type for KV21%20CPF: 0
2026-03-29 22:07:58 [bca.uk] INFO: Found listing with ID: WO68%20DUV
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO68%2520DUV%27 HTTP/1.1" 200 None
2026-03-29 22:07:58 [bca.uk] INFO: Scrape type for WO68%20DUV: 0
2026-03-29 22:07:58 [bca.uk] INFO: Found listing with ID: YF71%20LFZ
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF71%2520LFZ%27 HTTP/1.1" 200 None
2026-03-29 22:07:58 [bca.uk] INFO: Scrape type for YF71%20LFZ: 0
2026-03-29 22:07:58 [bca.uk] INFO: Found listing with ID: AF24%20KLL
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF24%2520KLL%27 HTTP/1.1" 200 None
2026-03-29 22:07:58 [bca.uk] INFO: Scrape type for AF24%20KLL: 0
2026-03-29 22:07:58 [bca.uk] INFO: Found listing with ID: AF69%20BZY
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF69%2520BZY%27 HTTP/1.1" 200 None
2026-03-29 22:07:58 [bca.uk] INFO: Scrape type for AF69%20BZY: 0
2026-03-29 22:07:58 [bca.uk] INFO: Found listing with ID: GW69%20WAW
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GW69%2520WAW%27 HTTP/1.1" 200 None
2026-03-29 22:07:58 [bca.uk] INFO: Scrape type for GW69%20WAW: 2
2026-03-29 22:07:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afad1f26-88af-57eb-94f9-a5b1a59b67b0 with identifier: GW69%20WAW
2026-03-29 22:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afad1f26-88af-57eb-94f9-a5b1a59b67b0 with scrape type 2
2026-03-29 22:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afad1f26-88af-57eb-94f9-a5b1a59b67b0 with scrape type 2
2026-03-29 22:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: afad1f26-88af-57eb-94f9-a5b1a59b67b0, identifier: GW69%20WAW
2026-03-29 22:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146896/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR60HNV/42810656?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=iTeyX7WgAxvLftpE%2F2dkTmhR4Qwoz4r3xCUieQTYJOM%3D)
2026-03-29 22:07:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103837/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103837>
2026-03-29 22:07:58 [bca.uk] INFO: Found listing with ID: LV18%20FLW
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV18%2520FLW%27 HTTP/1.1" 200 None
2026-03-29 22:07:58 [bca.uk] INFO: Scrape type for LV18%20FLW: 2
2026-03-29 22:07:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0f6191-0680-5ec4-9f99-776551675a24 with identifier: LV18%20FLW
2026-03-29 22:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0f6191-0680-5ec4-9f99-776551675a24 with scrape type 2
2026-03-29 22:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b0f6191-0680-5ec4-9f99-776551675a24 with scrape type 2
2026-03-29 22:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3b0f6191-0680-5ec4-9f99-776551675a24, identifier: LV18%20FLW
2026-03-29 22:07:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: afad1f26-88af-57eb-94f9-a5b1a59b67b0 with identifier: GW69%20WAW
2026-03-29 22:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: afad1f26-88af-57eb-94f9-a5b1a59b67b0 with identifier: GW69%20WAW
2026-03-29 22:07:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: afad1f26-88af-57eb-94f9-a5b1a59b67b0 with identifier: GW69%20WAW to the API
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GW69%20WAW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'afad1f26-88af-57eb-94f9-a5b1a59b67b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GW69 WAW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GW69%20WAW&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 22593,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.5 VVT-I Y20 (BI-TONE) Hatchback',
'transmission': 'automatic',
'trim': 'VVT-I Y20 (BI-TONE)',
'vin': 'VNKKG3D320A151885',
'year': 2019}
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GW69%2520WAW%27 HTTP/1.1" 200 None
2026-03-29 22:07:58 [bca.uk] INFO: Saving data for GW69%20WAW: {'auction_closing_time': 1774864800.0, 'created_time': 1774706988.175576, 'last_price_update_time': 1774822078.98274}
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GW69%2520WAW') HTTP/1.1" 204 0
2026-03-29 22:07:59 [bca.uk] INFO: Total items found: 100
2026-03-29 22:07:59 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded
2026-03-29 22:07:59 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:07:59 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP66PGE/42809943?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=WoZ%2FTTd8%2FUTJlWN%2B%2FNq0hoqMOCTHwgwo3OayCCjYYF0%3D)
2026-03-29 22:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435148/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ58SFX/42812168?sv=2020-08-04&st=2026-03-29T22%3A06%3A32Z&se=2026-03-29T22%3A31%3A32Z&sr=b&sp=r&sig=qiTgzjDZ%2FB1Y9Jc9LI61o7EdjHjaU8RNz%2BEzvH34f2o%3D)
2026-03-29 22:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430157/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE56AOD/42812125?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=jYNw1fNPOU4PCeqA8yT%2FgW%2F2lYqFTt1ML7YNy%2BQkkpE%3D)
2026-03-29 22:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430193/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ08SVR/42812103?sv=2020-08-04&st=2026-03-29T22%3A06%3A29Z&se=2026-03-29T22%3A31%3A29Z&sr=b&sp=r&sig=MlBD76Nciq6xfGWS8ogzePQWya6I7akYbscBXB2PpJI%3D)
2026-03-29 22:07:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146881>
2026-03-29 22:07:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124362/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124362>
2026-03-29 22:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3b0f6191-0680-5ec4-9f99-776551675a24 with identifier: LV18%20FLW
2026-03-29 22:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3b0f6191-0680-5ec4-9f99-776551675a24 with identifier: LV18%20FLW
2026-03-29 22:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3b0f6191-0680-5ec4-9f99-776551675a24 with identifier: LV18%20FLW to the API
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV18%20FLW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3b0f6191-0680-5ec4-9f99-776551675a24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LV18 FLW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LV18%20FLW&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'HYUNDAI',
'model': 'I10',
'odometer': 1806,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'HYUNDAI I10 1.0 S Hatchback',
'transmission': 'manual',
'trim': 'S',
'vin': 'NLHA751ALJZ410912',
'year': 2018}
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV18%2520FLW%27 HTTP/1.1" 200 None
2026-03-29 22:07:59 [bca.uk] INFO: Saving data for LV18%20FLW: {'auction_closing_time': 1774864800.0, 'created_time': 1774735576.441274, 'last_price_update_time': 1774822079.405469}
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LV18%2520FLW') HTTP/1.1" 204 0
2026-03-29 22:07:59 [bca.uk] INFO: Found listing with ID: KY22%20VLX
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY22%2520VLX%27 HTTP/1.1" 200 None
2026-03-29 22:07:59 [bca.uk] INFO: Scrape type for KY22%20VLX: 0
2026-03-29 22:07:59 [bca.uk] INFO: Found listing with ID: MT58%20FGX
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT58%2520FGX%27 HTTP/1.1" 200 None
2026-03-29 22:07:59 [bca.uk] INFO: Scrape type for MT58%20FGX: 0
2026-03-29 22:07:59 [bca.uk] INFO: Found listing with ID: NK54%20DDF
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK54%2520DDF%27 HTTP/1.1" 200 None
2026-03-29 22:07:59 [bca.uk] INFO: Scrape type for NK54%20DDF: 0
2026-03-29 22:07:59 [bca.uk] INFO: Found listing with ID: BU69%20FKW
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU69%2520FKW%27 HTTP/1.1" 200 None
2026-03-29 22:07:59 [bca.uk] INFO: Scrape type for BU69%20FKW: 0
2026-03-29 22:07:59 [bca.uk] INFO: Found listing with ID: PK74%20YSW
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK74%2520YSW%27 HTTP/1.1" 200 None
2026-03-29 22:07:59 [bca.uk] INFO: Scrape type for PK74%20YSW: 0
2026-03-29 22:07:59 [bca.uk] INFO: Found listing with ID: DA21%20SOU
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA21%2520SOU%27 HTTP/1.1" 200 None
2026-03-29 22:07:59 [bca.uk] INFO: Scrape type for DA21%20SOU: 2
2026-03-29 22:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1534762c-5952-5a28-84f7-7b27016558ac with identifier: DA21%20SOU
2026-03-29 22:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1534762c-5952-5a28-84f7-7b27016558ac with scrape type 2
2026-03-29 22:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1534762c-5952-5a28-84f7-7b27016558ac with scrape type 2
2026-03-29 22:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1534762c-5952-5a28-84f7-7b27016558ac, identifier: DA21%20SOU
2026-03-29 22:07:59 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:07:59 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:07:59 [bca.uk] INFO: Found listing with ID: AV20%20JJK
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV20%2520JJK%27 HTTP/1.1" 200 None
2026-03-29 22:07:59 [bca.uk] INFO: Scrape type for AV20%20JJK: 0
2026-03-29 22:07:59 [bca.uk] INFO: Found listing with ID: GJ20%20UMA
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ20%2520UMA%27 HTTP/1.1" 200 None
2026-03-29 22:07:59 [bca.uk] INFO: Scrape type for GJ20%20UMA: 2
2026-03-29 22:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 182b028b-defa-51b3-b97c-bb87ff17eb7b with identifier: GJ20%20UMA
2026-03-29 22:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 182b028b-defa-51b3-b97c-bb87ff17eb7b with scrape type 2
2026-03-29 22:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 182b028b-defa-51b3-b97c-bb87ff17eb7b with scrape type 2
2026-03-29 22:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 182b028b-defa-51b3-b97c-bb87ff17eb7b, identifier: GJ20%20UMA
2026-03-29 22:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1534762c-5952-5a28-84f7-7b27016558ac with identifier: DA21%20SOU
2026-03-29 22:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1534762c-5952-5a28-84f7-7b27016558ac with identifier: DA21%20SOU
2026-03-29 22:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1534762c-5952-5a28-84f7-7b27016558ac with identifier: DA21%20SOU to the API
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:07:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 224,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA21%20SOU-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1534762c-5952-5a28-84f7-7b27016558ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DA21 SOU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DA21%20SOU&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 57698,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 D300 HSE StationWagon',
'transmission': 'automatic',
'trim': 'D300 HSE',
'vin': 'SALWA2AW7MA787074',
'year': 2021}
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA21%2520SOU%27 HTTP/1.1" 200 None
2026-03-29 22:08:00 [bca.uk] INFO: Saving data for DA21%20SOU: {'auction_closing_time': 1774951200.0, 'created_time': 1774706919.375142, 'last_price_update_time': 1774822080.032003}
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DA21%2520SOU') HTTP/1.1" 204 0
2026-03-29 22:08:00 [bca.uk] INFO: Found listing with ID: NK68%20VWG
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK68%2520VWG%27 HTTP/1.1" 200 None
2026-03-29 22:08:00 [bca.uk] INFO: Scrape type for NK68%20VWG: 2
2026-03-29 22:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc8ec235-4132-5a4d-bc94-42a782cbe495 with identifier: NK68%20VWG
2026-03-29 22:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc8ec235-4132-5a4d-bc94-42a782cbe495 with scrape type 2
2026-03-29 22:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc8ec235-4132-5a4d-bc94-42a782cbe495 with scrape type 2
2026-03-29 22:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cc8ec235-4132-5a4d-bc94-42a782cbe495, identifier: NK68%20VWG
2026-03-29 22:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61636b50>
2026-03-29 22:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM09CVU%252F699124369%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124369/600 saved to cache
2026-03-29 22:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad76e9a4-0e7d-56af-9a84-3fd65281fde6
2026-03-29 22:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124365/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM09CVU/42809722?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=IVQHrCG530q4ZNE7GeniJ3%2F1vLzKHgZru4jgYYDb%2BSY%3D)
2026-03-29 22:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 182b028b-defa-51b3-b97c-bb87ff17eb7b with identifier: GJ20%20UMA
2026-03-29 22:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 182b028b-defa-51b3-b97c-bb87ff17eb7b with identifier: GJ20%20UMA
2026-03-29 22:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 182b028b-defa-51b3-b97c-bb87ff17eb7b with identifier: GJ20%20UMA to the API
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 85,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ20%20UMA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '182b028b-defa-51b3-b97c-bb87ff17eb7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ20 UMA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ20%20UMA&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'CITROEN',
'model': 'C1',
'odometer': 36374,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'CITROEN C1 1.0 VTI 72 FLAIR Hatchback',
'transmission': 'manual',
'trim': 'VTI 72 FLAIR',
'vin': 'VF7PSCFB7KR537644',
'year': 2020}
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ20%2520UMA%27 HTTP/1.1" 200 None
2026-03-29 22:08:00 [bca.uk] INFO: Saving data for GJ20%20UMA: {'auction_closing_time': 1774864800.0, 'created_time': 1774735561.565668, 'last_price_update_time': 1774822080.483905}
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ20%2520UMA') HTTP/1.1" 204 0
2026-03-29 22:08:00 [bca.uk] INFO: Found listing with ID: FL20%20XHA
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL20%2520XHA%27 HTTP/1.1" 200 None
2026-03-29 22:08:00 [bca.uk] INFO: Scrape type for FL20%20XHA: 0
2026-03-29 22:08:00 [bca.uk] INFO: Found listing with ID: NV69%20KPO
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV69%2520KPO%27 HTTP/1.1" 200 None
2026-03-29 22:08:00 [bca.uk] INFO: Scrape type for NV69%20KPO: 2
2026-03-29 22:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99802e3c-a379-5f96-bb92-0766f2a540f5 with identifier: NV69%20KPO
2026-03-29 22:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99802e3c-a379-5f96-bb92-0766f2a540f5 with scrape type 2
2026-03-29 22:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99802e3c-a379-5f96-bb92-0766f2a540f5 with scrape type 2
2026-03-29 22:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 99802e3c-a379-5f96-bb92-0766f2a540f5, identifier: NV69%20KPO
2026-03-29 22:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cc8ec235-4132-5a4d-bc94-42a782cbe495 with identifier: NK68%20VWG
2026-03-29 22:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cc8ec235-4132-5a4d-bc94-42a782cbe495 with identifier: NK68%20VWG
2026-03-29 22:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cc8ec235-4132-5a4d-bc94-42a782cbe495 with identifier: NK68%20VWG to the API
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NK68%20VWG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cc8ec235-4132-5a4d-bc94-42a782cbe495',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NK68 VWG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NK68%20VWG&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'FIAT',
'model': '500X',
'odometer': 69144,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FIAT 500X 1.0 M/AIR CITY CROSS Hatchback',
'transmission': 'manual',
'trim': 'M/AIR CITY CROSS',
'vin': 'ZFA3340000P732201',
'year': 2018}
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK68%2520VWG%27 HTTP/1.1" 200 None
2026-03-29 22:08:00 [bca.uk] INFO: Saving data for NK68%20VWG: {'auction_closing_time': 1774864800.0, 'created_time': 1774438081.82728, 'last_price_update_time': 1774822080.892167}
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NK68%2520VWG') HTTP/1.1" 204 0
2026-03-29 22:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103842/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AP12HDL/42809882?sv=2020-08-04&st=2026-03-29T22%3A06%3A24Z&se=2026-03-29T22%3A31%3A24Z&sr=b&sp=r&sig=DviGem8rLk3txiS7kcWiSVUINF67ojRtTzL1ranpKKA%3D)
2026-03-29 22:08:01 [bca.uk] INFO: Found listing with ID: V800%20ARR
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V800%2520ARR%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Scrape type for V800%20ARR: 0
2026-03-29 22:08:01 [bca.uk] INFO: Found listing with ID: BV19%20UHK
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV19%2520UHK%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Scrape type for BV19%20UHK: 2
2026-03-29 22:08:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1a66a79-c853-5081-90ec-1947830cb5c2 with identifier: BV19%20UHK
2026-03-29 22:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a66a79-c853-5081-90ec-1947830cb5c2 with scrape type 2
2026-03-29 22:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1a66a79-c853-5081-90ec-1947830cb5c2 with scrape type 2
2026-03-29 22:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e1a66a79-c853-5081-90ec-1947830cb5c2, identifier: BV19%20UHK
2026-03-29 22:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 99802e3c-a379-5f96-bb92-0766f2a540f5 with identifier: NV69%20KPO
2026-03-29 22:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 99802e3c-a379-5f96-bb92-0766f2a540f5 with identifier: NV69%20KPO
2026-03-29 22:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 99802e3c-a379-5f96-bb92-0766f2a540f5 with identifier: NV69%20KPO to the API
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NV69%20KPO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '99802e3c-a379-5f96-bb92-0766f2a540f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NV69 KPO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NV69%20KPO&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 32342,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 125 ST-LINE Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 ST-LINE',
'vin': 'WF0JXXGAHJKJ70394',
'year': 2020}
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV69%2520KPO%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Saving data for NV69%20KPO: {'auction_closing_time': 1774864800.0, 'created_time': 1774438144.426484, 'last_price_update_time': 1774822081.421496}
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NV69%2520KPO') HTTP/1.1" 204 0
2026-03-29 22:08:01 [bca.uk] INFO: Found listing with ID: OE74%20XKB
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE74%2520XKB%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Scrape type for OE74%20XKB: 0
2026-03-29 22:08:01 [bca.uk] INFO: Found listing with ID: NA69%20WCT
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA69%2520WCT%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Scrape type for NA69%20WCT: 0
2026-03-29 22:08:01 [bca.uk] INFO: Found listing with ID: ND70%20LZE
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND70%2520LZE%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Scrape type for ND70%20LZE: 0
2026-03-29 22:08:01 [bca.uk] INFO: Found listing with ID: BL16%20UUB
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL16%2520UUB%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Scrape type for BL16%20UUB: 0
2026-03-29 22:08:01 [bca.uk] INFO: Found listing with ID: FL59%20VTF
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL59%2520VTF%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Scrape type for FL59%20VTF: 0
2026-03-29 22:08:01 [bca.uk] INFO: Found listing with ID: YC72%20AVN
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC72%2520AVN%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Scrape type for YC72%20AVN: 0
2026-03-29 22:08:01 [bca.uk] INFO: Found listing with ID: FJ68%20ULM
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ68%2520ULM%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Scrape type for FJ68%20ULM: 0
2026-03-29 22:08:01 [bca.uk] INFO: Found listing with ID: FJ70%20HFF
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ70%2520HFF%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Scrape type for FJ70%20HFF: 0
2026-03-29 22:08:01 [bca.uk] INFO: Found listing with ID: AF71%20XUK
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF71%2520XUK%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Scrape type for AF71%20XUK: 0
2026-03-29 22:08:01 [bca.uk] INFO: Found listing with ID: BG72%20UUY
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG72%2520UUY%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Scrape type for BG72%20UUY: 0
2026-03-29 22:08:01 [bca.uk] INFO: Found listing with ID: FG69%20CVL
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG69%2520CVL%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Scrape type for FG69%20CVL: 0
2026-03-29 22:08:01 [bca.uk] INFO: Found listing with ID: KM69%20NXO
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM69%2520NXO%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Scrape type for KM69%20NXO: 0
2026-03-29 22:08:01 [bca.uk] INFO: Found listing with ID: KY19%20EBR
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY19%2520EBR%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Scrape type for KY19%20EBR: 0
2026-03-29 22:08:01 [bca.uk] INFO: Found listing with ID: SK20%20URM
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK20%2520URM%27 HTTP/1.1" 200 None
2026-03-29 22:08:01 [bca.uk] INFO: Scrape type for SK20%20URM: 2
2026-03-29 22:08:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51acc21e-4028-5475-8adc-1c02c0dad366 with identifier: SK20%20URM
2026-03-29 22:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51acc21e-4028-5475-8adc-1c02c0dad366 with scrape type 2
2026-03-29 22:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51acc21e-4028-5475-8adc-1c02c0dad366 with scrape type 2
2026-03-29 22:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 51acc21e-4028-5475-8adc-1c02c0dad366, identifier: SK20%20URM
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6102f350>
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR60HNV%252F699146896%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146896/600 saved to cache
2026-03-29 22:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a63c92f-88a3-5364-8028-ccaa89112c46
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6106cf50>
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP66PGE%252F699139535%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139535/600 saved to cache
2026-03-29 22:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49025c6e-c82c-5ad9-a984-dc586f875105
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61726850>
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ58SFX%252F699435148%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435148/600 saved to cache
2026-03-29 22:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5063d79c-4147-5ce9-b414-8b0ccabfea0d
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6191b710>
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE56AOD%252F699430157%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430157/600 saved to cache
2026-03-29 22:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5674dd98-879a-5bc0-92a6-049abdc5f932
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618eefd0>
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ08SVR%252F699430193%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430193/600 saved to cache
2026-03-29 22:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4de1def5-9fea-59aa-8472-dafc14cac3a1
2026-03-29 22:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435142/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ58SFX/42812168?sv=2020-08-04&st=2026-03-29T22%3A06%3A32Z&se=2026-03-29T22%3A31%3A32Z&sr=b&sp=r&sig=qiTgzjDZ%2FB1Y9Jc9LI61o7EdjHjaU8RNz%2BEzvH34f2o%3D)
2026-03-29 22:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430171/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ08SVR/42812103?sv=2020-08-04&st=2026-03-29T22%3A06%3A29Z&se=2026-03-29T22%3A31%3A29Z&sr=b&sp=r&sig=MlBD76Nciq6xfGWS8ogzePQWya6I7akYbscBXB2PpJI%3D)
2026-03-29 22:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699427731/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE56AOD/42812125?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=jYNw1fNPOU4PCeqA8yT%2FgW%2F2lYqFTt1ML7YNy%2BQkkpE%3D)
2026-03-29 22:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139527/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP66PGE/42809943?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=WoZ%2FTTd8%2FUTJlWN%2B%2FNq0hoqMOCTHwgwo3OayCCjYYF0%3D)
2026-03-29 22:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146888/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR60HNV/42810656?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=iTeyX7WgAxvLftpE%2F2dkTmhR4Qwoz4r3xCUieQTYJOM%3D)
2026-03-29 22:08:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435134/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435134>
2026-03-29 22:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e1a66a79-c853-5081-90ec-1947830cb5c2 with identifier: BV19%20UHK
2026-03-29 22:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e1a66a79-c853-5081-90ec-1947830cb5c2 with identifier: BV19%20UHK
2026-03-29 22:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e1a66a79-c853-5081-90ec-1947830cb5c2 with identifier: BV19%20UHK to the API
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV19%20UHK-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e1a66a79-c853-5081-90ec-1947830cb5c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BV19 UHK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BV19%20UHK&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'AUDI',
'model': 'A6',
'odometer': 35544,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'AUDI A6 2.0 40 TDI S LINE S-T Saloon',
'transmission': 'automatic',
'trim': '40 TDI S LINE S-T',
'vin': 'WAUZZZF2XKN077066',
'year': 2019}
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV19%2520UHK%27 HTTP/1.1" 200 None
2026-03-29 22:08:02 [bca.uk] INFO: Saving data for BV19%20UHK: {'auction_closing_time': 1774864800.0, 'created_time': 1774438096.584433, 'last_price_update_time': 1774822082.478708}
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BV19%2520UHK') HTTP/1.1" 204 0
2026-03-29 22:08:02 [bca.uk] INFO: Found listing with ID: PY71%20HPP
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY71%2520HPP%27 HTTP/1.1" 200 None
2026-03-29 22:08:02 [bca.uk] INFO: Scrape type for PY71%20HPP: 0
2026-03-29 22:08:02 [bca.uk] INFO: Found listing with ID: YL69%20MMV
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL69%2520MMV%27 HTTP/1.1" 200 None
2026-03-29 22:08:02 [bca.uk] INFO: Scrape type for YL69%20MMV: 0
2026-03-29 22:08:02 [bca.uk] INFO: Found listing with ID: FG22%20EFZ
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG22%2520EFZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:02 [bca.uk] INFO: Scrape type for FG22%20EFZ: 0
2026-03-29 22:08:02 [bca.uk] INFO: Found listing with ID: DG65%20GXU
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG65%2520GXU%27 HTTP/1.1" 200 None
2026-03-29 22:08:02 [bca.uk] INFO: Scrape type for DG65%20GXU: 0
2026-03-29 22:08:02 [bca.uk] INFO: Found listing with ID: SD18%20YWW
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD18%2520YWW%27 HTTP/1.1" 200 None
2026-03-29 22:08:02 [bca.uk] INFO: Scrape type for SD18%20YWW: 0
2026-03-29 22:08:02 [bca.uk] INFO: Found listing with ID: PJ59%20WXK
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ59%2520WXK%27 HTTP/1.1" 200 None
2026-03-29 22:08:02 [bca.uk] INFO: Scrape type for PJ59%20WXK: 0
2026-03-29 22:08:02 [bca.uk] INFO: Found listing with ID: KU69%20HXY
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU69%2520HXY%27 HTTP/1.1" 200 None
2026-03-29 22:08:02 [bca.uk] INFO: Scrape type for KU69%20HXY: 0
2026-03-29 22:08:02 [bca.uk] INFO: Found listing with ID: ST11%20LWD
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST11%2520LWD%27 HTTP/1.1" 200 None
2026-03-29 22:08:02 [bca.uk] INFO: Scrape type for ST11%20LWD: 0
2026-03-29 22:08:02 [bca.uk] INFO: Found listing with ID: BV09%20OZT
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV09%2520OZT%27 HTTP/1.1" 200 None
2026-03-29 22:08:02 [bca.uk] INFO: Scrape type for BV09%20OZT: 0
2026-03-29 22:08:02 [bca.uk] INFO: Found listing with ID: MJ03%20HOW
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ03%2520HOW%27 HTTP/1.1" 200 None
2026-03-29 22:08:02 [bca.uk] INFO: Scrape type for MJ03%20HOW: 2
2026-03-29 22:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b75153fa-8bbc-5e83-87eb-81edd908fcda with identifier: MJ03%20HOW
2026-03-29 22:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75153fa-8bbc-5e83-87eb-81edd908fcda with scrape type 2
2026-03-29 22:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b75153fa-8bbc-5e83-87eb-81edd908fcda with scrape type 2
2026-03-29 22:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b75153fa-8bbc-5e83-87eb-81edd908fcda, identifier: MJ03%20HOW
2026-03-29 22:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 51acc21e-4028-5475-8adc-1c02c0dad366 with identifier: SK20%20URM
2026-03-29 22:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 51acc21e-4028-5475-8adc-1c02c0dad366 with identifier: SK20%20URM
2026-03-29 22:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 51acc21e-4028-5475-8adc-1c02c0dad366 with identifier: SK20%20URM to the API
2026-03-29 22:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SK20%20URM-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '51acc21e-4028-5475-8adc-1c02c0dad366',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SK20 URM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SK20%20URM&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 71448,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'HYUNDAI TUCSON 1.6 CRDI 115 2WD PREMIUM SE StationWagon',
'transmission': 'manual',
'trim': 'CRDI 115 2WD PREMIUM SE',
'vin': 'TMAJ3817LLJ925092',
'year': 2020}
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK20%2520URM%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Saving data for SK20%20URM: {'auction_closing_time': 1774864800.0, 'created_time': 1774438054.498122, 'last_price_update_time': 1774822083.178242}
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SK20%2520URM') HTTP/1.1" 204 0
2026-03-29 22:08:03 [bca.uk] INFO: Found listing with ID: DY68%20UWN
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY68%2520UWN%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Scrape type for DY68%20UWN: 0
2026-03-29 22:08:03 [bca.uk] INFO: Found listing with ID: FL71%20EGE
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL71%2520EGE%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Scrape type for FL71%20EGE: 2
2026-03-29 22:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31b35f19-803b-5916-9d73-8fe099e2d84a with identifier: FL71%20EGE
2026-03-29 22:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31b35f19-803b-5916-9d73-8fe099e2d84a with scrape type 2
2026-03-29 22:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31b35f19-803b-5916-9d73-8fe099e2d84a with scrape type 2
2026-03-29 22:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 31b35f19-803b-5916-9d73-8fe099e2d84a, identifier: FL71%20EGE
2026-03-29 22:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b75153fa-8bbc-5e83-87eb-81edd908fcda with identifier: MJ03%20HOW
2026-03-29 22:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b75153fa-8bbc-5e83-87eb-81edd908fcda with identifier: MJ03%20HOW
2026-03-29 22:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b75153fa-8bbc-5e83-87eb-81edd908fcda with identifier: MJ03%20HOW to the API
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 270,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ03%20HOW-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b75153fa-8bbc-5e83-87eb-81edd908fcda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ03 HOW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ03%20HOW&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'JEEP',
'model': 'GRAND CHEROKEE',
'odometer': 92857,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'JEEP GRAND CHEROKEE 3.0 CRD OVERLAND StationWagon',
'transmission': 'automatic',
'trim': 'CRD OVERLAND',
'vin': '1J8HDE8M08Y127333',
'year': 2009}
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ03%2520HOW%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Saving data for MJ03%20HOW: {'auction_closing_time': 1774864800.0, 'created_time': 1774706945.297792, 'last_price_update_time': 1774822083.582211}
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ03%2520HOW') HTTP/1.1" 204 0
2026-03-29 22:08:03 [bca.uk] INFO: Found listing with ID: SE16%20KBX
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE16%2520KBX%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Scrape type for SE16%20KBX: 0
2026-03-29 22:08:03 [bca.uk] INFO: Found listing with ID: PN64%20UHS
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN64%2520UHS%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Scrape type for PN64%20UHS: 0
2026-03-29 22:08:03 [bca.uk] INFO: Found listing with ID: FV20%20CSZ
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV20%2520CSZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Scrape type for FV20%20CSZ: 0
2026-03-29 22:08:03 [bca.uk] INFO: Found listing with ID: HK18%20KTD
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK18%2520KTD%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Scrape type for HK18%20KTD: 0
2026-03-29 22:08:03 [bca.uk] INFO: Found listing with ID: JG15%20TAN
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JG15%2520TAN%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Scrape type for JG15%20TAN: 0
2026-03-29 22:08:03 [bca.uk] INFO: Found listing with ID: VO69%20FZU
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO69%2520FZU%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Scrape type for VO69%20FZU: 0
2026-03-29 22:08:03 [bca.uk] INFO: Found listing with ID: YX22%20KOA
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX22%2520KOA%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Scrape type for YX22%20KOA: 0
2026-03-29 22:08:03 [bca.uk] INFO: Found listing with ID: YY22%20BDE
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY22%2520BDE%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Scrape type for YY22%20BDE: 0
2026-03-29 22:08:03 [bca.uk] INFO: Found listing with ID: YY70%20LWT
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY70%2520LWT%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Scrape type for YY70%20LWT: 0
2026-03-29 22:08:03 [bca.uk] INFO: Found listing with ID: YY74%20VXV
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY74%2520VXV%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Scrape type for YY74%20VXV: 0
2026-03-29 22:08:03 [bca.uk] INFO: Found listing with ID: AD19%20LDZ
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD19%2520LDZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Scrape type for AD19%20LDZ: 0
2026-03-29 22:08:03 [bca.uk] INFO: Found listing with ID: RF21%20EBD
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF21%2520EBD%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Scrape type for RF21%20EBD: 0
2026-03-29 22:08:03 [bca.uk] INFO: Found listing with ID: WO21%20TKX
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO21%2520TKX%27 HTTP/1.1" 200 None
2026-03-29 22:08:03 [bca.uk] INFO: Scrape type for WO21%20TKX: 2
2026-03-29 22:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3e8645c-1c02-51d2-9715-52a8be0f5234 with identifier: WO21%20TKX
2026-03-29 22:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3e8645c-1c02-51d2-9715-52a8be0f5234 with scrape type 2
2026-03-29 22:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3e8645c-1c02-51d2-9715-52a8be0f5234 with scrape type 2
2026-03-29 22:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b3e8645c-1c02-51d2-9715-52a8be0f5234, identifier: WO21%20TKX
2026-03-29 22:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103837/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AP12HDL/42809882?sv=2020-08-04&st=2026-03-29T22%3A06%3A24Z&se=2026-03-29T22%3A31%3A24Z&sr=b&sp=r&sig=DviGem8rLk3txiS7kcWiSVUINF67ojRtTzL1ranpKKA%3D)
2026-03-29 22:08:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430136/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430136>
2026-03-29 22:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 31b35f19-803b-5916-9d73-8fe099e2d84a with identifier: FL71%20EGE
2026-03-29 22:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 31b35f19-803b-5916-9d73-8fe099e2d84a with identifier: FL71%20EGE
2026-03-29 22:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 31b35f19-803b-5916-9d73-8fe099e2d84a with identifier: FL71%20EGE to the API
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL71%20EGE-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '31b35f19-803b-5916-9d73-8fe099e2d84a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL71 EGE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL71%20EGE&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'BMW',
'model': '118I',
'odometer': 36588,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'BMW 118I 1.5 136 M SPORT STEP Hatchback',
'transmission': 'automatic',
'trim': '136 M SPORT STEP',
'vin': 'WBA7K320507K03462',
'year': 2021}
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL71%2520EGE%27 HTTP/1.1" 200 None
2026-03-29 22:08:04 [bca.uk] INFO: Saving data for FL71%20EGE: {'auction_closing_time': 1774864800.0, 'created_time': 1774735553.119493, 'last_price_update_time': 1774822084.375212}
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL71%2520EGE') HTTP/1.1" 204 0
2026-03-29 22:08:04 [bca.uk] INFO: Found listing with ID: FL69%20JZP
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL69%2520JZP%27 HTTP/1.1" 200 None
2026-03-29 22:08:04 [bca.uk] INFO: Scrape type for FL69%20JZP: 2
2026-03-29 22:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a5bffef-b353-54bb-b673-ece7012c4726 with identifier: FL69%20JZP
2026-03-29 22:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a5bffef-b353-54bb-b673-ece7012c4726 with scrape type 2
2026-03-29 22:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a5bffef-b353-54bb-b673-ece7012c4726 with scrape type 2
2026-03-29 22:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1a5bffef-b353-54bb-b673-ece7012c4726, identifier: FL69%20JZP
2026-03-29 22:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b3e8645c-1c02-51d2-9715-52a8be0f5234 with identifier: WO21%20TKX
2026-03-29 22:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b3e8645c-1c02-51d2-9715-52a8be0f5234 with identifier: WO21%20TKX
2026-03-29 22:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b3e8645c-1c02-51d2-9715-52a8be0f5234 with identifier: WO21%20TKX to the API
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 116,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WO21%20TKX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b3e8645c-1c02-51d2-9715-52a8be0f5234',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WO21 TKX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WO21%20TKX&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'FIAT',
'model': '500',
'odometer': 56263,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'FIAT 500 1.0 M/H ROCK STAR Hatchback',
'transmission': 'manual',
'trim': 'M/H ROCK STAR',
'vin': 'ZFA3120000JE98088',
'year': 2021}
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO21%2520TKX%27 HTTP/1.1" 200 None
2026-03-29 22:08:04 [bca.uk] INFO: Saving data for WO21%20TKX: {'auction_closing_time': 1774864800.0, 'created_time': 1774438098.539868, 'last_price_update_time': 1774822084.878006}
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WO21%2520TKX') HTTP/1.1" 204 0
2026-03-29 22:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6156c4d0>
2026-03-29 22:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM09CVU%252F699124365%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124365/600 saved to cache
2026-03-29 22:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad76e9a4-0e7d-56af-9a84-3fd65281fde6
2026-03-29 22:08:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:08:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:08:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:08:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:08:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6118a410>
2026-03-29 22:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAP12HDL%252F699103842%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103842/600 saved to cache
2026-03-29 22:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21e79e5d-2d1b-56fe-b8fb-2067f25370f7
2026-03-29 22:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124362/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM09CVU/42809722?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=IVQHrCG530q4ZNE7GeniJ3%2F1vLzKHgZru4jgYYDb%2BSY%3D)
2026-03-29 22:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146881/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR60HNV/42810656?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=iTeyX7WgAxvLftpE%2F2dkTmhR4Qwoz4r3xCUieQTYJOM%3D)
2026-03-29 22:08:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124359/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699124359>
2026-03-29 22:08:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103834/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103834>
2026-03-29 22:08:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430122/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430122>
2026-03-29 22:08:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139522/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139522>
2026-03-29 22:08:04 [bca.uk] INFO: Found listing with ID: ND70%20FWR
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND70%2520FWR%27 HTTP/1.1" 200 None
2026-03-29 22:08:04 [bca.uk] INFO: Scrape type for ND70%20FWR: 0
2026-03-29 22:08:04 [bca.uk] INFO: Found listing with ID: MJ69%20NDN
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ69%2520NDN%27 HTTP/1.1" 200 None
2026-03-29 22:08:05 [bca.uk] INFO: Scrape type for MJ69%20NDN: 0
2026-03-29 22:08:05 [bca.uk] INFO: Found listing with ID: KJ19%20OPY
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520OPY%27 HTTP/1.1" 200 None
2026-03-29 22:08:05 [bca.uk] INFO: Scrape type for KJ19%20OPY: 0
2026-03-29 22:08:05 [bca.uk] INFO: Found listing with ID: RE68%20BSO
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE68%2520BSO%27 HTTP/1.1" 200 None
2026-03-29 22:08:05 [bca.uk] INFO: Scrape type for RE68%20BSO: 0
2026-03-29 22:08:05 [bca.uk] INFO: Found listing with ID: DV70%20UAG
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV70%2520UAG%27 HTTP/1.1" 200 None
2026-03-29 22:08:05 [bca.uk] INFO: Scrape type for DV70%20UAG: 0
2026-03-29 22:08:05 [bca.uk] INFO: Found listing with ID: FL21%20VOF
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL21%2520VOF%27 HTTP/1.1" 200 None
2026-03-29 22:08:05 [bca.uk] INFO: Scrape type for FL21%20VOF: 0
2026-03-29 22:08:05 [bca.uk] INFO: Found listing with ID: PF68%20PYB
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF68%2520PYB%27 HTTP/1.1" 200 None
2026-03-29 22:08:05 [bca.uk] INFO: Scrape type for PF68%20PYB: 2
2026-03-29 22:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1941c029-e601-57db-8da4-77ae3b1b387e with identifier: PF68%20PYB
2026-03-29 22:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1941c029-e601-57db-8da4-77ae3b1b387e with scrape type 2
2026-03-29 22:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1941c029-e601-57db-8da4-77ae3b1b387e with scrape type 2
2026-03-29 22:08:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1941c029-e601-57db-8da4-77ae3b1b387e, identifier: PF68%20PYB
2026-03-29 22:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1a5bffef-b353-54bb-b673-ece7012c4726 with identifier: FL69%20JZP
2026-03-29 22:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1a5bffef-b353-54bb-b673-ece7012c4726 with identifier: FL69%20JZP
2026-03-29 22:08:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1a5bffef-b353-54bb-b673-ece7012c4726 with identifier: FL69%20JZP to the API
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL69%20JZP-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': '1a5bffef-b353-54bb-b673-ece7012c4726',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL69 JZP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL69%20JZP&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 78845,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF E-GOLF Hatchback',
'transmission': 'automatic',
'trim': 'E-GOLF',
'vin': 'WVWZZZAUZKW916263',
'year': 2019}
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL69%2520JZP%27 HTTP/1.1" 200 None
2026-03-29 22:08:05 [bca.uk] INFO: Saving data for FL69%20JZP: {'auction_closing_time': 1774864800.0, 'created_time': 1774706985.724546, 'last_price_update_time': 1774822085.459723}
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL69%2520JZP') HTTP/1.1" 204 0
2026-03-29 22:08:05 [bca.uk] INFO: Found listing with ID: KN15%20HKZ
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN15%2520HKZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:05 [bca.uk] INFO: Scrape type for KN15%20HKZ: 0
2026-03-29 22:08:05 [bca.uk] INFO: Found listing with ID: LM11%20RXV
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM11%2520RXV%27 HTTP/1.1" 200 None
2026-03-29 22:08:05 [bca.uk] INFO: Scrape type for LM11%20RXV: 0
2026-03-29 22:08:05 [bca.uk] INFO: Found listing with ID: VK20%20NNO
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK20%2520NNO%27 HTTP/1.1" 200 None
2026-03-29 22:08:05 [bca.uk] INFO: Scrape type for VK20%20NNO: 0
2026-03-29 22:08:05 [bca.uk] INFO: Found listing with ID: PE68%20ZNM
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE68%2520ZNM%27 HTTP/1.1" 200 None
2026-03-29 22:08:05 [bca.uk] INFO: Scrape type for PE68%20ZNM: 0
2026-03-29 22:08:05 [bca.uk] INFO: Found listing with ID: SB72%20GWA
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB72%2520GWA%27 HTTP/1.1" 200 None
2026-03-29 22:08:05 [bca.uk] INFO: Scrape type for SB72%20GWA: 0
2026-03-29 22:08:05 [bca.uk] INFO: Found listing with ID: SJ22%20EHM
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ22%2520EHM%27 HTTP/1.1" 200 None
2026-03-29 22:08:05 [bca.uk] INFO: Scrape type for SJ22%20EHM: 2
2026-03-29 22:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc10834f-41df-5685-8f4e-07d2c9215704 with identifier: SJ22%20EHM
2026-03-29 22:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc10834f-41df-5685-8f4e-07d2c9215704 with scrape type 2
2026-03-29 22:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc10834f-41df-5685-8f4e-07d2c9215704 with scrape type 2
2026-03-29 22:08:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dc10834f-41df-5685-8f4e-07d2c9215704, identifier: SJ22%20EHM
2026-03-29 22:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1941c029-e601-57db-8da4-77ae3b1b387e with identifier: PF68%20PYB
2026-03-29 22:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1941c029-e601-57db-8da4-77ae3b1b387e with identifier: PF68%20PYB
2026-03-29 22:08:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1941c029-e601-57db-8da4-77ae3b1b387e with identifier: PF68%20PYB to the API
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PF68%20PYB-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1941c029-e601-57db-8da4-77ae3b1b387e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PF68 PYB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PF68%20PYB&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'JAGUAR',
'model': 'E-PACE',
'odometer': 66523,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'JAGUAR E-PACE 2.0 D150 2WD R-DYNAMIC S Hatchback',
'transmission': 'manual',
'trim': 'D150 2WD R-DYNAMIC S',
'vin': 'SADFB2CN8K1Z47893',
'year': 2018}
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF68%2520PYB%27 HTTP/1.1" 200 None
2026-03-29 22:08:05 [bca.uk] INFO: Saving data for PF68%20PYB: {'auction_closing_time': 1774864800.0, 'created_time': 1774735553.692487, 'last_price_update_time': 1774822085.993271}
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PF68%2520PYB') HTTP/1.1" 204 0
2026-03-29 22:08:06 [bca.uk] INFO: Found listing with ID: AK64%20MOR
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK64%2520MOR%27 HTTP/1.1" 200 None
2026-03-29 22:08:06 [bca.uk] INFO: Scrape type for AK64%20MOR: 0
2026-03-29 22:08:06 [bca.uk] INFO: Found listing with ID: DY19%20EYK
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY19%2520EYK%27 HTTP/1.1" 200 None
2026-03-29 22:08:06 [bca.uk] INFO: Scrape type for DY19%20EYK: 0
2026-03-29 22:08:06 [bca.uk] INFO: Found listing with ID: GK21%20KBU
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK21%2520KBU%27 HTTP/1.1" 200 None
2026-03-29 22:08:06 [bca.uk] INFO: Scrape type for GK21%20KBU: 0
2026-03-29 22:08:06 [bca.uk] INFO: Found listing with ID: GM19%20WGU
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM19%2520WGU%27 HTTP/1.1" 200 None
2026-03-29 22:08:06 [bca.uk] INFO: Scrape type for GM19%20WGU: 2
2026-03-29 22:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45fb38d6-e2a8-57d4-8493-3dc79c4a4423 with identifier: GM19%20WGU
2026-03-29 22:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45fb38d6-e2a8-57d4-8493-3dc79c4a4423 with scrape type 2
2026-03-29 22:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45fb38d6-e2a8-57d4-8493-3dc79c4a4423 with scrape type 2
2026-03-29 22:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 45fb38d6-e2a8-57d4-8493-3dc79c4a4423, identifier: GM19%20WGU
2026-03-29 22:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dc10834f-41df-5685-8f4e-07d2c9215704 with identifier: SJ22%20EHM
2026-03-29 22:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dc10834f-41df-5685-8f4e-07d2c9215704 with identifier: SJ22%20EHM
2026-03-29 22:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dc10834f-41df-5685-8f4e-07d2c9215704 with identifier: SJ22%20EHM to the API
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 163,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SJ22%20EHM-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dc10834f-41df-5685-8f4e-07d2c9215704',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SJ22 EHM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SJ22%20EHM&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'MG MOTOR UK',
'model': 'ZS',
'odometer': 26767,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'MG MOTOR UK ZS 1.0 T GDI EXCITE DCT Hatchback',
'transmission': 'automatic',
'trim': 'T GDI EXCITE DCT',
'vin': 'LSJW74C99MZ233964',
'year': 2022}
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ22%2520EHM%27 HTTP/1.1" 200 None
2026-03-29 22:08:06 [bca.uk] INFO: Saving data for SJ22%20EHM: {'auction_closing_time': 1774864800.0, 'created_time': 1774438076.557092, 'last_price_update_time': 1774822086.535277}
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SJ22%2520EHM') HTTP/1.1" 204 0
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61936910>
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ58SFX%252F699435142%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435142/600 saved to cache
2026-03-29 22:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5063d79c-4147-5ce9-b414-8b0ccabfea0d
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6184d210>
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ08SVR%252F699430171%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430171/600 saved to cache
2026-03-29 22:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4de1def5-9fea-59aa-8472-dafc14cac3a1
2026-03-29 22:08:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:08:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:08:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:08:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:08:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611000d0>
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE56AOD%252F699427731%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699427731/600 saved to cache
2026-03-29 22:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5674dd98-879a-5bc0-92a6-049abdc5f932
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619ed410>
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP66PGE%252F699139527%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139527/600 saved to cache
2026-03-29 22:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49025c6e-c82c-5ad9-a984-dc586f875105
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62184a10>
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR60HNV%252F699146888%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146888/600 saved to cache
2026-03-29 22:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a63c92f-88a3-5364-8028-ccaa89112c46
2026-03-29 22:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435134/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ58SFX/42812168?sv=2020-08-04&st=2026-03-29T22%3A06%3A32Z&se=2026-03-29T22%3A31%3A32Z&sr=b&sp=r&sig=qiTgzjDZ%2FB1Y9Jc9LI61o7EdjHjaU8RNz%2BEzvH34f2o%3D)
2026-03-29 22:08:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146871/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WR60HNV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:08:06 [bca.uk] INFO: Found listing with ID: SK20%20UEP
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK20%2520UEP%27 HTTP/1.1" 200 None
2026-03-29 22:08:06 [bca.uk] INFO: Scrape type for SK20%20UEP: 0
2026-03-29 22:08:06 [bca.uk] INFO: Found listing with ID: RE70%20JXR
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE70%2520JXR%27 HTTP/1.1" 200 None
2026-03-29 22:08:06 [bca.uk] INFO: Scrape type for RE70%20JXR: 0
2026-03-29 22:08:06 [bca.uk] INFO: Found listing with ID: GF20%20LKE
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF20%2520LKE%27 HTTP/1.1" 200 None
2026-03-29 22:08:06 [bca.uk] INFO: Scrape type for GF20%20LKE: 0
2026-03-29 22:08:06 [bca.uk] INFO: Found listing with ID: SE68%20SDU
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE68%2520SDU%27 HTTP/1.1" 200 None
2026-03-29 22:08:06 [bca.uk] INFO: Scrape type for SE68%20SDU: 2
2026-03-29 22:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3efef238-e51a-526d-ba10-e8f193e1fbc2 with identifier: SE68%20SDU
2026-03-29 22:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3efef238-e51a-526d-ba10-e8f193e1fbc2 with scrape type 2
2026-03-29 22:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3efef238-e51a-526d-ba10-e8f193e1fbc2 with scrape type 2
2026-03-29 22:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3efef238-e51a-526d-ba10-e8f193e1fbc2, identifier: SE68%20SDU
2026-03-29 22:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 45fb38d6-e2a8-57d4-8493-3dc79c4a4423 with identifier: GM19%20WGU
2026-03-29 22:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 45fb38d6-e2a8-57d4-8493-3dc79c4a4423 with identifier: GM19%20WGU
2026-03-29 22:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 45fb38d6-e2a8-57d4-8493-3dc79c4a4423 with identifier: GM19%20WGU to the API
2026-03-29 22:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GM19%20WGU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '45fb38d6-e2a8-57d4-8493-3dc79c4a4423',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GM19 WGU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GM19%20WGU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'AUDI',
'model': 'A5',
'odometer': 54073,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'AUDI A5 2.0 40 TFSI SPORT S-T Coupe',
'transmission': 'automatic',
'trim': '40 TFSI SPORT S-T',
'vin': 'WAUZZZF5XKA040424',
'year': 2019}
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM19%2520WGU%27 HTTP/1.1" 200 None
2026-03-29 22:08:07 [bca.uk] INFO: Saving data for GM19%20WGU: {'auction_closing_time': 1774864800.0, 'created_time': 1774706988.564613, 'last_price_update_time': 1774822087.168923}
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GM19%2520WGU') HTTP/1.1" 204 0
2026-03-29 22:08:07 [bca.uk] INFO: Found listing with ID: C5%20BLJ
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27C5%2520BLJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:07 [bca.uk] INFO: Scrape type for C5%20BLJ: 0
2026-03-29 22:08:07 [bca.uk] INFO: Found listing with ID: DN19%20HKK
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN19%2520HKK%27 HTTP/1.1" 200 None
2026-03-29 22:08:07 [bca.uk] INFO: Scrape type for DN19%20HKK: 0
2026-03-29 22:08:07 [bca.uk] INFO: Found listing with ID: SC18%20HNF
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC18%2520HNF%27 HTTP/1.1" 200 None
2026-03-29 22:08:07 [bca.uk] INFO: Scrape type for SC18%20HNF: 0
2026-03-29 22:08:07 [bca.uk] INFO: Found listing with ID: SM22%20URS
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM22%2520URS%27 HTTP/1.1" 200 None
2026-03-29 22:08:07 [bca.uk] INFO: Scrape type for SM22%20URS: 0
2026-03-29 22:08:07 [bca.uk] INFO: Found listing with ID: SB65%20CAX
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB65%2520CAX%27 HTTP/1.1" 200 None
2026-03-29 22:08:07 [bca.uk] INFO: Scrape type for SB65%20CAX: 0
2026-03-29 22:08:07 [bca.uk] INFO: Found listing with ID: EP19%20XHA
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP19%2520XHA%27 HTTP/1.1" 200 None
2026-03-29 22:08:07 [bca.uk] INFO: Scrape type for EP19%20XHA: 0
2026-03-29 22:08:07 [bca.uk] INFO: Found listing with ID: WM19%20BFN
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM19%2520BFN%27 HTTP/1.1" 200 None
2026-03-29 22:08:07 [bca.uk] INFO: Scrape type for WM19%20BFN: 0
2026-03-29 22:08:07 [bca.uk] INFO: Found listing with ID: EJ19%20URS
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ19%2520URS%27 HTTP/1.1" 200 None
2026-03-29 22:08:07 [bca.uk] INFO: Scrape type for EJ19%20URS: 0
2026-03-29 22:08:07 [bca.uk] INFO: Found listing with ID: HJ69%20WRA
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ69%2520WRA%27 HTTP/1.1" 200 None
2026-03-29 22:08:07 [bca.uk] INFO: Scrape type for HJ69%20WRA: 2
2026-03-29 22:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 153af31d-028d-53b0-bf86-1a15b8cd7e12 with identifier: HJ69%20WRA
2026-03-29 22:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 153af31d-028d-53b0-bf86-1a15b8cd7e12 with scrape type 2
2026-03-29 22:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 153af31d-028d-53b0-bf86-1a15b8cd7e12 with scrape type 2
2026-03-29 22:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 153af31d-028d-53b0-bf86-1a15b8cd7e12, identifier: HJ69%20WRA
2026-03-29 22:08:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3efef238-e51a-526d-ba10-e8f193e1fbc2 with identifier: SE68%20SDU
2026-03-29 22:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3efef238-e51a-526d-ba10-e8f193e1fbc2 with identifier: SE68%20SDU
2026-03-29 22:08:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3efef238-e51a-526d-ba10-e8f193e1fbc2 with identifier: SE68%20SDU to the API
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 96,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SE68%20SDU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3efef238-e51a-526d-ba10-e8f193e1fbc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SE68 SDU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SE68%20SDU&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'SEAT',
'model': 'MII',
'odometer': 61308,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'SEAT MII 1.0 DESIGN MII EZ Hatchback',
'transmission': 'manual',
'trim': 'DESIGN MII EZ',
'vin': 'VSSZZZAAZKD305737',
'year': 2019}
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE68%2520SDU%27 HTTP/1.1" 200 None
2026-03-29 22:08:07 [bca.uk] INFO: Saving data for SE68%20SDU: {'auction_closing_time': 1774864800.0, 'created_time': 1774437430.358563, 'last_price_update_time': 1774822087.793626}
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SE68%2520SDU') HTTP/1.1" 204 0
2026-03-29 22:08:07 [bca.uk] INFO: Found listing with ID: VU70%20ZLO
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU70%2520ZLO%27 HTTP/1.1" 200 None
2026-03-29 22:08:07 [bca.uk] INFO: Scrape type for VU70%20ZLO: 2
2026-03-29 22:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ba7722a-587f-552f-9000-fec714f3bbb3 with identifier: VU70%20ZLO
2026-03-29 22:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ba7722a-587f-552f-9000-fec714f3bbb3 with scrape type 2
2026-03-29 22:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ba7722a-587f-552f-9000-fec714f3bbb3 with scrape type 2
2026-03-29 22:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2ba7722a-587f-552f-9000-fec714f3bbb3, identifier: VU70%20ZLO
2026-03-29 22:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 153af31d-028d-53b0-bf86-1a15b8cd7e12 with identifier: HJ69%20WRA
2026-03-29 22:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 153af31d-028d-53b0-bf86-1a15b8cd7e12 with identifier: HJ69%20WRA
2026-03-29 22:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 153af31d-028d-53b0-bf86-1a15b8cd7e12 with identifier: HJ69%20WRA to the API
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HJ69%20WRA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '153af31d-028d-53b0-bf86-1a15b8cd7e12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HJ69 WRA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HJ69%20WRA&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'GRAND CONNECT',
'odometer': 84524,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD GRAND CONNECT 1.5 EBL 120 TITANIUM P/S MPV',
'transmission': 'automatic',
'trim': 'EBL 120 TITANIUM P/S',
'vin': 'WF0UXXWPGUKU88649',
'year': 2019}
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ69%2520WRA%27 HTTP/1.1" 200 None
2026-03-29 22:08:08 [bca.uk] INFO: Saving data for HJ69%20WRA: {'auction_closing_time': 1774864800.0, 'created_time': 1774476166.059992, 'last_price_update_time': 1774822088.308875}
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HJ69%2520WRA') HTTP/1.1" 204 0
2026-03-29 22:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430136/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ08SVR/42812103?sv=2020-08-04&st=2026-03-29T22%3A06%3A29Z&se=2026-03-29T22%3A31%3A29Z&sr=b&sp=r&sig=MlBD76Nciq6xfGWS8ogzePQWya6I7akYbscBXB2PpJI%3D)
2026-03-29 22:08:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430098/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430098>
2026-03-29 22:08:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435122/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699435122>
2026-03-29 22:08:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139514/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139514>
2026-03-29 22:08:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103831/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103831>
2026-03-29 22:08:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699427714/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699427714>
2026-03-29 22:08:08 [bca.uk] INFO: Found listing with ID: SJ72%20MDX
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ72%2520MDX%27 HTTP/1.1" 200 None
2026-03-29 22:08:08 [bca.uk] INFO: Scrape type for SJ72%20MDX: 0
2026-03-29 22:08:08 [bca.uk] INFO: Found listing with ID: DG69%20VJO
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG69%2520VJO%27 HTTP/1.1" 200 None
2026-03-29 22:08:08 [bca.uk] INFO: Scrape type for DG69%20VJO: 0
2026-03-29 22:08:08 [bca.uk] INFO: Found listing with ID: SC19%20XGB
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC19%2520XGB%27 HTTP/1.1" 200 None
2026-03-29 22:08:08 [bca.uk] INFO: Scrape type for SC19%20XGB: 0
2026-03-29 22:08:08 [bca.uk] INFO: Found listing with ID: CE19%20UGD
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE19%2520UGD%27 HTTP/1.1" 200 None
2026-03-29 22:08:08 [bca.uk] INFO: Scrape type for CE19%20UGD: 2
2026-03-29 22:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2785a6e-33af-5eba-b84f-311143aa78be with identifier: CE19%20UGD
2026-03-29 22:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2785a6e-33af-5eba-b84f-311143aa78be with scrape type 2
2026-03-29 22:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2785a6e-33af-5eba-b84f-311143aa78be with scrape type 2
2026-03-29 22:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e2785a6e-33af-5eba-b84f-311143aa78be, identifier: CE19%20UGD
2026-03-29 22:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2ba7722a-587f-552f-9000-fec714f3bbb3 with identifier: VU70%20ZLO
2026-03-29 22:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2ba7722a-587f-552f-9000-fec714f3bbb3 with identifier: VU70%20ZLO
2026-03-29 22:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2ba7722a-587f-552f-9000-fec714f3bbb3 with identifier: VU70%20ZLO to the API
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VU70%20ZLO-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': '2ba7722a-587f-552f-9000-fec714f3bbb3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VU70 ZLO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VU70%20ZLO&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'CORSA-E',
'odometer': 32694,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA-E 100KW 50KWH ELITE (11KC) Hatchback',
'transmission': 'automatic',
'trim': '100KW 50KWH ELITE (11KC)',
'vin': 'VXKUHZKXZL4340414',
'year': 2020}
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU70%2520ZLO%27 HTTP/1.1" 200 None
2026-03-29 22:08:08 [bca.uk] INFO: Saving data for VU70%20ZLO: {'auction_closing_time': 1774864800.0, 'created_time': 1774706989.45696, 'last_price_update_time': 1774822088.749503}
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VU70%2520ZLO') HTTP/1.1" 204 0
2026-03-29 22:08:08 [bca.uk] INFO: Found listing with ID: VO62%20RAU
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO62%2520RAU%27 HTTP/1.1" 200 None
2026-03-29 22:08:08 [bca.uk] INFO: Scrape type for VO62%20RAU: 0
2026-03-29 22:08:08 [bca.uk] INFO: Found listing with ID: SV23%20HXP
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV23%2520HXP%27 HTTP/1.1" 200 None
2026-03-29 22:08:08 [bca.uk] INFO: Scrape type for SV23%20HXP: 0
2026-03-29 22:08:08 [bca.uk] INFO: Found listing with ID: V30%20NGA
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V30%2520NGA%27 HTTP/1.1" 200 None
2026-03-29 22:08:08 [bca.uk] INFO: Scrape type for V30%20NGA: 0
2026-03-29 22:08:08 [bca.uk] INFO: Found listing with ID: SR19%20GGU
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520GGU%27 HTTP/1.1" 200 None
2026-03-29 22:08:08 [bca.uk] INFO: Scrape type for SR19%20GGU: 0
2026-03-29 22:08:08 [bca.uk] INFO: Found listing with ID: VX68%20HBE
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX68%2520HBE%27 HTTP/1.1" 200 None
2026-03-29 22:08:08 [bca.uk] INFO: Scrape type for VX68%20HBE: 0
2026-03-29 22:08:08 [bca.uk] INFO: Found listing with ID: AF20%20DFX
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF20%2520DFX%27 HTTP/1.1" 200 None
2026-03-29 22:08:08 [bca.uk] INFO: Scrape type for AF20%20DFX: 2
2026-03-29 22:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc279a6e-9287-5150-bd4c-4b265cf17726 with identifier: AF20%20DFX
2026-03-29 22:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc279a6e-9287-5150-bd4c-4b265cf17726 with scrape type 2
2026-03-29 22:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc279a6e-9287-5150-bd4c-4b265cf17726 with scrape type 2
2026-03-29 22:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cc279a6e-9287-5150-bd4c-4b265cf17726, identifier: AF20%20DFX
2026-03-29 22:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac612de1d0>
2026-03-29 22:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 22:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAP12HDL%252F699103837%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103837/600 saved to cache
2026-03-29 22:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21e79e5d-2d1b-56fe-b8fb-2067f25370f7
2026-03-29 22:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6179b7d0>
2026-03-29 22:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM09CVU%252F699124362%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124362/600 saved to cache
2026-03-29 22:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad76e9a4-0e7d-56af-9a84-3fd65281fde6
2026-03-29 22:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61100b90>
2026-03-29 22:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR60HNV%252F699146881%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146881/600 saved to cache
2026-03-29 22:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a63c92f-88a3-5364-8028-ccaa89112c46
2026-03-29 22:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139522/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP66PGE/42809943?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=WoZ%2FTTd8%2FUTJlWN%2B%2FNq0hoqMOCTHwgwo3OayCCjYYF0%3D)
2026-03-29 22:08:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124354/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM09CVU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e2785a6e-33af-5eba-b84f-311143aa78be with identifier: CE19%20UGD
2026-03-29 22:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e2785a6e-33af-5eba-b84f-311143aa78be with identifier: CE19%20UGD
2026-03-29 22:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e2785a6e-33af-5eba-b84f-311143aa78be with identifier: CE19%20UGD to the API
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CE19%20UGD-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 6,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e2785a6e-33af-5eba-b84f-311143aa78be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CE19 UGD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CE19%20UGD&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MINI',
'model': 'CLUBMAN',
'odometer': 83001,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MINI CLUBMAN 2.0 COOPER S EXCLUSIVE Estate',
'transmission': 'automatic',
'trim': 'COOPER S EXCLUSIVE',
'vin': 'WMWJZ520002L19288',
'year': 2019}
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE19%2520UGD%27 HTTP/1.1" 200 None
2026-03-29 22:08:09 [bca.uk] INFO: Saving data for CE19%20UGD: {'auction_closing_time': 1774864800.0, 'created_time': 1774735578.336249, 'last_price_update_time': 1774822089.396442}
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CE19%2520UGD') HTTP/1.1" 204 0
2026-03-29 22:08:09 [bca.uk] INFO: Found listing with ID: GL23%20VZB
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL23%2520VZB%27 HTTP/1.1" 200 None
2026-03-29 22:08:09 [bca.uk] INFO: Scrape type for GL23%20VZB: 2
2026-03-29 22:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff1ca2ee-3094-5da2-ab74-133cc0e9f7e3 with identifier: GL23%20VZB
2026-03-29 22:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff1ca2ee-3094-5da2-ab74-133cc0e9f7e3 with scrape type 2
2026-03-29 22:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff1ca2ee-3094-5da2-ab74-133cc0e9f7e3 with scrape type 2
2026-03-29 22:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ff1ca2ee-3094-5da2-ab74-133cc0e9f7e3, identifier: GL23%20VZB
2026-03-29 22:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cc279a6e-9287-5150-bd4c-4b265cf17726 with identifier: AF20%20DFX
2026-03-29 22:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cc279a6e-9287-5150-bd4c-4b265cf17726 with identifier: AF20%20DFX
2026-03-29 22:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cc279a6e-9287-5150-bd4c-4b265cf17726 with identifier: AF20%20DFX to the API
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF20%20DFX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cc279a6e-9287-5150-bd4c-4b265cf17726',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF20 DFX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF20%20DFX&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'MG MOTOR UK',
'model': 'ZS',
'odometer': 52595,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'MG MOTOR UK ZS 1.0 T GDI EXCLUSIVE DCT Hatchback',
'transmission': 'automatic',
'trim': 'T GDI EXCLUSIVE DCT',
'vin': 'SDPW7CBECKZ232455',
'year': 2020}
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF20%2520DFX%27 HTTP/1.1" 200 None
2026-03-29 22:08:09 [bca.uk] INFO: Saving data for AF20%20DFX: {'auction_closing_time': 1774864800.0, 'created_time': 1774622286.997342, 'last_price_update_time': 1774822089.889631}
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF20%2520DFX') HTTP/1.1" 204 0
2026-03-29 22:08:09 [bca.uk] INFO: Found listing with ID: BG70%20GGP
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG70%2520GGP%27 HTTP/1.1" 200 None
2026-03-29 22:08:09 [bca.uk] INFO: Scrape type for BG70%20GGP: 0
2026-03-29 22:08:09 [bca.uk] INFO: Found listing with ID: SN21%20AHB
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN21%2520AHB%27 HTTP/1.1" 200 None
2026-03-29 22:08:09 [bca.uk] INFO: Scrape type for SN21%20AHB: 0
2026-03-29 22:08:09 [bca.uk] INFO: Found listing with ID: CN22%20SLU
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN22%2520SLU%27 HTTP/1.1" 200 None
2026-03-29 22:08:09 [bca.uk] INFO: Scrape type for CN22%20SLU: 2
2026-03-29 22:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b95ec648-e27a-5a47-b460-f09e07adbbeb with identifier: CN22%20SLU
2026-03-29 22:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b95ec648-e27a-5a47-b460-f09e07adbbeb with scrape type 2
2026-03-29 22:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b95ec648-e27a-5a47-b460-f09e07adbbeb with scrape type 2
2026-03-29 22:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b95ec648-e27a-5a47-b460-f09e07adbbeb, identifier: CN22%20SLU
2026-03-29 22:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ff1ca2ee-3094-5da2-ab74-133cc0e9f7e3 with identifier: GL23%20VZB
2026-03-29 22:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ff1ca2ee-3094-5da2-ab74-133cc0e9f7e3 with identifier: GL23%20VZB
2026-03-29 22:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ff1ca2ee-3094-5da2-ab74-133cc0e9f7e3 with identifier: GL23%20VZB to the API
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GL23%20VZB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ff1ca2ee-3094-5da2-ab74-133cc0e9f7e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GL23 VZB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GL23%20VZB&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'AUDI',
'model': 'A5 SPORTBACK',
'odometer': 39087,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'AUDI A5 SPORTBACK 2.0 35 TDI S LINE S-T Hatchback',
'transmission': 'automatic',
'trim': '35 TDI S LINE S-T',
'vin': 'WAUZZZF57PA052442',
'year': 2023}
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL23%2520VZB%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Saving data for GL23%20VZB: {'auction_closing_time': 1774951200.0, 'created_time': 1774706989.834441, 'last_price_update_time': 1774822090.336903}
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GL23%2520VZB') HTTP/1.1" 204 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: BL19%20WJA
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL19%2520WJA%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for BL19%20WJA: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: HF19%20JKU
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF19%2520JKU%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for HF19%20JKU: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: SD68%20WCY
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD68%2520WCY%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for SD68%20WCY: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: OY16%20VNK
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY16%2520VNK%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for OY16%20VNK: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: PE10%20DXZ
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE10%2520DXZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for PE10%20DXZ: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: FJ20%20XSP
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ20%2520XSP%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for FJ20%20XSP: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: LB22%20KUJ
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB22%2520KUJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for LB22%20KUJ: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: LM20%20BCX
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM20%2520BCX%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for LM20%20BCX: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: ML19%20YHM
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML19%2520YHM%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for ML19%20YHM: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: MX22%20PPO
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX22%2520PPO%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for MX22%20PPO: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: SH19%20ZZL
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH19%2520ZZL%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for SH19%20ZZL: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: VN21%20GCK
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN21%2520GCK%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for VN21%20GCK: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: WX18%20RMZ
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX18%2520RMZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for WX18%20RMZ: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: WX70%20JZJ
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX70%2520JZJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for WX70%20JZJ: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: CA18%20JPY
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA18%2520JPY%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for CA18%20JPY: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: CP19%20XKX
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP19%2520XKX%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for CP19%20XKX: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: WP22%20GWL
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP22%2520GWL%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for WP22%20GWL: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: CU72%20ZHM
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU72%2520ZHM%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for CU72%20ZHM: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: FE19%20XYC
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE19%2520XYC%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for FE19%20XYC: 0
2026-03-29 22:08:10 [bca.uk] INFO: Found listing with ID: KU19%20CFH
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU19%2520CFH%27 HTTP/1.1" 200 None
2026-03-29 22:08:10 [bca.uk] INFO: Scrape type for KU19%20CFH: 2
2026-03-29 22:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6d51688-b23c-5016-a794-ddfbf11c9378 with identifier: KU19%20CFH
2026-03-29 22:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6d51688-b23c-5016-a794-ddfbf11c9378 with scrape type 2
2026-03-29 22:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6d51688-b23c-5016-a794-ddfbf11c9378 with scrape type 2
2026-03-29 22:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b6d51688-b23c-5016-a794-ddfbf11c9378, identifier: KU19%20CFH
2026-03-29 22:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac62178650>
2026-03-29 22:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ58SFX%252F699435134%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435134/600 saved to cache
2026-03-29 22:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5063d79c-4147-5ce9-b414-8b0ccabfea0d
2026-03-29 22:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103834/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AP12HDL/42809882?sv=2020-08-04&st=2026-03-29T22%3A06%3A24Z&se=2026-03-29T22%3A31%3A24Z&sr=b&sp=r&sig=DviGem8rLk3txiS7kcWiSVUINF67ojRtTzL1ranpKKA%3D)
2026-03-29 22:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146871/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR60HNV/42810656?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=iTeyX7WgAxvLftpE%2F2dkTmhR4Qwoz4r3xCUieQTYJOM%3D)
2026-03-29 22:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430122/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE56AOD/42812125?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=jYNw1fNPOU4PCeqA8yT%2FgW%2F2lYqFTt1ML7YNy%2BQkkpE%3D)
2026-03-29 22:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124359/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM09CVU/42809722?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=IVQHrCG530q4ZNE7GeniJ3%2F1vLzKHgZru4jgYYDb%2BSY%3D)
2026-03-29 22:08:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430095/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430095>
2026-03-29 22:08:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435115/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NJ58SFX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:08:10 [scrapy.extensions.logstats] INFO: Crawled 161 pages (at 8 pages/min), scraped 606 items (at 117 items/min)
2026-03-29 22:08:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-29 22:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b95ec648-e27a-5a47-b460-f09e07adbbeb with identifier: CN22%20SLU
2026-03-29 22:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b95ec648-e27a-5a47-b460-f09e07adbbeb with identifier: CN22%20SLU
2026-03-29 22:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b95ec648-e27a-5a47-b460-f09e07adbbeb with identifier: CN22%20SLU to the API
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CN22%20SLU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b95ec648-e27a-5a47-b460-f09e07adbbeb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CN22 SLU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CN22%20SLU&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MAZDA',
'model': '3',
'odometer': 48101,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'MAZDA 3 2.0 E-SKY-G MHEV SE-L LUX Hatchback',
'transmission': 'manual',
'trim': 'E-SKY-G MHEV SE-L LUX',
'vin': 'JM4BP6HE601306558',
'year': 2022}
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN22%2520SLU%27 HTTP/1.1" 200 None
2026-03-29 22:08:11 [bca.uk] INFO: Saving data for CN22%20SLU: {'auction_closing_time': 1774864800.0, 'created_time': 1774735579.849802, 'last_price_update_time': 1774822091.208926}
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CN22%2520SLU') HTTP/1.1" 204 0
2026-03-29 22:08:11 [bca.uk] INFO: Found listing with ID: LV23%20RXA
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV23%2520RXA%27 HTTP/1.1" 200 None
2026-03-29 22:08:11 [bca.uk] INFO: Scrape type for LV23%20RXA: 0
2026-03-29 22:08:11 [bca.uk] INFO: Found listing with ID: LY69%20PXN
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY69%2520PXN%27 HTTP/1.1" 200 None
2026-03-29 22:08:11 [bca.uk] INFO: Scrape type for LY69%20PXN: 0
2026-03-29 22:08:11 [bca.uk] INFO: Found listing with ID: NX20%20NZM
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX20%2520NZM%27 HTTP/1.1" 200 None
2026-03-29 22:08:11 [bca.uk] INFO: Scrape type for NX20%20NZM: 0
2026-03-29 22:08:11 [bca.uk] INFO: Found listing with ID: SC69%20SYA
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC69%2520SYA%27 HTTP/1.1" 200 None
2026-03-29 22:08:11 [bca.uk] INFO: Scrape type for SC69%20SYA: 0
2026-03-29 22:08:11 [bca.uk] INFO: Found listing with ID: WR21%20RBV
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR21%2520RBV%27 HTTP/1.1" 200 None
2026-03-29 22:08:11 [bca.uk] INFO: Scrape type for WR21%20RBV: 0
2026-03-29 22:08:11 [bca.uk] INFO: Found listing with ID: YM68%20ZFO
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM68%2520ZFO%27 HTTP/1.1" 200 None
2026-03-29 22:08:11 [bca.uk] INFO: Scrape type for YM68%20ZFO: 0
2026-03-29 22:08:11 [bca.uk] INFO: Found listing with ID: AO69%20YDV
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO69%2520YDV%27 HTTP/1.1" 200 None
2026-03-29 22:08:11 [bca.uk] INFO: Scrape type for AO69%20YDV: 0
2026-03-29 22:08:11 [bca.uk] INFO: Found listing with ID: DU19%20WRR
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU19%2520WRR%27 HTTP/1.1" 200 None
2026-03-29 22:08:11 [bca.uk] INFO: Scrape type for DU19%20WRR: 0
2026-03-29 22:08:11 [bca.uk] INFO: Found listing with ID: EN73%20ZXH
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN73%2520ZXH%27 HTTP/1.1" 200 None
2026-03-29 22:08:11 [bca.uk] INFO: Scrape type for EN73%20ZXH: 2
2026-03-29 22:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08f7680b-fbb6-579a-a286-11cdb0fea14b with identifier: EN73%20ZXH
2026-03-29 22:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08f7680b-fbb6-579a-a286-11cdb0fea14b with scrape type 2
2026-03-29 22:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08f7680b-fbb6-579a-a286-11cdb0fea14b with scrape type 2
2026-03-29 22:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 08f7680b-fbb6-579a-a286-11cdb0fea14b, identifier: EN73%20ZXH
2026-03-29 22:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b6d51688-b23c-5016-a794-ddfbf11c9378 with identifier: KU19%20CFH
2026-03-29 22:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b6d51688-b23c-5016-a794-ddfbf11c9378 with identifier: KU19%20CFH
2026-03-29 22:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b6d51688-b23c-5016-a794-ddfbf11c9378 with identifier: KU19%20CFH to the API
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU19%20CFH-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b6d51688-b23c-5016-a794-ddfbf11c9378',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU19 CFH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KU19%20CFH&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MERCEDES-BENZ',
'model': 'A180 D',
'odometer': 28526,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A180 D 1.5 AMG LINE PREMIUM DCT Hatchback',
'transmission': 'automatic',
'trim': 'AMG LINE PREMIUM DCT',
'vin': 'WDD1770032V040895',
'year': 2019}
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU19%2520CFH%27 HTTP/1.1" 200 None
2026-03-29 22:08:11 [bca.uk] INFO: Saving data for KU19%20CFH: {'auction_closing_time': 1774864800.0, 'created_time': 1774706920.919237, 'last_price_update_time': 1774822091.87137}
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KU19%2520CFH') HTTP/1.1" 204 0
2026-03-29 22:08:11 [bca.uk] INFO: Found listing with ID: DP69%20NZK
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP69%2520NZK%27 HTTP/1.1" 200 None
2026-03-29 22:08:11 [bca.uk] INFO: Scrape type for DP69%20NZK: 0
2026-03-29 22:08:11 [bca.uk] INFO: Found listing with ID: HK73%20EWD
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK73%2520EWD%27 HTTP/1.1" 200 None
2026-03-29 22:08:11 [bca.uk] INFO: Scrape type for HK73%20EWD: 2
2026-03-29 22:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e39c955-50ed-58e2-b150-dec2ff78b99f with identifier: HK73%20EWD
2026-03-29 22:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e39c955-50ed-58e2-b150-dec2ff78b99f with scrape type 2
2026-03-29 22:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e39c955-50ed-58e2-b150-dec2ff78b99f with scrape type 2
2026-03-29 22:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8e39c955-50ed-58e2-b150-dec2ff78b99f, identifier: HK73%20EWD
2026-03-29 22:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 08f7680b-fbb6-579a-a286-11cdb0fea14b with identifier: EN73%20ZXH
2026-03-29 22:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 08f7680b-fbb6-579a-a286-11cdb0fea14b with identifier: EN73%20ZXH
2026-03-29 22:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 08f7680b-fbb6-579a-a286-11cdb0fea14b with identifier: EN73%20ZXH to the API
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 197,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN73%20ZXH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '08f7680b-fbb6-579a-a286-11cdb0fea14b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN73 ZXH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN73%20ZXH&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLVO',
'model': 'XC90',
'odometer': 10223,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'VOLVO XC90 2.0 B5P 250 AWD CORE G/T StationWagon',
'transmission': 'automatic',
'trim': 'B5P 250 AWD CORE G/T',
'vin': 'YV1LFL1V3R1214845',
'year': 2024}
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN73%2520ZXH%27 HTTP/1.1" 200 None
2026-03-29 22:08:12 [bca.uk] INFO: Saving data for EN73%20ZXH: {'auction_closing_time': 1774864800.0, 'created_time': 1774438118.203394, 'last_price_update_time': 1774822092.322182}
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN73%2520ZXH') HTTP/1.1" 204 0
2026-03-29 22:08:12 [bca.uk] INFO: Found listing with ID: CA19%20UTE
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA19%2520UTE%27 HTTP/1.1" 200 None
2026-03-29 22:08:12 [bca.uk] INFO: Scrape type for CA19%20UTE: 2
2026-03-29 22:08:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41dd639c-cc52-58ab-80be-f6c9b83b3884 with identifier: CA19%20UTE
2026-03-29 22:08:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41dd639c-cc52-58ab-80be-f6c9b83b3884 with scrape type 2
2026-03-29 22:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41dd639c-cc52-58ab-80be-f6c9b83b3884 with scrape type 2
2026-03-29 22:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 41dd639c-cc52-58ab-80be-f6c9b83b3884, identifier: CA19%20UTE
2026-03-29 22:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6209f190>
2026-03-29 22:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ08SVR%252F699430136%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430136/600 saved to cache
2026-03-29 22:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4de1def5-9fea-59aa-8472-dafc14cac3a1
2026-03-29 22:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61681110>
2026-03-29 22:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP66PGE%252F699139522%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139522/600 saved to cache
2026-03-29 22:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49025c6e-c82c-5ad9-a984-dc586f875105
2026-03-29 22:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699427714/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE56AOD/42812125?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=jYNw1fNPOU4PCeqA8yT%2FgW%2F2lYqFTt1ML7YNy%2BQkkpE%3D)
2026-03-29 22:08:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139508/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699139508>
2026-03-29 22:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8e39c955-50ed-58e2-b150-dec2ff78b99f with identifier: HK73%20EWD
2026-03-29 22:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8e39c955-50ed-58e2-b150-dec2ff78b99f with identifier: HK73%20EWD
2026-03-29 22:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8e39c955-50ed-58e2-b150-dec2ff78b99f with identifier: HK73%20EWD to the API
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK73%20EWD-GB',
'category': 'Car',
'color': 'orange',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8e39c955-50ed-58e2-b150-dec2ff78b99f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK73 EWD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK73%20EWD&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'MG MOTOR UK',
'model': 'ZS',
'odometer': 21872,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'MG MOTOR UK ZS 1.0 T GDI EXCLUSIVE Hatchback',
'transmission': 'manual',
'trim': 'T GDI EXCLUSIVE',
'vin': 'LSJW74C99PZ313270',
'year': 2023}
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK73%2520EWD%27 HTTP/1.1" 200 None
2026-03-29 22:08:12 [bca.uk] INFO: Saving data for HK73%20EWD: {'auction_closing_time': 1774864800.0, 'created_time': 1774735580.664539, 'last_price_update_time': 1774822092.899396}
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK73%2520EWD') HTTP/1.1" 204 0
2026-03-29 22:08:12 [bca.uk] INFO: Found listing with ID: GF23%20LJX
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF23%2520LJX%27 HTTP/1.1" 200 None
2026-03-29 22:08:12 [bca.uk] INFO: Scrape type for GF23%20LJX: 0
2026-03-29 22:08:12 [bca.uk] INFO: Found listing with ID: GJ69%20TMO
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ69%2520TMO%27 HTTP/1.1" 200 None
2026-03-29 22:08:12 [bca.uk] INFO: Scrape type for GJ69%20TMO: 0
2026-03-29 22:08:12 [bca.uk] INFO: Found listing with ID: LV22%20XPR
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV22%2520XPR%27 HTTP/1.1" 200 None
2026-03-29 22:08:12 [bca.uk] INFO: Scrape type for LV22%20XPR: 0
2026-03-29 22:08:12 [bca.uk] INFO: Found listing with ID: GU14%20USS
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU14%2520USS%27 HTTP/1.1" 200 None
2026-03-29 22:08:12 [bca.uk] INFO: Scrape type for GU14%20USS: 0
2026-03-29 22:08:12 [bca.uk] INFO: Found listing with ID: ND17%20WHW
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND17%2520WHW%27 HTTP/1.1" 200 None
2026-03-29 22:08:12 [bca.uk] INFO: Scrape type for ND17%20WHW: 0
2026-03-29 22:08:12 [bca.uk] INFO: Found listing with ID: WA15%20XTF
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA15%2520XTF%27 HTTP/1.1" 200 None
2026-03-29 22:08:13 [bca.uk] INFO: Scrape type for WA15%20XTF: 0
2026-03-29 22:08:13 [bca.uk] INFO: Found listing with ID: YW64%20DGU
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YW64%2520DGU%27 HTTP/1.1" 200 None
2026-03-29 22:08:13 [bca.uk] INFO: Scrape type for YW64%20DGU: 0
2026-03-29 22:08:13 [bca.uk] INFO: Found listing with ID: FA18%20OJS
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA18%2520OJS%27 HTTP/1.1" 200 None
2026-03-29 22:08:13 [bca.uk] INFO: Scrape type for FA18%20OJS: 0
2026-03-29 22:08:13 [bca.uk] INFO: Found listing with ID: YN20%20XDY
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN20%2520XDY%27 HTTP/1.1" 200 None
2026-03-29 22:08:13 [bca.uk] INFO: Scrape type for YN20%20XDY: 0
2026-03-29 22:08:13 [bca.uk] INFO: Found listing with ID: CY68%20EOB
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CY68%2520EOB%27 HTTP/1.1" 200 None
2026-03-29 22:08:13 [bca.uk] INFO: Scrape type for CY68%20EOB: 0
2026-03-29 22:08:13 [bca.uk] INFO: Found listing with ID: FH21%20UNX
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH21%2520UNX%27 HTTP/1.1" 200 None
2026-03-29 22:08:13 [bca.uk] INFO: Scrape type for FH21%20UNX: 0
2026-03-29 22:08:13 [bca.uk] INFO: Found listing with ID: UIG%204202
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27UIG%25204202%27 HTTP/1.1" 200 None
2026-03-29 22:08:13 [bca.uk] INFO: Scrape type for UIG%204202: 0
2026-03-29 22:08:13 [bca.uk] INFO: Found listing with ID: YV19%20MBU
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YV19%2520MBU%27 HTTP/1.1" 200 None
2026-03-29 22:08:13 [bca.uk] INFO: Scrape type for YV19%20MBU: 2
2026-03-29 22:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 222a3fb0-6ef1-5700-a566-5c3adb371d0b with identifier: YV19%20MBU
2026-03-29 22:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222a3fb0-6ef1-5700-a566-5c3adb371d0b with scrape type 2
2026-03-29 22:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 222a3fb0-6ef1-5700-a566-5c3adb371d0b with scrape type 2
2026-03-29 22:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 222a3fb0-6ef1-5700-a566-5c3adb371d0b, identifier: YV19%20MBU
2026-03-29 22:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 41dd639c-cc52-58ab-80be-f6c9b83b3884 with identifier: CA19%20UTE
2026-03-29 22:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 41dd639c-cc52-58ab-80be-f6c9b83b3884 with identifier: CA19%20UTE
2026-03-29 22:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 41dd639c-cc52-58ab-80be-f6c9b83b3884 with identifier: CA19%20UTE to the API
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CA19%20UTE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '41dd639c-cc52-58ab-80be-f6c9b83b3884',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CA19 UTE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CA19%20UTE&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MERCEDES-BENZ',
'model': 'A180',
'odometer': 23629,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A180 1.3 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'WDD1770842V028189',
'year': 2019}
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA19%2520UTE%27 HTTP/1.1" 200 None
2026-03-29 22:08:13 [bca.uk] INFO: Saving data for CA19%20UTE: {'auction_closing_time': 1774864800.0, 'created_time': 1774622262.100801, 'last_price_update_time': 1774822093.501197}
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CA19%2520UTE') HTTP/1.1" 204 0
2026-03-29 22:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139514/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP66PGE/42809943?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=WoZ%2FTTd8%2FUTJlWN%2B%2FNq0hoqMOCTHwgwo3OayCCjYYF0%3D)
2026-03-29 22:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430098/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ08SVR/42812103?sv=2020-08-04&st=2026-03-29T22%3A06%3A29Z&se=2026-03-29T22%3A31%3A29Z&sr=b&sp=r&sig=MlBD76Nciq6xfGWS8ogzePQWya6I7akYbscBXB2PpJI%3D)
2026-03-29 22:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435122/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ58SFX/42812168?sv=2020-08-04&st=2026-03-29T22%3A06%3A32Z&se=2026-03-29T22%3A31%3A32Z&sr=b&sp=r&sig=qiTgzjDZ%2FB1Y9Jc9LI61o7EdjHjaU8RNz%2BEzvH34f2o%3D)
2026-03-29 22:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103831/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AP12HDL/42809882?sv=2020-08-04&st=2026-03-29T22%3A06%3A24Z&se=2026-03-29T22%3A31%3A24Z&sr=b&sp=r&sig=DviGem8rLk3txiS7kcWiSVUINF67ojRtTzL1ranpKKA%3D)
2026-03-29 22:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124354/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM09CVU/42809722?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=IVQHrCG530q4ZNE7GeniJ3%2F1vLzKHgZru4jgYYDb%2BSY%3D)
2026-03-29 22:08:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430105/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699430105>
2026-03-29 22:08:13 [bca.uk] INFO: Found listing with ID: MJ20%20EEG
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ20%2520EEG%27 HTTP/1.1" 200 None
2026-03-29 22:08:13 [bca.uk] INFO: Scrape type for MJ20%20EEG: 0
2026-03-29 22:08:13 [bca.uk] INFO: Found listing with ID: WD72%20JHL
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD72%2520JHL%27 HTTP/1.1" 200 None
2026-03-29 22:08:13 [bca.uk] INFO: Scrape type for WD72%20JHL: 2
2026-03-29 22:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d06042a9-4183-5322-b0e5-834acfc52d31 with identifier: WD72%20JHL
2026-03-29 22:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d06042a9-4183-5322-b0e5-834acfc52d31 with scrape type 2
2026-03-29 22:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d06042a9-4183-5322-b0e5-834acfc52d31 with scrape type 2
2026-03-29 22:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d06042a9-4183-5322-b0e5-834acfc52d31, identifier: WD72%20JHL
2026-03-29 22:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 222a3fb0-6ef1-5700-a566-5c3adb371d0b with identifier: YV19%20MBU
2026-03-29 22:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 222a3fb0-6ef1-5700-a566-5c3adb371d0b with identifier: YV19%20MBU
2026-03-29 22:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 222a3fb0-6ef1-5700-a566-5c3adb371d0b with identifier: YV19%20MBU to the API
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YV19%20MBU-GB',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '222a3fb0-6ef1-5700-a566-5c3adb371d0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YV19 MBU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YV19%20MBU&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FIAT',
'model': 'PANDA',
'odometer': 61628,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FIAT PANDA 1.2 WAZE Hatchback',
'transmission': 'manual',
'trim': 'WAZE',
'vin': 'ZFA31200003C24743',
'year': 2019}
2026-03-29 22:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YV19%2520MBU%27 HTTP/1.1" 200 None
2026-03-29 22:08:14 [bca.uk] INFO: Saving data for YV19%20MBU: {'auction_closing_time': 1774864800.0, 'created_time': 1774438082.992949, 'last_price_update_time': 1774822094.007352}
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YV19%2520MBU') HTTP/1.1" 204 0
2026-03-29 22:08:14 [bca.uk] INFO: Found listing with ID: CK18%20AOC
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520AOC%27 HTTP/1.1" 200 None
2026-03-29 22:08:14 [bca.uk] INFO: Scrape type for CK18%20AOC: 0
2026-03-29 22:08:14 [bca.uk] INFO: Found listing with ID: WV16%20UWB
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV16%2520UWB%27 HTTP/1.1" 200 None
2026-03-29 22:08:14 [bca.uk] INFO: Scrape type for WV16%20UWB: 0
2026-03-29 22:08:14 [bca.uk] INFO: Found listing with ID: MT65%20UJH
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT65%2520UJH%27 HTTP/1.1" 200 None
2026-03-29 22:08:14 [bca.uk] INFO: Scrape type for MT65%20UJH: 0
2026-03-29 22:08:14 [bca.uk] INFO: Found listing with ID: X11%20BBM
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X11%2520BBM%27 HTTP/1.1" 200 None
2026-03-29 22:08:14 [bca.uk] INFO: Scrape type for X11%20BBM: 0
2026-03-29 22:08:14 [bca.uk] INFO: Found listing with ID: KW73%20VTL
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW73%2520VTL%27 HTTP/1.1" 200 None
2026-03-29 22:08:14 [bca.uk] INFO: Scrape type for KW73%20VTL: 0
2026-03-29 22:08:14 [bca.uk] INFO: Found listing with ID: MC19%20ONF
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC19%2520ONF%27 HTTP/1.1" 200 None
2026-03-29 22:08:14 [bca.uk] INFO: Scrape type for MC19%20ONF: 2
2026-03-29 22:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cb9544d-cc57-5f0e-8fc5-e986b790158d with identifier: MC19%20ONF
2026-03-29 22:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cb9544d-cc57-5f0e-8fc5-e986b790158d with scrape type 2
2026-03-29 22:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cb9544d-cc57-5f0e-8fc5-e986b790158d with scrape type 2
2026-03-29 22:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3cb9544d-cc57-5f0e-8fc5-e986b790158d, identifier: MC19%20ONF
2026-03-29 22:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d06042a9-4183-5322-b0e5-834acfc52d31 with identifier: WD72%20JHL
2026-03-29 22:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d06042a9-4183-5322-b0e5-834acfc52d31 with identifier: WD72%20JHL
2026-03-29 22:08:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d06042a9-4183-5322-b0e5-834acfc52d31 with identifier: WD72%20JHL to the API
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WD72%20JHL-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd06042a9-4183-5322-b0e5-834acfc52d31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WD72 JHL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WD72%20JHL&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 32638,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 100 ST-LINE X Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 ST-LINE X',
'vin': 'WF0JXXGAHJNG89582',
'year': 2023}
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD72%2520JHL%27 HTTP/1.1" 200 None
2026-03-29 22:08:14 [bca.uk] INFO: Saving data for WD72%20JHL: {'auction_closing_time': 1774864800.0, 'created_time': 1774735549.31875, 'last_price_update_time': 1774822094.500994}
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WD72%2520JHL') HTTP/1.1" 204 0
2026-03-29 22:08:14 [bca.uk] INFO: Found listing with ID: NG74%20PZW
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG74%2520PZW%27 HTTP/1.1" 200 None
2026-03-29 22:08:14 [bca.uk] INFO: Scrape type for NG74%20PZW: 0
2026-03-29 22:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3cb9544d-cc57-5f0e-8fc5-e986b790158d with identifier: MC19%20ONF
2026-03-29 22:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3cb9544d-cc57-5f0e-8fc5-e986b790158d with identifier: MC19%20ONF
2026-03-29 22:08:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3cb9544d-cc57-5f0e-8fc5-e986b790158d with identifier: MC19%20ONF to the API
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MC19%20ONF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3cb9544d-cc57-5f0e-8fc5-e986b790158d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MC19 ONF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MC19%20ONF&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'CITROEN',
'model': 'C4 SPACETOURER',
'odometer': 58506,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'CITROEN C4 SPACETOURER 1.5 BLUEHDI 130 FLAIR MPV',
'transmission': 'manual',
'trim': 'BLUEHDI 130 FLAIR',
'vin': 'VF73DYHZPJJ807864',
'year': 2019}
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC19%2520ONF%27 HTTP/1.1" 200 None
2026-03-29 22:08:14 [bca.uk] INFO: Saving data for MC19%20ONF: {'auction_closing_time': 1774864800.0, 'created_time': 1774706939.336691, 'last_price_update_time': 1774822094.806108}
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MC19%2520ONF') HTTP/1.1" 204 0
2026-03-29 22:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619cdf50>
2026-03-29 22:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAP12HDL%252F699103834%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103834/600 saved to cache
2026-03-29 22:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21e79e5d-2d1b-56fe-b8fb-2067f25370f7
2026-03-29 22:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619ce510>
2026-03-29 22:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR60HNV%252F699146871%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146871/600 saved to cache
2026-03-29 22:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a63c92f-88a3-5364-8028-ccaa89112c46
2026-03-29 22:08:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a63c92f-88a3-5364-8028-ccaa89112c46, skipping ID generation
2026-03-29 22:08:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a63c92f-88a3-5364-8028-ccaa89112c46 sending to next pipeline
2026-03-29 22:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1a63c92f-88a3-5364-8028-ccaa89112c46, identifier: WR60%20HNV
2026-03-29 22:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac619cc450>
2026-03-29 22:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE56AOD%252F699430122%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430122/600 saved to cache
2026-03-29 22:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5674dd98-879a-5bc0-92a6-049abdc5f932
2026-03-29 22:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6197e490>
2026-03-29 22:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM09CVU%252F699124359%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124359/600 saved to cache
2026-03-29 22:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad76e9a4-0e7d-56af-9a84-3fd65281fde6
2026-03-29 22:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435115/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ58SFX/42812168?sv=2020-08-04&st=2026-03-29T22%3A06%3A32Z&se=2026-03-29T22%3A31%3A32Z&sr=b&sp=r&sig=qiTgzjDZ%2FB1Y9Jc9LI61o7EdjHjaU8RNz%2BEzvH34f2o%3D)
2026-03-29 22:08:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103826/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103826>
2026-03-29 22:08:15 [bca.uk] INFO: Found listing with ID: WP20%20GXG
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP20%2520GXG%27 HTTP/1.1" 200 None
2026-03-29 22:08:15 [bca.uk] INFO: Scrape type for WP20%20GXG: 2
2026-03-29 22:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f9db565-2af9-5a3f-b34f-bc261fd13a67 with identifier: WP20%20GXG
2026-03-29 22:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f9db565-2af9-5a3f-b34f-bc261fd13a67 with scrape type 2
2026-03-29 22:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f9db565-2af9-5a3f-b34f-bc261fd13a67 with scrape type 2
2026-03-29 22:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2f9db565-2af9-5a3f-b34f-bc261fd13a67, identifier: WP20%20GXG
2026-03-29 22:08:15 [bca.uk] INFO: Found listing with ID: WF20%20RYP
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF20%2520RYP%27 HTTP/1.1" 200 None
2026-03-29 22:08:15 [bca.uk] INFO: Scrape type for WF20%20RYP: 2
2026-03-29 22:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ca681d6-7a67-5d2d-a0c5-27df3db113a3 with identifier: WF20%20RYP
2026-03-29 22:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ca681d6-7a67-5d2d-a0c5-27df3db113a3 with scrape type 2
2026-03-29 22:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ca681d6-7a67-5d2d-a0c5-27df3db113a3 with scrape type 2
2026-03-29 22:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1ca681d6-7a67-5d2d-a0c5-27df3db113a3, identifier: WF20%20RYP
2026-03-29 22:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1a63c92f-88a3-5364-8028-ccaa89112c46 with identifier: WR60%20HNV
2026-03-29 22:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1a63c92f-88a3-5364-8028-ccaa89112c46 with identifier: WR60%20HNV
2026-03-29 22:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1a63c92f-88a3-5364-8028-ccaa89112c46 with identifier: WR60%20HNV to the API
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146871/600>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_expert_report_file_2d963a44-3fc3-4627-a4ec-0100048ccbce.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WR60%20HNV-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1a63c92f-88a3-5364-8028-ccaa89112c46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WR60 HNV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WR60%20HNV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'B180',
'odometer': 136633,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52777,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146871/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49325,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146881/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45736,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146888/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48736,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146896/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49415,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146901/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45711,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146908/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106850,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146921/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63044,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146934/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91719,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146948/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a63c92f-88a3-5364-8028-ccaa89112c46/1a63c92f-88a3-5364-8028-ccaa89112c46_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64532,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR60HNV/699146962/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ B180 2.0 CDI SPORT Hatchback',
'transmission': 'manual',
'trim': 'CDI SPORT',
'vin': 'WDD2452072J673106',
'year': 2011}
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR60%2520HNV%27 HTTP/1.1" 200 None
2026-03-29 22:08:15 [bca.uk] INFO: Saving data for WR60%20HNV: {'created_time': 1774822095.674751, 'last_price_update_time': 1774822095.674763, 'auction_closing_time': 1775210400.0}
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WR60%2520HNV') HTTP/1.1" 204 0
2026-03-29 22:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2f9db565-2af9-5a3f-b34f-bc261fd13a67 with identifier: WP20%20GXG
2026-03-29 22:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2f9db565-2af9-5a3f-b34f-bc261fd13a67 with identifier: WP20%20GXG
2026-03-29 22:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2f9db565-2af9-5a3f-b34f-bc261fd13a67 with identifier: WP20%20GXG to the API
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP20%20GXG-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2f9db565-2af9-5a3f-b34f-bc261fd13a67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WP20 GXG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WP20%20GXG&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VOLKSWAGEN',
'model': 'TIGUAN ALLSPACE',
'odometer': 62871,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN ALLSPACE 2.0 TDI SCR 150 2WD MATCH DSG '
'StationWagon',
'transmission': 'automatic',
'trim': 'TDI SCR 150 2WD MATCH DSG',
'vin': 'WVGZZZ5NZLM134919',
'year': 2020}
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP20%2520GXG%27 HTTP/1.1" 200 None
2026-03-29 22:08:16 [bca.uk] INFO: Saving data for WP20%20GXG: {'auction_closing_time': 1774864800.0, 'created_time': 1774621736.438024, 'last_price_update_time': 1774822096.07141}
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WP20%2520GXG') HTTP/1.1" 204 0
2026-03-29 22:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1ca681d6-7a67-5d2d-a0c5-27df3db113a3 with identifier: WF20%20RYP
2026-03-29 22:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1ca681d6-7a67-5d2d-a0c5-27df3db113a3 with identifier: WF20%20RYP
2026-03-29 22:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1ca681d6-7a67-5d2d-a0c5-27df3db113a3 with identifier: WF20%20RYP to the API
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 168,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WF20%20RYP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1ca681d6-7a67-5d2d-a0c5-27df3db113a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WF20 RYP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WF20%20RYP&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 46026,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN 1.5 TSI EVO 150 2WD SEL DSG StationWagon',
'transmission': 'automatic',
'trim': 'TSI EVO 150 2WD SEL DSG',
'vin': 'WVGZZZ5NZLW871108',
'year': 2020}
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF20%2520RYP%27 HTTP/1.1" 200 None
2026-03-29 22:08:16 [bca.uk] INFO: Saving data for WF20%20RYP: {'auction_closing_time': 1774864800.0, 'created_time': 1774706946.503548, 'last_price_update_time': 1774822096.358037}
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WF20%2520RYP') HTTP/1.1" 204 0
2026-03-29 22:08:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 22:08:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 22:08:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:08:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 22:08:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6158dcd0>
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE56AOD%252F699427714%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699427714/600 saved to cache
2026-03-29 22:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5674dd98-879a-5bc0-92a6-049abdc5f932
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6118c650>
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP66PGE%252F699139514%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139514/600 saved to cache
2026-03-29 22:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49025c6e-c82c-5ad9-a984-dc586f875105
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6179ed10>
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ08SVR%252F699430098%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430098/600 saved to cache
2026-03-29 22:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4de1def5-9fea-59aa-8472-dafc14cac3a1
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6331a550>
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ58SFX%252F699435122%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435122/600 saved to cache
2026-03-29 22:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5063d79c-4147-5ce9-b414-8b0ccabfea0d
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61051d10>
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAP12HDL%252F699103831%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103831/600 saved to cache
2026-03-29 22:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21e79e5d-2d1b-56fe-b8fb-2067f25370f7
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611a36d0>
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM09CVU%252F699124354%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124354/600 saved to cache
2026-03-29 22:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad76e9a4-0e7d-56af-9a84-3fd65281fde6
2026-03-29 22:08:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad76e9a4-0e7d-56af-9a84-3fd65281fde6, skipping ID generation
2026-03-29 22:08:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad76e9a4-0e7d-56af-9a84-3fd65281fde6 sending to next pipeline
2026-03-29 22:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ad76e9a4-0e7d-56af-9a84-3fd65281fde6, identifier: LM09%20CVU
2026-03-29 22:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430095/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ08SVR/42812103?sv=2020-08-04&st=2026-03-29T22%3A06%3A29Z&se=2026-03-29T22%3A31%3A29Z&sr=b&sp=r&sig=MlBD76Nciq6xfGWS8ogzePQWya6I7akYbscBXB2PpJI%3D)
2026-03-29 22:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139508/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP66PGE/42809943?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=WoZ%2FTTd8%2FUTJlWN%2B%2FNq0hoqMOCTHwgwo3OayCCjYYF0%3D)
2026-03-29 22:08:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430091/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PJ08SVR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:08:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103824/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699103824>
2026-03-29 22:08:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139502/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WP66PGE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:08:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430085/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DE56AOD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:08:16 [bca.uk] INFO: Found listing with ID: MT69%20XJO
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT69%2520XJO%27 HTTP/1.1" 200 None
2026-03-29 22:08:16 [bca.uk] INFO: Scrape type for MT69%20XJO: 2
2026-03-29 22:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 077175b3-5b3c-5809-a84a-d5bd71dee8fa with identifier: MT69%20XJO
2026-03-29 22:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 077175b3-5b3c-5809-a84a-d5bd71dee8fa with scrape type 2
2026-03-29 22:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 077175b3-5b3c-5809-a84a-d5bd71dee8fa with scrape type 2
2026-03-29 22:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 077175b3-5b3c-5809-a84a-d5bd71dee8fa, identifier: MT69%20XJO
2026-03-29 22:08:16 [bca.uk] INFO: Found listing with ID: WJ22%20OXH
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ22%2520OXH%27 HTTP/1.1" 200 None
2026-03-29 22:08:16 [bca.uk] INFO: Scrape type for WJ22%20OXH: 2
2026-03-29 22:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53a4e9e1-ee6b-549b-aea2-9b80871af97d with identifier: WJ22%20OXH
2026-03-29 22:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53a4e9e1-ee6b-549b-aea2-9b80871af97d with scrape type 2
2026-03-29 22:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53a4e9e1-ee6b-549b-aea2-9b80871af97d with scrape type 2
2026-03-29 22:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 53a4e9e1-ee6b-549b-aea2-9b80871af97d, identifier: WJ22%20OXH
2026-03-29 22:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ad76e9a4-0e7d-56af-9a84-3fd65281fde6 with identifier: LM09%20CVU
2026-03-29 22:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ad76e9a4-0e7d-56af-9a84-3fd65281fde6 with identifier: LM09%20CVU
2026-03-29 22:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ad76e9a4-0e7d-56af-9a84-3fd65281fde6 with identifier: LM09%20CVU to the API
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124354/600>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_expert_report_file_58441138-33b7-4ee8-8dd0-3dcd1a4d81e9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM09%20CVU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.8L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ad76e9a4-0e7d-56af-9a84-3fd65281fde6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM09 CVU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM09%20CVU&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'TIGRA',
'odometer': 89939,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48701,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124354/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46948,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124359/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45741,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124362/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46709,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124365/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44438,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124369/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44574,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124373/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120161,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124379/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77834,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124388/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95073,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124400/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad76e9a4-0e7d-56af-9a84-3fd65281fde6/ad76e9a4-0e7d-56af-9a84-3fd65281fde6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70341,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM09CVU/699124407/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VAUXHALL TIGRA 1.8 EXCLUSIV 16V C R Convertible',
'transmission': 'manual',
'trim': 'EXCLUSIV 16V C R',
'vin': 'W0L0XCR979E001862',
'year': 2009}
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM09%2520CVU%27 HTTP/1.1" 200 None
2026-03-29 22:08:17 [bca.uk] INFO: Saving data for LM09%20CVU: {'created_time': 1774822097.292832, 'last_price_update_time': 1774822097.292843, 'auction_closing_time': 1775210400.0}
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM09%2520CVU') HTTP/1.1" 204 0
2026-03-29 22:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 077175b3-5b3c-5809-a84a-d5bd71dee8fa with identifier: MT69%20XJO
2026-03-29 22:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 077175b3-5b3c-5809-a84a-d5bd71dee8fa with identifier: MT69%20XJO
2026-03-29 22:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 077175b3-5b3c-5809-a84a-d5bd71dee8fa with identifier: MT69%20XJO to the API
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT69%20XJO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '077175b3-5b3c-5809-a84a-d5bd71dee8fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT69 XJO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT69%20XJO&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 47413,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.0 IG-T 100 TEKNA Hatchback',
'transmission': 'manual',
'trim': 'IG-T 100 TEKNA',
'vin': 'VNVK1400863791120',
'year': 2019}
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT69%2520XJO%27 HTTP/1.1" 200 None
2026-03-29 22:08:17 [bca.uk] INFO: Saving data for MT69%20XJO: {'auction_closing_time': 1774864800.0, 'created_time': 1774391385.61558, 'last_price_update_time': 1774822097.611057}
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT69%2520XJO') HTTP/1.1" 204 0
2026-03-29 22:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 53a4e9e1-ee6b-549b-aea2-9b80871af97d with identifier: WJ22%20OXH
2026-03-29 22:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 53a4e9e1-ee6b-549b-aea2-9b80871af97d with identifier: WJ22%20OXH
2026-03-29 22:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 53a4e9e1-ee6b-549b-aea2-9b80871af97d with identifier: WJ22%20OXH to the API
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ22%20OXH-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '53a4e9e1-ee6b-549b-aea2-9b80871af97d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ22 OXH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ22%20OXH&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 57600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 TSI 95 LIFE Hatchback',
'transmission': 'manual',
'trim': 'TSI 95 LIFE',
'vin': 'WVWZZZAWZNU027054',
'year': 2022}
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ22%2520OXH%27 HTTP/1.1" 200 None
2026-03-29 22:08:17 [bca.uk] INFO: Saving data for WJ22%20OXH: {'auction_closing_time': 1774864800.0, 'created_time': 1774706946.929719, 'last_price_update_time': 1774822097.929989}
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ22%2520OXH') HTTP/1.1" 204 0
2026-03-29 22:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac60fc9b90>
2026-03-29 22:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ58SFX%252F699435115%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435115/600 saved to cache
2026-03-29 22:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5063d79c-4147-5ce9-b414-8b0ccabfea0d
2026-03-29 22:08:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5063d79c-4147-5ce9-b414-8b0ccabfea0d, skipping ID generation
2026-03-29 22:08:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5063d79c-4147-5ce9-b414-8b0ccabfea0d sending to next pipeline
2026-03-29 22:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5063d79c-4147-5ce9-b414-8b0ccabfea0d, identifier: NJ58%20SFX
2026-03-29 22:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430105/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE56AOD/42812125?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=jYNw1fNPOU4PCeqA8yT%2FgW%2F2lYqFTt1ML7YNy%2BQkkpE%3D)
2026-03-29 22:08:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103820/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AP12HDL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 22:08:18 [bca.uk] INFO: Found listing with ID: SW70%20EHR
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW70%2520EHR%27 HTTP/1.1" 200 None
2026-03-29 22:08:18 [bca.uk] INFO: Scrape type for SW70%20EHR: 0
2026-03-29 22:08:18 [bca.uk] INFO: Found listing with ID: PK70%20ULM
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK70%2520ULM%27 HTTP/1.1" 200 None
2026-03-29 22:08:18 [bca.uk] INFO: Scrape type for PK70%20ULM: 2
2026-03-29 22:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f00e19f0-99e9-5dc5-858f-2fe00b0b70a0 with identifier: PK70%20ULM
2026-03-29 22:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f00e19f0-99e9-5dc5-858f-2fe00b0b70a0 with scrape type 2
2026-03-29 22:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f00e19f0-99e9-5dc5-858f-2fe00b0b70a0 with scrape type 2
2026-03-29 22:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f00e19f0-99e9-5dc5-858f-2fe00b0b70a0, identifier: PK70%20ULM
2026-03-29 22:08:18 [bca.uk] INFO: Found listing with ID: FT19%20BHF
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT19%2520BHF%27 HTTP/1.1" 200 None
2026-03-29 22:08:18 [bca.uk] INFO: Scrape type for FT19%20BHF: 0
2026-03-29 22:08:18 [bca.uk] INFO: Found listing with ID: KT21%20LUH
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT21%2520LUH%27 HTTP/1.1" 200 None
2026-03-29 22:08:18 [bca.uk] INFO: Scrape type for KT21%20LUH: 2
2026-03-29 22:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0f73dcf-11ab-5c5f-8e62-eae10bfca806 with identifier: KT21%20LUH
2026-03-29 22:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0f73dcf-11ab-5c5f-8e62-eae10bfca806 with scrape type 2
2026-03-29 22:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0f73dcf-11ab-5c5f-8e62-eae10bfca806 with scrape type 2
2026-03-29 22:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d0f73dcf-11ab-5c5f-8e62-eae10bfca806, identifier: KT21%20LUH
2026-03-29 22:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5063d79c-4147-5ce9-b414-8b0ccabfea0d with identifier: NJ58%20SFX
2026-03-29 22:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5063d79c-4147-5ce9-b414-8b0ccabfea0d with identifier: NJ58%20SFX
2026-03-29 22:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5063d79c-4147-5ce9-b414-8b0ccabfea0d with identifier: NJ58%20SFX to the API
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435115/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_expert_report_file_8bfdc0c0-3c3b-495e-b0e7-235ac7cd5b0b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NJ58%20SFX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5063d79c-4147-5ce9-b414-8b0ccabfea0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NJ58 SFX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NJ58%20SFX&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 54454,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39344,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435115/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39135,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435122/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39141,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435134/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39596,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435142/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38892,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435148/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37927,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435152/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91494,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435161/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67571,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435168/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83259,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435175/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5063d79c-4147-5ce9-b414-8b0ccabfea0d/5063d79c-4147-5ce9-b414-8b0ccabfea0d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81469,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ58SFX/699435182/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 ZETEC CLIMATE Hatchback',
'transmission': 'manual',
'trim': 'ZETEC CLIMATE',
'vin': 'WF0HXXWPJH8D14066',
'year': 2008}
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ58%2520SFX%27 HTTP/1.1" 200 None
2026-03-29 22:08:18 [bca.uk] INFO: Saving data for NJ58%20SFX: {'created_time': 1774822098.676894, 'last_price_update_time': 1774822098.676904, 'auction_closing_time': 1774951200.0}
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NJ58%2520SFX') HTTP/1.1" 204 0
2026-03-29 22:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103826/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AP12HDL/42809882?sv=2020-08-04&st=2026-03-29T22%3A06%3A24Z&se=2026-03-29T22%3A31%3A24Z&sr=b&sp=r&sig=DviGem8rLk3txiS7kcWiSVUINF67ojRtTzL1ranpKKA%3D)
2026-03-29 22:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f00e19f0-99e9-5dc5-858f-2fe00b0b70a0 with identifier: PK70%20ULM
2026-03-29 22:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f00e19f0-99e9-5dc5-858f-2fe00b0b70a0 with identifier: PK70%20ULM
2026-03-29 22:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f00e19f0-99e9-5dc5-858f-2fe00b0b70a0 with identifier: PK70%20ULM to the API
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK70%20ULM-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f00e19f0-99e9-5dc5-858f-2fe00b0b70a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK70 ULM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PK70%20ULM&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FORD',
'model': 'PUMA',
'odometer': 21867,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FORD PUMA 1.0 E/B MHEV 125 ST-LINE X Hatchback',
'transmission': 'manual',
'trim': 'E/B MHEV 125 ST-LINE X',
'vin': 'WF02XXERK2LY04457',
'year': 2020}
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK70%2520ULM%27 HTTP/1.1" 200 None
2026-03-29 22:08:18 [bca.uk] INFO: Saving data for PK70%20ULM: {'auction_closing_time': 1774864800.0, 'created_time': 1774621735.691252, 'last_price_update_time': 1774822098.953064}
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PK70%2520ULM') HTTP/1.1" 204 0
2026-03-29 22:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d0f73dcf-11ab-5c5f-8e62-eae10bfca806 with identifier: KT21%20LUH
2026-03-29 22:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d0f73dcf-11ab-5c5f-8e62-eae10bfca806 with identifier: KT21%20LUH
2026-03-29 22:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d0f73dcf-11ab-5c5f-8e62-eae10bfca806 with identifier: KT21%20LUH to the API
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KT21%20LUH-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd0f73dcf-11ab-5c5f-8e62-eae10bfca806',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KT21 LUH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KT21%20LUH&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 43200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.2 P/T 130 ALLURE EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 ALLURE EAT8',
'vin': 'VF3MRHNSUMS124124',
'year': 2021}
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT21%2520LUH%27 HTTP/1.1" 200 None
2026-03-29 22:08:19 [bca.uk] INFO: Saving data for KT21%20LUH: {'auction_closing_time': 1774864800.0, 'created_time': 1774706947.352705, 'last_price_update_time': 1774822099.231756}
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KT21%2520LUH') HTTP/1.1" 204 0
2026-03-29 22:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac615f1d10>
2026-03-29 22:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ08SVR%252F699430095%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430095/600 saved to cache
2026-03-29 22:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4de1def5-9fea-59aa-8472-dafc14cac3a1
2026-03-29 22:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61705cd0>
2026-03-29 22:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP66PGE%252F699139508%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139508/600 saved to cache
2026-03-29 22:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49025c6e-c82c-5ad9-a984-dc586f875105
2026-03-29 22:08:19 [bca.uk] INFO: Total items found: 100
2026-03-29 22:08:19 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded
2026-03-29 22:08:19 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:08:19 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430091/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ08SVR/42812103?sv=2020-08-04&st=2026-03-29T22%3A06%3A29Z&se=2026-03-29T22%3A31%3A29Z&sr=b&sp=r&sig=MlBD76Nciq6xfGWS8ogzePQWya6I7akYbscBXB2PpJI%3D)
2026-03-29 22:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103824/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AP12HDL/42809882?sv=2020-08-04&st=2026-03-29T22%3A06%3A24Z&se=2026-03-29T22%3A31%3A24Z&sr=b&sp=r&sig=DviGem8rLk3txiS7kcWiSVUINF67ojRtTzL1ranpKKA%3D)
2026-03-29 22:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430085/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE56AOD/42812125?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=jYNw1fNPOU4PCeqA8yT%2FgW%2F2lYqFTt1ML7YNy%2BQkkpE%3D)
2026-03-29 22:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139502/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP66PGE/42809943?sv=2020-08-04&st=2026-03-29T22%3A06%3A28Z&se=2026-03-29T22%3A31%3A28Z&sr=b&sp=r&sig=WoZ%2FTTd8%2FUTJlWN%2B%2FNq0hoqMOCTHwgwo3OayCCjYYF0%3D)
2026-03-29 22:08:19 [bca.uk] INFO: Found listing with ID: YD20%20LRV
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD20%2520LRV%27 HTTP/1.1" 200 None
2026-03-29 22:08:19 [bca.uk] INFO: Scrape type for YD20%20LRV: 2
2026-03-29 22:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d5b8146-b8bd-5296-87ea-e6038cf022b0 with identifier: YD20%20LRV
2026-03-29 22:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d5b8146-b8bd-5296-87ea-e6038cf022b0 with scrape type 2
2026-03-29 22:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d5b8146-b8bd-5296-87ea-e6038cf022b0 with scrape type 2
2026-03-29 22:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7d5b8146-b8bd-5296-87ea-e6038cf022b0, identifier: YD20%20LRV
2026-03-29 22:08:19 [bca.uk] INFO: Found listing with ID: RE68%20RYC
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE68%2520RYC%27 HTTP/1.1" 200 None
2026-03-29 22:08:19 [bca.uk] INFO: Scrape type for RE68%20RYC: 0
2026-03-29 22:08:19 [bca.uk] INFO: Found listing with ID: WB19%20OHW
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WB19%2520OHW%27 HTTP/1.1" 200 None
2026-03-29 22:08:19 [bca.uk] INFO: Scrape type for WB19%20OHW: 0
2026-03-29 22:08:19 [bca.uk] INFO: Found listing with ID: WD19%20GOC
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD19%2520GOC%27 HTTP/1.1" 200 None
2026-03-29 22:08:19 [bca.uk] INFO: Scrape type for WD19%20GOC: 0
2026-03-29 22:08:19 [bca.uk] INFO: Found listing with ID: WL19%20LZJ
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WL19%2520LZJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:19 [bca.uk] INFO: Scrape type for WL19%20LZJ: 0
2026-03-29 22:08:19 [bca.uk] INFO: Found listing with ID: VO67%20OHE
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO67%2520OHE%27 HTTP/1.1" 200 None
2026-03-29 22:08:19 [bca.uk] INFO: Scrape type for VO67%20OHE: 0
2026-03-29 22:08:19 [bca.uk] INFO: Found listing with ID: WD66%20RGU
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD66%2520RGU%27 HTTP/1.1" 200 None
2026-03-29 22:08:19 [bca.uk] INFO: Scrape type for WD66%20RGU: 0
2026-03-29 22:08:19 [bca.uk] INFO: Found listing with ID: HD12%20PKZ
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD12%2520PKZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:19 [bca.uk] INFO: Scrape type for HD12%20PKZ: 0
2026-03-29 22:08:19 [bca.uk] INFO: Found listing with ID: YD21%20LKP
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD21%2520LKP%27 HTTP/1.1" 200 None
2026-03-29 22:08:19 [bca.uk] INFO: Scrape type for YD21%20LKP: 0
2026-03-29 22:08:19 [bca.uk] INFO: Found listing with ID: YD23%20UGZ
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD23%2520UGZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:19 [bca.uk] INFO: Scrape type for YD23%20UGZ: 2
2026-03-29 22:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 960f19bb-dfb5-5f6b-948a-0a87672b7695 with identifier: YD23%20UGZ
2026-03-29 22:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 960f19bb-dfb5-5f6b-948a-0a87672b7695 with scrape type 2
2026-03-29 22:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 960f19bb-dfb5-5f6b-948a-0a87672b7695 with scrape type 2
2026-03-29 22:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 960f19bb-dfb5-5f6b-948a-0a87672b7695, identifier: YD23%20UGZ
2026-03-29 22:08:19 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:19 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7d5b8146-b8bd-5296-87ea-e6038cf022b0 with identifier: YD20%20LRV
2026-03-29 22:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7d5b8146-b8bd-5296-87ea-e6038cf022b0 with identifier: YD20%20LRV
2026-03-29 22:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7d5b8146-b8bd-5296-87ea-e6038cf022b0 with identifier: YD20%20LRV to the API
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD20%20LRV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7d5b8146-b8bd-5296-87ea-e6038cf022b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD20 LRV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD20%20LRV&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 29676,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.0 DIG-T 115 TEKNA Hatchback',
'transmission': 'manual',
'trim': 'DIG-T 115 TEKNA',
'vin': 'SJNFAAF16U1031340',
'year': 2020}
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD20%2520LRV%27 HTTP/1.1" 200 None
2026-03-29 22:08:19 [bca.uk] INFO: Saving data for YD20%20LRV: {'auction_closing_time': 1774864800.0, 'created_time': 1774436747.279805, 'last_price_update_time': 1774822099.979268}
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD20%2520LRV') HTTP/1.1" 204 0
2026-03-29 22:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 960f19bb-dfb5-5f6b-948a-0a87672b7695 with identifier: YD23%20UGZ
2026-03-29 22:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 960f19bb-dfb5-5f6b-948a-0a87672b7695 with identifier: YD23%20UGZ
2026-03-29 22:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 960f19bb-dfb5-5f6b-948a-0a87672b7695 with identifier: YD23%20UGZ to the API
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD23%20UGZ-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '960f19bb-dfb5-5f6b-948a-0a87672b7695',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD23 UGZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD23%20UGZ&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'TOYOTA',
'model': 'AYGO X',
'odometer': 44183,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'TOYOTA AYGO X 1.0 VVT-I EXCLUSIVE Hatchback',
'transmission': 'manual',
'trim': 'VVT-I EXCLUSIVE',
'vin': 'JTDAGNAC800084249',
'year': 2023}
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD23%2520UGZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Saving data for YD23%20UGZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774622264.484324, 'last_price_update_time': 1774822100.348135}
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD23%2520UGZ') HTTP/1.1" 204 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: HT19%20DXO
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT19%2520DXO%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for HT19%20DXO: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: KY19%20BNC
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY19%2520BNC%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for KY19%20BNC: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: LD22%20EZW
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD22%2520EZW%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for LD22%20EZW: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: LT19%20JWW
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT19%2520JWW%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for LT19%20JWW: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: MA20%20EKM
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA20%2520EKM%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for MA20%20EKM: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: YR19%20AOV
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR19%2520AOV%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for YR19%20AOV: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: GD17%20MJV
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD17%2520MJV%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for GD17%20MJV: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: LO66%20UOC
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO66%2520UOC%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for LO66%20UOC: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: NH17%20THH
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NH17%2520THH%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for NH17%20THH: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: BV61%20MVO
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV61%2520MVO%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for BV61%20MVO: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: CK18%20AEJ
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520AEJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for CK18%20AEJ: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: KV59%20HZE
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV59%2520HZE%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for KV59%20HZE: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: KR71%20ZWG
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR71%2520ZWG%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for KR71%20ZWG: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: YH19%20PTV
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH19%2520PTV%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for YH19%20PTV: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: DV20%20CWA
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV20%2520CWA%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for DV20%20CWA: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: NK64%20UTR
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK64%2520UTR%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for NK64%20UTR: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: PXZ%201595
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PXZ%25201595%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for PXZ%201595: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: EP68%20EZZ
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP68%2520EZZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for EP68%20EZZ: 2
2026-03-29 22:08:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 216d8fd7-67c4-53f3-b310-c0712e88b8ef with identifier: EP68%20EZZ
2026-03-29 22:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 216d8fd7-67c4-53f3-b310-c0712e88b8ef with scrape type 2
2026-03-29 22:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 216d8fd7-67c4-53f3-b310-c0712e88b8ef with scrape type 2
2026-03-29 22:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 216d8fd7-67c4-53f3-b310-c0712e88b8ef, identifier: EP68%20EZZ
2026-03-29 22:08:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac6114a890>
2026-03-29 22:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE56AOD%252F699430105%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430105/600 saved to cache
2026-03-29 22:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5674dd98-879a-5bc0-92a6-049abdc5f932
2026-03-29 22:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103820/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AP12HDL/42809882?sv=2020-08-04&st=2026-03-29T22%3A06%3A24Z&se=2026-03-29T22%3A31%3A24Z&sr=b&sp=r&sig=DviGem8rLk3txiS7kcWiSVUINF67ojRtTzL1ranpKKA%3D)
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: DN20%20ENC
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN20%2520ENC%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for DN20%20ENC: 2
2026-03-29 22:08:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85b056c6-c0d6-5d9f-8894-629a1e21efb8 with identifier: DN20%20ENC
2026-03-29 22:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85b056c6-c0d6-5d9f-8894-629a1e21efb8 with scrape type 2
2026-03-29 22:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85b056c6-c0d6-5d9f-8894-629a1e21efb8 with scrape type 2
2026-03-29 22:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 85b056c6-c0d6-5d9f-8894-629a1e21efb8, identifier: DN20%20ENC
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: YH22%20LZX
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH22%2520LZX%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for YH22%20LZX: 0
2026-03-29 22:08:20 [bca.uk] INFO: Found listing with ID: V22%20VJW
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V22%2520VJW%27 HTTP/1.1" 200 None
2026-03-29 22:08:20 [bca.uk] INFO: Scrape type for V22%20VJW: 2
2026-03-29 22:08:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3298554-8cd4-55c7-aa23-1ce97a59ca38 with identifier: V22%20VJW
2026-03-29 22:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3298554-8cd4-55c7-aa23-1ce97a59ca38 with scrape type 2
2026-03-29 22:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3298554-8cd4-55c7-aa23-1ce97a59ca38 with scrape type 2
2026-03-29 22:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e3298554-8cd4-55c7-aa23-1ce97a59ca38, identifier: V22%20VJW
2026-03-29 22:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 216d8fd7-67c4-53f3-b310-c0712e88b8ef with identifier: EP68%20EZZ
2026-03-29 22:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 216d8fd7-67c4-53f3-b310-c0712e88b8ef with identifier: EP68%20EZZ
2026-03-29 22:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 216d8fd7-67c4-53f3-b310-c0712e88b8ef with identifier: EP68%20EZZ to the API
2026-03-29 22:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EP68%20EZZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '216d8fd7-67c4-53f3-b310-c0712e88b8ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EP68 EZZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EP68%20EZZ&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VOLKSWAGEN',
'model': 'T-ROC',
'odometer': 97772,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN T-ROC 1.6 TDI 115 R LINE Hatchback',
'transmission': 'manual',
'trim': 'TDI 115 R LINE',
'vin': 'WVGZZZA1ZKV049805',
'year': 2019}
2026-03-29 22:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP68%2520EZZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:21 [bca.uk] INFO: Saving data for EP68%20EZZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774622217.712253, 'last_price_update_time': 1774822101.368935}
2026-03-29 22:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EP68%2520EZZ') HTTP/1.1" 204 0
2026-03-29 22:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 85b056c6-c0d6-5d9f-8894-629a1e21efb8 with identifier: DN20%20ENC
2026-03-29 22:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 85b056c6-c0d6-5d9f-8894-629a1e21efb8 with identifier: DN20%20ENC
2026-03-29 22:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 85b056c6-c0d6-5d9f-8894-629a1e21efb8 with identifier: DN20%20ENC to the API
2026-03-29 22:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 196,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DN20%20ENC-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '85b056c6-c0d6-5d9f-8894-629a1e21efb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DN20 ENC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DN20%20ENC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 20919,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'NISSAN X-TRAIL 1.7 DCI 150 TEKNA (7ST) StationWagon',
'transmission': 'automatic',
'trim': 'DCI 150 TEKNA (7ST)',
'vin': 'JN1JHAT32U0021203',
'year': 2020}
2026-03-29 22:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN20%2520ENC%27 HTTP/1.1" 200 None
2026-03-29 22:08:21 [bca.uk] INFO: Saving data for DN20%20ENC: {'auction_closing_time': 1774864800.0, 'created_time': 1774735558.078619, 'last_price_update_time': 1774822101.750707}
2026-03-29 22:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DN20%2520ENC') HTTP/1.1" 204 0
2026-03-29 22:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e3298554-8cd4-55c7-aa23-1ce97a59ca38 with identifier: V22%20VJW
2026-03-29 22:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e3298554-8cd4-55c7-aa23-1ce97a59ca38 with identifier: V22%20VJW
2026-03-29 22:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e3298554-8cd4-55c7-aa23-1ce97a59ca38 with identifier: V22%20VJW to the API
2026-03-29 22:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 173,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=V22%20VJW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e3298554-8cd4-55c7-aa23-1ce97a59ca38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'V22 VJW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=V22%20VJW&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'JAGUAR',
'model': 'F-PACE',
'odometer': 24685,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'JAGUAR F-PACE 2.0 D200 AWD HSE StationWagon',
'transmission': 'automatic',
'trim': 'D200 AWD HSE',
'vin': 'SADCA2AN3MA674583',
'year': 2021}
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V22%2520VJW%27 HTTP/1.1" 200 None
2026-03-29 22:08:22 [bca.uk] INFO: Saving data for V22%20VJW: {'auction_closing_time': 1774864800.0, 'created_time': 1774436792.71785, 'last_price_update_time': 1774822102.036203}
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='V22%2520VJW') HTTP/1.1" 204 0
2026-03-29 22:08:22 [bca.uk] INFO: Found listing with ID: KW24%20UKR
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW24%2520UKR%27 HTTP/1.1" 200 None
2026-03-29 22:08:22 [bca.uk] INFO: Scrape type for KW24%20UKR: 0
2026-03-29 22:08:22 [bca.uk] INFO: Found listing with ID: MX69%20OBE
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX69%2520OBE%27 HTTP/1.1" 200 None
2026-03-29 22:08:22 [bca.uk] INFO: Scrape type for MX69%20OBE: 2
2026-03-29 22:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff2391ac-504f-5213-9c88-e226be959f67 with identifier: MX69%20OBE
2026-03-29 22:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff2391ac-504f-5213-9c88-e226be959f67 with scrape type 2
2026-03-29 22:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff2391ac-504f-5213-9c88-e226be959f67 with scrape type 2
2026-03-29 22:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ff2391ac-504f-5213-9c88-e226be959f67, identifier: MX69%20OBE
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac618f5e10>
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAP12HDL%252F699103826%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103826/600 saved to cache
2026-03-29 22:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21e79e5d-2d1b-56fe-b8fb-2067f25370f7
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac620bcf50>
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ08SVR%252F699430091%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430091/600 saved to cache
2026-03-29 22:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4de1def5-9fea-59aa-8472-dafc14cac3a1
2026-03-29 22:08:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4de1def5-9fea-59aa-8472-dafc14cac3a1, skipping ID generation
2026-03-29 22:08:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4de1def5-9fea-59aa-8472-dafc14cac3a1 sending to next pipeline
2026-03-29 22:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4de1def5-9fea-59aa-8472-dafc14cac3a1, identifier: PJ08%20SVR
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac69971990>
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAP12HDL%252F699103824%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103824/600 saved to cache
2026-03-29 22:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21e79e5d-2d1b-56fe-b8fb-2067f25370f7
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611a4510>
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE56AOD%252F699430085%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430085/600 saved to cache
2026-03-29 22:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5674dd98-879a-5bc0-92a6-049abdc5f932
2026-03-29 22:08:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5674dd98-879a-5bc0-92a6-049abdc5f932, skipping ID generation
2026-03-29 22:08:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5674dd98-879a-5bc0-92a6-049abdc5f932 sending to next pipeline
2026-03-29 22:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5674dd98-879a-5bc0-92a6-049abdc5f932, identifier: DE56%20AOD
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac611991d0>
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP66PGE%252F699139502%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139502/600 saved to cache
2026-03-29 22:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49025c6e-c82c-5ad9-a984-dc586f875105
2026-03-29 22:08:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49025c6e-c82c-5ad9-a984-dc586f875105, skipping ID generation
2026-03-29 22:08:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49025c6e-c82c-5ad9-a984-dc586f875105 sending to next pipeline
2026-03-29 22:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 49025c6e-c82c-5ad9-a984-dc586f875105, identifier: WP66%20PGE
2026-03-29 22:08:22 [bca.uk] INFO: Found listing with ID: EP68%20DWV
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP68%2520DWV%27 HTTP/1.1" 200 None
2026-03-29 22:08:22 [bca.uk] INFO: Scrape type for EP68%20DWV: 2
2026-03-29 22:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0 with identifier: EP68%20DWV
2026-03-29 22:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0 with scrape type 2
2026-03-29 22:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0 with scrape type 2
2026-03-29 22:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0, identifier: EP68%20DWV
2026-03-29 22:08:22 [bca.uk] INFO: Found listing with ID: YG70%20CMV
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG70%2520CMV%27 HTTP/1.1" 200 None
2026-03-29 22:08:22 [bca.uk] INFO: Scrape type for YG70%20CMV: 0
2026-03-29 22:08:22 [bca.uk] INFO: Found listing with ID: YM19%20HXY
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM19%2520HXY%27 HTTP/1.1" 200 None
2026-03-29 22:08:22 [bca.uk] INFO: Scrape type for YM19%20HXY: 0
2026-03-29 22:08:22 [bca.uk] INFO: Found listing with ID: YS71%20HNL
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS71%2520HNL%27 HTTP/1.1" 200 None
2026-03-29 22:08:22 [bca.uk] INFO: Scrape type for YS71%20HNL: 0
2026-03-29 22:08:22 [bca.uk] INFO: Found listing with ID: YD70%20WOM
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD70%2520WOM%27 HTTP/1.1" 200 None
2026-03-29 22:08:22 [bca.uk] INFO: Scrape type for YD70%20WOM: 0
2026-03-29 22:08:22 [bca.uk] INFO: Found listing with ID: YO66%20ENU
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YO66%2520ENU%27 HTTP/1.1" 200 None
2026-03-29 22:08:22 [bca.uk] INFO: Scrape type for YO66%20ENU: 0
2026-03-29 22:08:22 [bca.uk] INFO: Found listing with ID: MJ58%20UJC
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ58%2520UJC%27 HTTP/1.1" 200 None
2026-03-29 22:08:22 [bca.uk] INFO: Scrape type for MJ58%20UJC: 0
2026-03-29 22:08:22 [bca.uk] INFO: Found listing with ID: HV69%20NLA
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV69%2520NLA%27 HTTP/1.1" 200 None
2026-03-29 22:08:22 [bca.uk] INFO: Scrape type for HV69%20NLA: 0
2026-03-29 22:08:22 [bca.uk] INFO: Found listing with ID: ND19%20ZXL
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND19%2520ZXL%27 HTTP/1.1" 200 None
2026-03-29 22:08:22 [bca.uk] INFO: Scrape type for ND19%20ZXL: 0
2026-03-29 22:08:22 [bca.uk] INFO: Found listing with ID: HN73%20ZTC
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN73%2520ZTC%27 HTTP/1.1" 200 None
2026-03-29 22:08:22 [bca.uk] INFO: Scrape type for HN73%20ZTC: 2
2026-03-29 22:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ce1a042-8af4-558f-87af-e8588ce6cbe6 with identifier: HN73%20ZTC
2026-03-29 22:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ce1a042-8af4-558f-87af-e8588ce6cbe6 with scrape type 2
2026-03-29 22:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ce1a042-8af4-558f-87af-e8588ce6cbe6 with scrape type 2
2026-03-29 22:08:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5ce1a042-8af4-558f-87af-e8588ce6cbe6, identifier: HN73%20ZTC
2026-03-29 22:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ff2391ac-504f-5213-9c88-e226be959f67 with identifier: MX69%20OBE
2026-03-29 22:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ff2391ac-504f-5213-9c88-e226be959f67 with identifier: MX69%20OBE
2026-03-29 22:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ff2391ac-504f-5213-9c88-e226be959f67 with identifier: MX69%20OBE to the API
2026-03-29 22:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MX69%20OBE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ff2391ac-504f-5213-9c88-e226be959f67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MX69 OBE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MX69%20OBE&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'FIAT',
'model': '500',
'odometer': 15920,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 LOUNGE Hatchback',
'transmission': 'manual',
'trim': 'LOUNGE',
'vin': 'ZFA3120000JC19340',
'year': 2020}
2026-03-29 22:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX69%2520OBE%27 HTTP/1.1" 200 None
2026-03-29 22:08:23 [bca.uk] INFO: Saving data for MX69%20OBE: {'auction_closing_time': 1774864800.0, 'created_time': 1774621332.612769, 'last_price_update_time': 1774822103.317509}
2026-03-29 22:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MX69%2520OBE') HTTP/1.1" 204 0
2026-03-29 22:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4de1def5-9fea-59aa-8472-dafc14cac3a1 with identifier: PJ08%20SVR
2026-03-29 22:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4de1def5-9fea-59aa-8472-dafc14cac3a1 with identifier: PJ08%20SVR
2026-03-29 22:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4de1def5-9fea-59aa-8472-dafc14cac3a1 with identifier: PJ08%20SVR to the API
2026-03-29 22:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430091/600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_expert_report_file_da286475-434b-4545-8f8b-dd494f2a9a0b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ08%20SVR-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.3L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4de1def5-9fea-59aa-8472-dafc14cac3a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ08 SVR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ08%20SVR&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SUZUKI',
'model': 'SWIFT',
'odometer': 124926,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40471,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430091/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39203,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430095/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40449,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430098/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41349,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430136/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38518,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430171/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36038,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430193/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108353,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430227/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70345,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430255/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99852,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430284/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4de1def5-9fea-59aa-8472-dafc14cac3a1/4de1def5-9fea-59aa-8472-dafc14cac3a1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84183,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ08SVR/699430310/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'SUZUKI SWIFT 1.3 GL Hatchback',
'transmission': 'manual',
'trim': 'GL',
'vin': 'TSMMZA11S00560706',
'year': 2008}
2026-03-29 22:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ08%2520SVR%27 HTTP/1.1" 200 None
2026-03-29 22:08:23 [bca.uk] INFO: Saving data for PJ08%20SVR: {'created_time': 1774822103.81359, 'last_price_update_time': 1774822103.8136, 'auction_closing_time': 1774951200.0}
2026-03-29 22:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ08%2520SVR') HTTP/1.1" 204 0
2026-03-29 22:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5674dd98-879a-5bc0-92a6-049abdc5f932 with identifier: DE56%20AOD
2026-03-29 22:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5674dd98-879a-5bc0-92a6-049abdc5f932 with identifier: DE56%20AOD
2026-03-29 22:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5674dd98-879a-5bc0-92a6-049abdc5f932 with identifier: DE56%20AOD to the API
2026-03-29 22:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430085/600>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_expert_report_file_c429b8da-da45-4adc-87ad-bc8404376fbf.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE56%20AOD-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5674dd98-879a-5bc0-92a6-049abdc5f932',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DE56 AOD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DE56%20AOD&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'TOYOTA',
'model': 'AYGO',
'odometer': 78848,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37055,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430085/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37315,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430105/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54905,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699427714/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38419,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430122/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60417,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699427731/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430157/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61029,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699427769/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33073,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430178/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53136,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699427784/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5674dd98-879a-5bc0-92a6-049abdc5f932/5674dd98-879a-5bc0-92a6-049abdc5f932_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33936,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE56AOD/699430199/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'TOYOTA AYGO 1.0 VVT-I + Hatchback',
'transmission': 'manual',
'trim': 'VVT-I +',
'vin': 'JTDJG18C60N093873',
'year': 2006}
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE56%2520AOD%27 HTTP/1.1" 200 None
2026-03-29 22:08:24 [bca.uk] INFO: Saving data for DE56%20AOD: {'created_time': 1774822104.222895, 'last_price_update_time': 1774822104.222906, 'auction_closing_time': 1774951200.0}
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DE56%2520AOD') HTTP/1.1" 204 0
2026-03-29 22:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 49025c6e-c82c-5ad9-a984-dc586f875105 with identifier: WP66%20PGE
2026-03-29 22:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 49025c6e-c82c-5ad9-a984-dc586f875105 with identifier: WP66%20PGE
2026-03-29 22:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 49025c6e-c82c-5ad9-a984-dc586f875105 with identifier: WP66%20PGE to the API
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139502/600>
{'auction_title': '',
'c_o_2_emission_value': 93,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_expert_report_file_3920aafd-0ba9-48bf-b19a-6a01605b856d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP66%20PGE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Diesel',
'id': '49025c6e-c82c-5ad9-a984-dc586f875105',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WP66 PGE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WP66%20PGE&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 65493,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48226,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139502/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46194,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139508/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44721,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139514/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46217,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139522/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46940,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139527/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45364,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139535/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92768,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139551/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77558,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139564/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82648,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139576/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49025c6e-c82c-5ad9-a984-dc586f875105/49025c6e-c82c-5ad9-a984-dc586f875105_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70133,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP66PGE/699139586/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.4 TDI 90 R LINE Hatchback',
'transmission': 'manual',
'trim': 'TDI 90 R LINE',
'vin': 'WVWZZZ6RZHY120691',
'year': 2016}
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP66%2520PGE%27 HTTP/1.1" 200 None
2026-03-29 22:08:24 [bca.uk] INFO: Saving data for WP66%20PGE: {'created_time': 1774822104.597033, 'last_price_update_time': 1774822104.597044, 'auction_closing_time': 1775210400.0}
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WP66%2520PGE') HTTP/1.1" 204 0
2026-03-29 22:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0 with identifier: EP68%20DWV
2026-03-29 22:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0 with identifier: EP68%20DWV
2026-03-29 22:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0 with identifier: EP68%20DWV to the API
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EP68%20DWV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '75ce59cb-ab45-5b0a-ae1e-fd90c6a4bbf0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EP68 DWV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EP68%20DWV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'ECOSPORT',
'odometer': 14097,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD ECOSPORT 1.0 E/B 125 TITANIUM StationWagon',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF01XXERK1JG71135',
'year': 2019}
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP68%2520DWV%27 HTTP/1.1" 200 None
2026-03-29 22:08:24 [bca.uk] INFO: Saving data for EP68%20DWV: {'auction_closing_time': 1774864800.0, 'created_time': 1774735560.47573, 'last_price_update_time': 1774822104.892759}
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EP68%2520DWV') HTTP/1.1" 204 0
2026-03-29 22:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5ce1a042-8af4-558f-87af-e8588ce6cbe6 with identifier: HN73%20ZTC
2026-03-29 22:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5ce1a042-8af4-558f-87af-e8588ce6cbe6 with identifier: HN73%20ZTC
2026-03-29 22:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5ce1a042-8af4-558f-87af-e8588ce6cbe6 with identifier: HN73%20ZTC to the API
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HN73%20ZTC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5ce1a042-8af4-558f-87af-e8588ce6cbe6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HN73 ZTC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HN73%20ZTC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'PUMA',
'odometer': 15344,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'FORD PUMA 1.0 E/B MHEV 125 ST-LINE DCT Hatchback',
'transmission': 'automatic',
'trim': 'E/B MHEV 125 ST-LINE DCT',
'vin': 'WF02XXERK2PJ05327',
'year': 2023}
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN73%2520ZTC%27 HTTP/1.1" 200 None
2026-03-29 22:08:25 [bca.uk] INFO: Saving data for HN73%20ZTC: {'auction_closing_time': 1774864800.0, 'created_time': 1774436704.934744, 'last_price_update_time': 1774822105.204958}
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HN73%2520ZTC') HTTP/1.1" 204 0
2026-03-29 22:08:25 [bca.uk] INFO: Found listing with ID: ND18%20UAG
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND18%2520UAG%27 HTTP/1.1" 200 None
2026-03-29 22:08:25 [bca.uk] INFO: Scrape type for ND18%20UAG: 0
2026-03-29 22:08:25 [bca.uk] INFO: Found listing with ID: BT24%20NCX
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT24%2520NCX%27 HTTP/1.1" 200 None
2026-03-29 22:08:25 [bca.uk] INFO: Scrape type for BT24%20NCX: 2
2026-03-29 22:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c01b6733-a8dc-5f8a-839f-8e77c3caa19c with identifier: BT24%20NCX
2026-03-29 22:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c01b6733-a8dc-5f8a-839f-8e77c3caa19c with scrape type 2
2026-03-29 22:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c01b6733-a8dc-5f8a-839f-8e77c3caa19c with scrape type 2
2026-03-29 22:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c01b6733-a8dc-5f8a-839f-8e77c3caa19c, identifier: BT24%20NCX
2026-03-29 22:08:25 [bca.uk] INFO: Found listing with ID: FE70%20UFX
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE70%2520UFX%27 HTTP/1.1" 200 None
2026-03-29 22:08:25 [bca.uk] INFO: Scrape type for FE70%20UFX: 2
2026-03-29 22:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b with identifier: FE70%20UFX
2026-03-29 22:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b with scrape type 2
2026-03-29 22:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b with scrape type 2
2026-03-29 22:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b, identifier: FE70%20UFX
2026-03-29 22:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c01b6733-a8dc-5f8a-839f-8e77c3caa19c with identifier: BT24%20NCX
2026-03-29 22:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c01b6733-a8dc-5f8a-839f-8e77c3caa19c with identifier: BT24%20NCX
2026-03-29 22:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c01b6733-a8dc-5f8a-839f-8e77c3caa19c with identifier: BT24%20NCX to the API
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT24%20NCX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c01b6733-a8dc-5f8a-839f-8e77c3caa19c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BT24 NCX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BT24%20NCX&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'PEUGEOT',
'model': '408 FASTBACK',
'odometer': 41013,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 408 FASTBACK 1.2 P/T 130 GT EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 GT EAT8',
'vin': 'VR3FPHNSXRY530570',
'year': 2024}
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT24%2520NCX%27 HTTP/1.1" 200 None
2026-03-29 22:08:25 [bca.uk] INFO: Saving data for BT24%20NCX: {'auction_closing_time': 1774864800.0, 'created_time': 1774622219.564284, 'last_price_update_time': 1774822105.755269}
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BT24%2520NCX') HTTP/1.1" 204 0
2026-03-29 22:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 22:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fac61653d90>
2026-03-29 22:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 22:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAP12HDL%252F699103820%252F600') HTTP/1.1" 204 0
2026-03-29 22:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103820/600 saved to cache
2026-03-29 22:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21e79e5d-2d1b-56fe-b8fb-2067f25370f7
2026-03-29 22:08:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21e79e5d-2d1b-56fe-b8fb-2067f25370f7, skipping ID generation
2026-03-29 22:08:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21e79e5d-2d1b-56fe-b8fb-2067f25370f7 sending to next pipeline
2026-03-29 22:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 21e79e5d-2d1b-56fe-b8fb-2067f25370f7, identifier: AP12%20HDL
2026-03-29 22:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b with identifier: FE70%20UFX
2026-03-29 22:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b with identifier: FE70%20UFX
2026-03-29 22:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b with identifier: FE70%20UFX to the API
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE70%20UFX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'f216e666-7b3d-56cc-8e1f-cb4cc8e2bd7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FE70 UFX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FE70%20UFX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'TOYOTA',
'model': 'COROLLA',
'odometer': 41735,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'TOYOTA COROLLA 2.0 VVT-I 184 HYBRID GR-SPORT Hatchback',
'transmission': 'automatic',
'trim': 'VVT-I 184 HYBRID GR-SPORT',
'vin': 'SB1K53BEX0E053087',
'year': 2020}
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE70%2520UFX%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Saving data for FE70%20UFX: {'auction_closing_time': 1774864800.0, 'created_time': 1774735559.408309, 'last_price_update_time': 1774822106.170794}
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FE70%2520UFX') HTTP/1.1" 204 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: GJ70%20LXZ
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ70%2520LXZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for GJ70%20LXZ: 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: KJ70%20LJU
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ70%2520LJU%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for KJ70%20LJU: 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: KN70%20RHA
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN70%2520RHA%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for KN70%20RHA: 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: NU19%20CDX
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU19%2520CDX%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for NU19%20CDX: 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: SR19%20TNU
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520TNU%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for SR19%20TNU: 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: OW69%20BUU
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW69%2520BUU%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for OW69%20BUU: 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: LJ24%20UKC
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ24%2520UKC%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for LJ24%20UKC: 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: SA60%20NYT
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA60%2520NYT%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for SA60%20NYT: 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: LD57%20FXL
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD57%2520FXL%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for LD57%20FXL: 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: DA64%20AKP
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA64%2520AKP%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for DA64%20AKP: 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: ST12%20HSO
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST12%2520HSO%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for ST12%20HSO: 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: JP04%20STP
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JP04%2520STP%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for JP04%20STP: 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: HK20%20GFE
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK20%2520GFE%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for HK20%20GFE: 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: VF19%20GJU
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF19%2520GJU%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for VF19%20GJU: 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: BF17%20UCH
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF17%2520UCH%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for BF17%20UCH: 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: FM16%20JXO
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM16%2520JXO%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for FM16%20JXO: 0
2026-03-29 22:08:26 [bca.uk] INFO: Found listing with ID: WF67%20CFE
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF67%2520CFE%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Scrape type for WF67%20CFE: 2
2026-03-29 22:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 185851f3-337e-5447-9442-a811e9db65ca with identifier: WF67%20CFE
2026-03-29 22:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 185851f3-337e-5447-9442-a811e9db65ca with scrape type 2
2026-03-29 22:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 185851f3-337e-5447-9442-a811e9db65ca with scrape type 2
2026-03-29 22:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 185851f3-337e-5447-9442-a811e9db65ca, identifier: WF67%20CFE
2026-03-29 22:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 21e79e5d-2d1b-56fe-b8fb-2067f25370f7 with identifier: AP12%20HDL
2026-03-29 22:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 21e79e5d-2d1b-56fe-b8fb-2067f25370f7 with identifier: AP12%20HDL
2026-03-29 22:08:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 21e79e5d-2d1b-56fe-b8fb-2067f25370f7 with identifier: AP12%20HDL to the API
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103820/600>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_expert_report_file_f47a1264-67a3-4d55-b88b-7d3b12df3f95.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AP12%20HDL-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': '21e79e5d-2d1b-56fe-b8fb-2067f25370f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AP12 HDL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AP12%20HDL&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 122462,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49977,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103820/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46719,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103824/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48179,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103826/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50040,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103831/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45806,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103834/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41956,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103837/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100095,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103842/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66237,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103848/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94358,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103853/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21e79e5d-2d1b-56fe-b8fb-2067f25370f7/21e79e5d-2d1b-56fe-b8fb-2067f25370f7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64585,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AP12HDL/699103856/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.8 I-VTEC ES Hatchback',
'transmission': 'manual',
'trim': 'I-VTEC ES',
'vin': 'SHHFK2760CU018611',
'year': 2012}
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP12%2520HDL%27 HTTP/1.1" 200 None
2026-03-29 22:08:26 [bca.uk] INFO: Saving data for AP12%20HDL: {'created_time': 1774822106.913288, 'last_price_update_time': 1774822106.913298, 'auction_closing_time': 1775210400.0}
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AP12%2520HDL') HTTP/1.1" 204 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: HK21%20BWB
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK21%2520BWB%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for HK21%20BWB: 0
2026-03-29 22:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 185851f3-337e-5447-9442-a811e9db65ca with identifier: WF67%20CFE
2026-03-29 22:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 185851f3-337e-5447-9442-a811e9db65ca with identifier: WF67%20CFE
2026-03-29 22:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 185851f3-337e-5447-9442-a811e9db65ca with identifier: WF67%20CFE to the API
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WF67%20CFE-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '185851f3-337e-5447-9442-a811e9db65ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WF67 CFE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WF67%20CFE&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 71183,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 1.7 CRDI 2WD 3 ISG DCT StationWagon',
'transmission': 'automatic',
'trim': 'CRDI 2WD 3 ISG DCT',
'vin': 'U5YPH815VHL224674',
'year': 2017}
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF67%2520CFE%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Saving data for WF67%20CFE: {'auction_closing_time': 1774864800.0, 'created_time': 1774535614.348691, 'last_price_update_time': 1774822107.321607}
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WF67%2520CFE') HTTP/1.1" 204 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: FJ59%20TSZ
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ59%2520TSZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for FJ59%20TSZ: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: MV13%20TFX
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV13%2520TFX%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for MV13%20TFX: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: WG62%20AOC
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG62%2520AOC%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for WG62%20AOC: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: BT71%20ZWP
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT71%2520ZWP%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for BT71%20ZWP: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: CV23%20JXZ
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV23%2520JXZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for CV23%20JXZ: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: VA19%20TJU
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA19%2520TJU%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for VA19%20TJU: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: VN73%20XUO
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN73%2520XUO%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for VN73%20XUO: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: WK70%20VKG
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK70%2520VKG%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for WK70%20VKG: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: WG66%20DHY
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG66%2520DHY%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for WG66%20DHY: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: YK17%20ZRC
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK17%2520ZRC%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for YK17%20ZRC: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: EN14%20ZRU
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN14%2520ZRU%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for EN14%20ZRU: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: KP66%20FXV
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP66%2520FXV%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for KP66%20FXV: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: NU67%20NWA
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU67%2520NWA%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for NU67%20NWA: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: OY17%20FXG
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520FXG%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for OY17%20FXG: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: SGZ%206140
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SGZ%25206140%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for SGZ%206140: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: F6%20ENE
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27F6%2520ENE%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for F6%20ENE: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: SY63%20BZU
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY63%2520BZU%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for SY63%20BZU: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: WU10%20OBT
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU10%2520OBT%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for WU10%20OBT: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: YA08%20OVK
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA08%2520OVK%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for YA08%20OVK: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: FL59%20GYJ
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL59%2520GYJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for FL59%20GYJ: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: KR60%20ZHC
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR60%2520ZHC%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for KR60%20ZHC: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: KV61%20SXO
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV61%2520SXO%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for KV61%20SXO: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: MH07%20CHJ
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH07%2520CHJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for MH07%20CHJ: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: ND11%20FHJ
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND11%2520FHJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for ND11%20FHJ: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: T99%20NNO
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T99%2520NNO%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for T99%20NNO: 0
2026-03-29 22:08:27 [bca.uk] INFO: Found listing with ID: YK22%20XJW
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK22%2520XJW%27 HTTP/1.1" 200 None
2026-03-29 22:08:27 [bca.uk] INFO: Scrape type for YK22%20XJW: 2
2026-03-29 22:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49dcfd44-769e-5ad1-b132-2eaf8cf04ba9 with identifier: YK22%20XJW
2026-03-29 22:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49dcfd44-769e-5ad1-b132-2eaf8cf04ba9 with scrape type 2
2026-03-29 22:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49dcfd44-769e-5ad1-b132-2eaf8cf04ba9 with scrape type 2
2026-03-29 22:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 49dcfd44-769e-5ad1-b132-2eaf8cf04ba9, identifier: YK22%20XJW
2026-03-29 22:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 49dcfd44-769e-5ad1-b132-2eaf8cf04ba9 with identifier: YK22%20XJW
2026-03-29 22:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 49dcfd44-769e-5ad1-b132-2eaf8cf04ba9 with identifier: YK22%20XJW
2026-03-29 22:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 49dcfd44-769e-5ad1-b132-2eaf8cf04ba9 with identifier: YK22%20XJW to the API
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK22%20XJW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': '49dcfd44-769e-5ad1-b132-2eaf8cf04ba9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK22 XJW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK22%20XJW&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'JAGUAR',
'model': 'I-PACE',
'odometer': 86453,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'JAGUAR I-PACE EV400 BLACK (11KW) Hatchback',
'transmission': 'automatic',
'trim': 'EV400 BLACK (11KW)',
'vin': 'SADHA2A18N1622600',
'year': 2022}
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK22%2520XJW%27 HTTP/1.1" 200 None
2026-03-29 22:08:28 [bca.uk] INFO: Saving data for YK22%20XJW: {'auction_closing_time': 1774864800.0, 'created_time': 1774305696.221015, 'last_price_update_time': 1774822108.267738}
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK22%2520XJW') HTTP/1.1" 204 0
2026-03-29 22:08:28 [bca.uk] INFO: Found listing with ID: AD22%20HLK
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD22%2520HLK%27 HTTP/1.1" 200 None
2026-03-29 22:08:28 [bca.uk] INFO: Scrape type for AD22%20HLK: 0
2026-03-29 22:08:28 [bca.uk] INFO: Found listing with ID: AF20%20XAB
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF20%2520XAB%27 HTTP/1.1" 200 None
2026-03-29 22:08:28 [bca.uk] INFO: Scrape type for AF20%20XAB: 0
2026-03-29 22:08:28 [bca.uk] INFO: Found listing with ID: CF19%20EJU
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF19%2520EJU%27 HTTP/1.1" 200 None
2026-03-29 22:08:28 [bca.uk] INFO: Scrape type for CF19%20EJU: 0
2026-03-29 22:08:28 [bca.uk] INFO: Found listing with ID: DT21%20WNL
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT21%2520WNL%27 HTTP/1.1" 200 None
2026-03-29 22:08:28 [bca.uk] INFO: Scrape type for DT21%20WNL: 2
2026-03-29 22:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7caa27a-e904-5687-918d-db0ade173816 with identifier: DT21%20WNL
2026-03-29 22:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7caa27a-e904-5687-918d-db0ade173816 with scrape type 2
2026-03-29 22:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7caa27a-e904-5687-918d-db0ade173816 with scrape type 2
2026-03-29 22:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e7caa27a-e904-5687-918d-db0ade173816, identifier: DT21%20WNL
2026-03-29 22:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e7caa27a-e904-5687-918d-db0ade173816 with identifier: DT21%20WNL
2026-03-29 22:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e7caa27a-e904-5687-918d-db0ade173816 with identifier: DT21%20WNL
2026-03-29 22:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e7caa27a-e904-5687-918d-db0ade173816 with identifier: DT21%20WNL to the API
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DT21%20WNL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e7caa27a-e904-5687-918d-db0ade173816',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DT21 WNL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DT21%20WNL&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'VAUXHALL',
'model': 'CROSSLAND',
'odometer': 50089,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VAUXHALL CROSSLAND 1.2 TURBO 130 ELITE Hatchback',
'transmission': 'manual',
'trim': 'TURBO 130 ELITE',
'vin': 'W0V7H9EB2M4244453',
'year': 2021}
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT21%2520WNL%27 HTTP/1.1" 200 None
2026-03-29 22:08:28 [bca.uk] INFO: Saving data for DT21%20WNL: {'auction_closing_time': 1774864800.0, 'created_time': 1774535710.565719, 'last_price_update_time': 1774822108.785103}
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DT21%2520WNL') HTTP/1.1" 204 0
2026-03-29 22:08:28 [bca.uk] INFO: Found listing with ID: FM19%20TVL
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM19%2520TVL%27 HTTP/1.1" 200 None
2026-03-29 22:08:28 [bca.uk] INFO: Scrape type for FM19%20TVL: 2
2026-03-29 22:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0ae6479-d025-5018-8fa8-c188c15ae893 with identifier: FM19%20TVL
2026-03-29 22:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0ae6479-d025-5018-8fa8-c188c15ae893 with scrape type 2
2026-03-29 22:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0ae6479-d025-5018-8fa8-c188c15ae893 with scrape type 2
2026-03-29 22:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e0ae6479-d025-5018-8fa8-c188c15ae893, identifier: FM19%20TVL
2026-03-29 22:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e0ae6479-d025-5018-8fa8-c188c15ae893 with identifier: FM19%20TVL
2026-03-29 22:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e0ae6479-d025-5018-8fa8-c188c15ae893 with identifier: FM19%20TVL
2026-03-29 22:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e0ae6479-d025-5018-8fa8-c188c15ae893 with identifier: FM19%20TVL to the API
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 209,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FM19%20TVL-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e0ae6479-d025-5018-8fa8-c188c15ae893',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FM19 TVL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FM19%20TVL&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 70249,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 P400 HST StationWagon',
'transmission': 'automatic',
'trim': 'P400 HST',
'vin': 'SALWA2AU3LA876234',
'year': 2019}
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM19%2520TVL%27 HTTP/1.1" 200 None
2026-03-29 22:08:29 [bca.uk] INFO: Saving data for FM19%20TVL: {'auction_closing_time': 1774864800.0, 'created_time': 1773825972.127274, 'last_price_update_time': 1774822109.200058}
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FM19%2520TVL') HTTP/1.1" 204 0
2026-03-29 22:08:29 [bca.uk] INFO: Found listing with ID: GV19%20DVR
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV19%2520DVR%27 HTTP/1.1" 200 None
2026-03-29 22:08:29 [bca.uk] INFO: Scrape type for GV19%20DVR: 2
2026-03-29 22:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 070da218-d0ff-55d0-92a8-ca4c74d032c7 with identifier: GV19%20DVR
2026-03-29 22:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 070da218-d0ff-55d0-92a8-ca4c74d032c7 with scrape type 2
2026-03-29 22:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 070da218-d0ff-55d0-92a8-ca4c74d032c7 with scrape type 2
2026-03-29 22:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 070da218-d0ff-55d0-92a8-ca4c74d032c7, identifier: GV19%20DVR
2026-03-29 22:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 070da218-d0ff-55d0-92a8-ca4c74d032c7 with identifier: GV19%20DVR
2026-03-29 22:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 070da218-d0ff-55d0-92a8-ca4c74d032c7 with identifier: GV19%20DVR
2026-03-29 22:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 070da218-d0ff-55d0-92a8-ca4c74d032c7 with identifier: GV19%20DVR to the API
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GV19%20DVR-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '070da218-d0ff-55d0-92a8-ca4c74d032c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GV19 DVR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GV19%20DVR&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 95825,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'HYUNDAI TUCSON 1.6 CRDI 115 2WD PREMIUM StationWagon',
'transmission': 'manual',
'trim': 'CRDI 115 2WD PREMIUM',
'vin': 'TMAJ3817LKJ708464',
'year': 2019}
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV19%2520DVR%27 HTTP/1.1" 200 None
2026-03-29 22:08:29 [bca.uk] INFO: Saving data for GV19%20DVR: {'auction_closing_time': 1774864800.0, 'created_time': 1773831459.840177, 'last_price_update_time': 1774822109.66193}
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GV19%2520DVR') HTTP/1.1" 204 0
2026-03-29 22:08:29 [bca.uk] INFO: Found listing with ID: BD17%20TZF
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD17%2520TZF%27 HTTP/1.1" 200 None
2026-03-29 22:08:29 [bca.uk] INFO: Scrape type for BD17%20TZF: 0
2026-03-29 22:08:29 [bca.uk] INFO: Found listing with ID: CU18%20AXX
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU18%2520AXX%27 HTTP/1.1" 200 None
2026-03-29 22:08:29 [bca.uk] INFO: Scrape type for CU18%20AXX: 0
2026-03-29 22:08:29 [bca.uk] INFO: Found listing with ID: LK65%20VPG
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK65%2520VPG%27 HTTP/1.1" 200 None
2026-03-29 22:08:29 [bca.uk] INFO: Scrape type for LK65%20VPG: 0
2026-03-29 22:08:29 [bca.uk] INFO: Found listing with ID: NJ18%20YDM
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ18%2520YDM%27 HTTP/1.1" 200 None
2026-03-29 22:08:29 [bca.uk] INFO: Scrape type for NJ18%20YDM: 0
2026-03-29 22:08:29 [bca.uk] INFO: Found listing with ID: OV20%20KUN
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV20%2520KUN%27 HTTP/1.1" 200 None
2026-03-29 22:08:29 [bca.uk] INFO: Scrape type for OV20%20KUN: 2
2026-03-29 22:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8f89133-772c-5165-8c4c-abf7edd7b771 with identifier: OV20%20KUN
2026-03-29 22:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f89133-772c-5165-8c4c-abf7edd7b771 with scrape type 2
2026-03-29 22:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8f89133-772c-5165-8c4c-abf7edd7b771 with scrape type 2
2026-03-29 22:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e8f89133-772c-5165-8c4c-abf7edd7b771, identifier: OV20%20KUN
2026-03-29 22:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e8f89133-772c-5165-8c4c-abf7edd7b771 with identifier: OV20%20KUN
2026-03-29 22:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e8f89133-772c-5165-8c4c-abf7edd7b771 with identifier: OV20%20KUN
2026-03-29 22:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e8f89133-772c-5165-8c4c-abf7edd7b771 with identifier: OV20%20KUN to the API
2026-03-29 22:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 22:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 41,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV20%20KUN-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'e8f89133-772c-5165-8c4c-abf7edd7b771',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV20 KUN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV20%20KUN&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'BMW',
'model': 'X1',
'odometer': 107753,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'BMW X1 1.5 XDRIVE 25E X LINE StationWagon',
'transmission': 'automatic',
'trim': 'XDRIVE 25E X LINE',
'vin': 'WBA72AB0505R92826',
'year': 2020}
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV20%2520KUN%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Saving data for OV20%20KUN: {'auction_closing_time': 1774864800.0, 'created_time': 1774130640.81559, 'last_price_update_time': 1774822110.142741}
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV20%2520KUN') HTTP/1.1" 204 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: WD67%20HAX
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD67%2520HAX%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for WD67%20HAX: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: MP19%20OSZ
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520OSZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for MP19%20OSZ: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: RF21%20DKD
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF21%2520DKD%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for RF21%20DKD: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: VK22%20LGG
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK22%2520LGG%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for VK22%20LGG: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: YJ70%20TKD
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ70%2520TKD%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for YJ70%20TKD: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: MA62%20RAA
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA62%2520RAA%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for MA62%20RAA: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: K999%20ENP
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27K999%2520ENP%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for K999%20ENP: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: YN64%20VNE
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN64%2520VNE%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for YN64%20VNE: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: GG05%20AVG
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GG05%2520AVG%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for GG05%20AVG: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: S706%20NFV
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S706%2520NFV%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for S706%20NFV: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: GY19%20ZXT
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY19%2520ZXT%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for GY19%20ZXT: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: KM20%20ZZB
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM20%2520ZZB%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for KM20%20ZZB: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: BD19%20RBF
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD19%2520RBF%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for BD19%20RBF: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: CV66%20MDJ
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV66%2520MDJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for CV66%20MDJ: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: LA66%20CNU
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA66%2520CNU%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for LA66%20CNU: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: SP14%20YXM
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP14%2520YXM%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for SP14%20YXM: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: EX13%20SOH
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX13%2520SOH%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for EX13%20SOH: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: KU09%20AEA
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU09%2520AEA%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for KU09%20AEA: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: LD10%20VGG
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD10%2520VGG%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for LD10%20VGG: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: PK60%20UOG
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK60%2520UOG%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for PK60%20UOG: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: NA17%20GMZ
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA17%2520GMZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for NA17%20GMZ: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: YR07%20OWB
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR07%2520OWB%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for YR07%20OWB: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: AY61%20ZBP
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY61%2520ZBP%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for AY61%20ZBP: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: GD12%20LSU
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD12%2520LSU%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for GD12%20LSU: 0
2026-03-29 22:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:08:30 [bca.uk] INFO: Total items found: 100
2026-03-29 22:08:30 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=25&sort=MostRecentlyAdded
2026-03-29 22:08:30 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:08:30 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=25&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: KT09%20JOV
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT09%2520JOV%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for KT09%20JOV: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: LG61%20YWR
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG61%2520YWR%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for LG61%20YWR: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: LR53%20YBK
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR53%2520YBK%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for LR53%20YBK: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: LV10%20WSE
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV10%2520WSE%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for LV10%20WSE: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: PHZ%206637
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PHZ%25206637%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for PHZ%206637: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: VN09%20WSO
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN09%2520WSO%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for VN09%20WSO: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: VK21%20OFN
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK21%2520OFN%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for VK21%20OFN: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: GU22%20LDF
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU22%2520LDF%27 HTTP/1.1" 200 None
2026-03-29 22:08:30 [bca.uk] INFO: Scrape type for GU22%20LDF: 0
2026-03-29 22:08:30 [bca.uk] INFO: Found listing with ID: RV69%20YEC
2026-03-29 22:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV69%2520YEC%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for RV69%20YEC: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: CT15%20CRJ
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT15%2520CRJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for CT15%20CRJ: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: S20%20HNN
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S20%2520HNN%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for S20%20HNN: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: FN64%20RAU
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN64%2520RAU%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for FN64%20RAU: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: GL20%20MWO
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL20%2520MWO%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for GL20%20MWO: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: LC17%20UBN
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC17%2520UBN%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for LC17%20UBN: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: OW15%20FVZ
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW15%2520FVZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for OW15%20FVZ: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: LM62%20VCU
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM62%2520VCU%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for LM62%20VCU: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: EK63%20UCX
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520UCX%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for EK63%20UCX: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: BX69%20KFJ
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX69%2520KFJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for BX69%20KFJ: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: GU68%20KAX
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU68%2520KAX%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for GU68%20KAX: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: LJ68%20YWE
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ68%2520YWE%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for LJ68%20YWE: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: SC71%20KXX
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC71%2520KXX%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for SC71%20KXX: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: SP19%20KZX
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP19%2520KZX%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for SP19%20KZX: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: YK69%20PZB
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK69%2520PZB%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for YK69%20PZB: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: AB55%20WWW
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AB55%2520WWW%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for AB55%20WWW: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: PX72%20KYH
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX72%2520KYH%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for PX72%20KYH: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: OV14%20UEZ
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV14%2520UEZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for OV14%20UEZ: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: OY16%20UYX
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY16%2520UYX%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for OY16%20UYX: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: SJ17%20NRR
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ17%2520NRR%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for SJ17%20NRR: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: VK16%20KNM
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK16%2520KNM%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for VK16%20KNM: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: BF62%20JWL
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF62%2520JWL%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for BF62%20JWL: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: EF64%20PYO
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF64%2520PYO%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for EF64%20PYO: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: EX13%20UJA
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX13%2520UJA%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for EX13%20UJA: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: FY11%20SBZ
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY11%2520SBZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for FY11%20SBZ: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: OV09%20NOF
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV09%2520NOF%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for OV09%20NOF: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: WV20%20YFC
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV20%2520YFC%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for WV20%20YFC: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: AF14%20UDV
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF14%2520UDV%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for AF14%20UDV: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: BJ17%20OUK
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ17%2520OUK%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for BJ17%20OUK: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: NL15%20BYY
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL15%2520BYY%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for NL15%20BYY: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: YP13%20AUV
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP13%2520AUV%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for YP13%20AUV: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: KM14%20WMU
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM14%2520WMU%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for KM14%20WMU: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: SV70%20XPL
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV70%2520XPL%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for SV70%20XPL: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: FJ16%20NYD
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ16%2520NYD%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for FJ16%20NYD: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: FD19%20ARF
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD19%2520ARF%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for FD19%20ARF: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: KY59%20LSX
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY59%2520LSX%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for KY59%20LSX: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: BJ66%20YWK
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ66%2520YWK%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for BJ66%20YWK: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: LM60%20EUZ
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM60%2520EUZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for LM60%20EUZ: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: M500%20MDC
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M500%2520MDC%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for M500%20MDC: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: C7%20WRJ
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27C7%2520WRJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for C7%20WRJ: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: WV65%20EZL
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV65%2520EZL%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for WV65%20EZL: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: SA16%20NZY
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA16%2520NZY%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for SA16%20NZY: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: SP14%20TRV
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP14%2520TRV%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for SP14%20TRV: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: SK57%20HOJ
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK57%2520HOJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for SK57%20HOJ: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: SV12%20OCC
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV12%2520OCC%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for SV12%20OCC: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: NA14%20XFF
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA14%2520XFF%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for NA14%20XFF: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: GU66%20BFA
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU66%2520BFA%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for GU66%20BFA: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: MF19%20OFT
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF19%2520OFT%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for MF19%20OFT: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: SK18%20JKO
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK18%2520JKO%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for SK18%20JKO: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: SP70%20LPC
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP70%2520LPC%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for SP70%20LPC: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: KP65%20NNV
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP65%2520NNV%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for KP65%20NNV: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: PJ66%20LUT
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ66%2520LUT%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for PJ66%20LUT: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: LFZ%202518
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LFZ%25202518%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for LFZ%202518: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: SA10%20DVK
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA10%2520DVK%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for SA10%20DVK: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: A5%20VHE
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27A5%2520VHE%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for A5%20VHE: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: YK22%20RXB
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK22%2520RXB%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for YK22%20RXB: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: N88%20SFD
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27N88%2520SFD%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for N88%20SFD: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: WU57%20NZB
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU57%2520NZB%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for WU57%20NZB: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: GL58%20GUC
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL58%2520GUC%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for GL58%20GUC: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: AO71%20FNZ
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO71%2520FNZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for AO71%20FNZ: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: KS70%20JKZ
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS70%2520JKZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:31 [bca.uk] INFO: Scrape type for KS70%20JKZ: 0
2026-03-29 22:08:31 [bca.uk] INFO: Found listing with ID: KY72%20BKX
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY72%2520BKX%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for KY72%20BKX: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: RO18%20ZFF
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO18%2520ZFF%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for RO18%20ZFF: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: WG21%20DFZ
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG21%2520DFZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for WG21%20DFZ: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: EA64%20XMM
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA64%2520XMM%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for EA64%20XMM: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: EO72%20HNA
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO72%2520HNA%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for EO72%20HNA: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: EY04%20UCF
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY04%2520UCF%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for EY04%20UCF: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: KS69%20YXO
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520YXO%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for KS69%20YXO: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: PY66%20KMK
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY66%2520KMK%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for PY66%20KMK: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: WV20%20WDZ
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV20%2520WDZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for WV20%20WDZ: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: AGZ%204435
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AGZ%25204435%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for AGZ%204435: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: FP67%20BNL
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP67%2520BNL%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for FP67%20BNL: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: GJ16%20DHC
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ16%2520DHC%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for GJ16%20DHC: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: KP15%20OKE
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP15%2520OKE%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for KP15%20OKE: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: BK68%20ECE
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK68%2520ECE%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for BK68%20ECE: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: BP19%20TWZ
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP19%2520TWZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for BP19%20TWZ: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: SK72%20YTM
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK72%2520YTM%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for SK72%20YTM: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: EX13%20UKP
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX13%2520UKP%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for EX13%20UKP: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: FL15%20SDZ
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL15%2520SDZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for FL15%20SDZ: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: KJ18%20TUV
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ18%2520TUV%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for KJ18%20TUV: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: RK19%20KCU
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK19%2520KCU%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for RK19%20KCU: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: DU64%20UHM
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU64%2520UHM%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for DU64%20UHM: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: SP07%20GLF
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP07%2520GLF%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for SP07%20GLF: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: YA73%20ESV
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA73%2520ESV%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for YA73%20ESV: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: OY17%20FYS
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520FYS%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for OY17%20FYS: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: AK17%20YDS
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK17%2520YDS%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for AK17%20YDS: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: CF17%20BZG
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF17%2520BZG%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for CF17%20BZG: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: CV65%20ZBZ
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV65%2520ZBZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for CV65%20ZBZ: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: FA52%20BEL
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA52%2520BEL%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for FA52%20BEL: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: FE65%20VCD
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE65%2520VCD%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for FE65%20VCD: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: K40%20VNB
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27K40%2520VNB%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for K40%20VNB: 0
2026-03-29 22:08:32 [bca.uk] INFO: Found listing with ID: MF16%20GHO
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF16%2520GHO%27 HTTP/1.1" 200 None
2026-03-29 22:08:32 [bca.uk] INFO: Scrape type for MF16%20GHO: 0
2026-03-29 22:08:32 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=25&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:32 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=25&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=25&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:08:34 [bca.uk] INFO: Total items found: 100
2026-03-29 22:08:34 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=26&sort=MostRecentlyAdded
2026-03-29 22:08:34 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:08:34 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=26&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: HX05%20UJS
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX05%2520UJS%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for HX05%20UJS: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: KR09%20WWZ
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR09%2520WWZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for KR09%20WWZ: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: LG11%20BUP
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG11%2520BUP%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for LG11%20BUP: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: LT56%20FLZ
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT56%2520FLZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for LT56%20FLZ: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: SG11%20EMV
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG11%2520EMV%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for SG11%20EMV: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: BN07%20XHP
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN07%2520XHP%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for BN07%20XHP: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: FL60%20TTX
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL60%2520TTX%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for FL60%20TTX: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: KN09%20JZF
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN09%2520JZF%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for KN09%20JZF: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: WV59%20TZE
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV59%2520TZE%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for WV59%20TZE: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: VN67%20AUR
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN67%2520AUR%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for VN67%20AUR: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: AV56%20LPL
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV56%2520LPL%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for AV56%20LPL: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: RO63%20LZW
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO63%2520LZW%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for RO63%20LZW: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: FV17%20CRF
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV17%2520CRF%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for FV17%20CRF: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: PG68%20MPV
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PG68%2520MPV%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for PG68%20MPV: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: AK58%20VZY
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK58%2520VZY%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for AK58%20VZY: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: J17%20SDL
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J17%2520SDL%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for J17%20SDL: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: LW02%20GAV
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LW02%2520GAV%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for LW02%20GAV: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: YH62%20JFG
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH62%2520JFG%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for YH62%20JFG: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: RV57%20WUJ
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV57%2520WUJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for RV57%20WUJ: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: SV59%20YZL
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV59%2520YZL%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for SV59%20YZL: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: W22%20JED
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27W22%2520JED%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for W22%20JED: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: YR63%20WBM
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR63%2520WBM%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for YR63%20WBM: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: GN63%20YUK
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN63%2520YUK%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for GN63%20YUK: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: H9%20HBE
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27H9%2520HBE%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for H9%20HBE: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: HF13%20ONH
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF13%2520ONH%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for HF13%20ONH: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: KJ02%20AAA
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ02%2520AAA%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for KJ02%20AAA: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: KU07%20ERA
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU07%2520ERA%27 HTTP/1.1" 200 None
2026-03-29 22:08:34 [bca.uk] INFO: Scrape type for KU07%20ERA: 0
2026-03-29 22:08:34 [bca.uk] INFO: Found listing with ID: LT58%20VMH
2026-03-29 22:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT58%2520VMH%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for LT58%20VMH: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: LV10%20NJJ
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV10%2520NJJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for LV10%20NJJ: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: MC53%20GXE
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC53%2520GXE%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for MC53%20GXE: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: P60%20NPR
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P60%2520NPR%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for P60%20NPR: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: AN09%20KEE
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AN09%2520KEE%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for AN09%20KEE: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: BV13%20ZYW
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV13%2520ZYW%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for BV13%20ZYW: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: GR21%20HBF
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GR21%2520HBF%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for GR21%20HBF: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: DX70%20UBS
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX70%2520UBS%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for DX70%20UBS: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: EU19%20RWF
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU19%2520RWF%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for EU19%20RWF: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: FL20%20CPY
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL20%2520CPY%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for FL20%20CPY: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: HY06%20NAU
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY06%2520NAU%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for HY06%20NAU: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: LM17%20JWJ
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM17%2520JWJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for LM17%20JWJ: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: LX17%20OGL
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX17%2520OGL%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for LX17%20OGL: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: RK16%20MEU
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK16%2520MEU%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for RK16%20MEU: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: WL54%20NHF
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WL54%2520NHF%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for WL54%20NHF: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: WR11%20HHA
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR11%2520HHA%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for WR11%20HHA: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: YL17%20SVO
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL17%2520SVO%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for YL17%20SVO: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: HG09%20ZSN
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG09%2520ZSN%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for HG09%20ZSN: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: BX16%20DHC
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX16%2520DHC%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for BX16%20DHC: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: EA14%20EOC
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA14%2520EOC%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for EA14%20EOC: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: EF16%20EOM
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF16%2520EOM%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for EF16%20EOM: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: RF18%20ATV
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF18%2520ATV%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for RF18%20ATV: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: RV17%20VJG
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV17%2520VJG%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for RV17%20VJG: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: DX16%20UVK
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX16%2520UVK%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for DX16%20UVK: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: VK66%20VXB
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK66%2520VXB%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for VK66%20VXB: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: LY62%20DNF
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY62%2520DNF%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for LY62%20DNF: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: EY63%20WHH
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY63%2520WHH%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for EY63%20WHH: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: MF61%20FVN
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF61%2520FVN%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for MF61%20FVN: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: MT09%20FDX
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT09%2520FDX%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for MT09%20FDX: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: PK11%20ZFG
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK11%2520ZFG%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for PK11%20ZFG: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: RJ57%20KKY
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ57%2520KKY%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for RJ57%20KKY: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: SP08%20HWJ
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP08%2520HWJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for SP08%20HWJ: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: KW19%20WVM
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW19%2520WVM%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for KW19%20WVM: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: NY19%20XSW
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NY19%2520XSW%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for NY19%20XSW: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: OV20%20OKU
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV20%2520OKU%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for OV20%20OKU: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: FD21%20HBN
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD21%2520HBN%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for FD21%20HBN: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: DP21%20OWH
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP21%2520OWH%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for DP21%20OWH: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: WO18%20YOD
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO18%2520YOD%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for WO18%20YOD: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: PF66%20DZV
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF66%2520DZV%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for PF66%20DZV: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: BF65%20EKA
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF65%2520EKA%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for BF65%20EKA: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: DE15%20YKD
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE15%2520YKD%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for DE15%20YKD: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: KO17%20XBK
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO17%2520XBK%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for KO17%20XBK: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: LL14%20KEK
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL14%2520KEK%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for LL14%20KEK: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: MD16%20BFY
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD16%2520BFY%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for MD16%20BFY: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: VHZ%203476
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VHZ%25203476%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for VHZ%203476: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: YL67%20NGU
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL67%2520NGU%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for YL67%20NGU: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: SV21%20ZGG
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV21%2520ZGG%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for SV21%20ZGG: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: YP18%20HSO
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP18%2520HSO%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for YP18%20HSO: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: LF64%20ZKW
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF64%2520ZKW%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for LF64%20ZKW: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: SH16%20FAF
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH16%2520FAF%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for SH16%20FAF: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: SP17%20UUO
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP17%2520UUO%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for SP17%20UUO: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: YC17%20HBJ
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC17%2520HBJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for YC17%20HBJ: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: EY66%20AWF
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY66%2520AWF%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for EY66%20AWF: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: AV56%20FEX
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV56%2520FEX%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for AV56%20FEX: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: EK63%20ZDN
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520ZDN%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for EK63%20ZDN: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: GY61%20XPC
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY61%2520XPC%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for GY61%20XPC: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: LC16%20BCV
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC16%2520BCV%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for LC16%20BCV: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: LO13%20NYW
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO13%2520NYW%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for LO13%20NYW: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: ND21%20TWM
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND21%2520TWM%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for ND21%20TWM: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: OV62%20USF
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV62%2520USF%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for OV62%20USF: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: YR18%20HBP
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR18%2520HBP%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for YR18%20HBP: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: JE51%20XXE
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JE51%2520XXE%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for JE51%20XXE: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: BL62%20FPF
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL62%2520FPF%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for BL62%20FPF: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: OE67%20PUF
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE67%2520PUF%27 HTTP/1.1" 200 None
2026-03-29 22:08:35 [bca.uk] INFO: Scrape type for OE67%20PUF: 0
2026-03-29 22:08:35 [bca.uk] INFO: Found listing with ID: CK66%20VME
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK66%2520VME%27 HTTP/1.1" 200 None
2026-03-29 22:08:36 [bca.uk] INFO: Scrape type for CK66%20VME: 0
2026-03-29 22:08:36 [bca.uk] INFO: Found listing with ID: LD75%20EHO
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD75%2520EHO%27 HTTP/1.1" 200 None
2026-03-29 22:08:36 [bca.uk] INFO: Scrape type for LD75%20EHO: 0
2026-03-29 22:08:36 [bca.uk] INFO: Found listing with ID: BU74%20UXT
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU74%2520UXT%27 HTTP/1.1" 200 None
2026-03-29 22:08:36 [bca.uk] INFO: Scrape type for BU74%20UXT: 0
2026-03-29 22:08:36 [bca.uk] INFO: Found listing with ID: LD63%20HAU
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD63%2520HAU%27 HTTP/1.1" 200 None
2026-03-29 22:08:36 [bca.uk] INFO: Scrape type for LD63%20HAU: 0
2026-03-29 22:08:36 [bca.uk] INFO: Found listing with ID: AL11%20DAV
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AL11%2520DAV%27 HTTP/1.1" 200 None
2026-03-29 22:08:36 [bca.uk] INFO: Scrape type for AL11%20DAV: 0
2026-03-29 22:08:36 [bca.uk] INFO: Found listing with ID: LC13%20XXF
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC13%2520XXF%27 HTTP/1.1" 200 None
2026-03-29 22:08:36 [bca.uk] INFO: Scrape type for LC13%20XXF: 0
2026-03-29 22:08:36 [bca.uk] INFO: Found listing with ID: LR63%20VBU
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR63%2520VBU%27 HTTP/1.1" 200 None
2026-03-29 22:08:36 [bca.uk] INFO: Scrape type for LR63%20VBU: 0
2026-03-29 22:08:36 [bca.uk] INFO: Found listing with ID: L14%20RHU
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L14%2520RHU%27 HTTP/1.1" 200 None
2026-03-29 22:08:36 [bca.uk] INFO: Scrape type for L14%20RHU: 0
2026-03-29 22:08:36 [bca.uk] INFO: Found listing with ID: HK14%20ZDR
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK14%2520ZDR%27 HTTP/1.1" 200 None
2026-03-29 22:08:36 [bca.uk] INFO: Scrape type for HK14%20ZDR: 0
2026-03-29 22:08:36 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=26&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:36 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=26&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=26&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:08:38 [bca.uk] INFO: Total items found: 100
2026-03-29 22:08:38 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=27&sort=MostRecentlyAdded
2026-03-29 22:08:38 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:08:38 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=27&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:38 [bca.uk] INFO: Found listing with ID: MA68%20OAS
2026-03-29 22:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA68%2520OAS%27 HTTP/1.1" 200 None
2026-03-29 22:08:38 [bca.uk] INFO: Scrape type for MA68%20OAS: 0
2026-03-29 22:08:38 [bca.uk] INFO: Found listing with ID: YN18%20XLF
2026-03-29 22:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN18%2520XLF%27 HTTP/1.1" 200 None
2026-03-29 22:08:38 [bca.uk] INFO: Scrape type for YN18%20XLF: 0
2026-03-29 22:08:38 [bca.uk] INFO: Found listing with ID: OE23%20DFP
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE23%2520DFP%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for OE23%20DFP: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: KE71%20OYG
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE71%2520OYG%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for KE71%20OYG: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: GU23%20RCX
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU23%2520RCX%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for GU23%20RCX: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: KS67%20YMP
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS67%2520YMP%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for KS67%20YMP: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: LL21%20EHM
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL21%2520EHM%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for LL21%20EHM: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: RF68%20KUV
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF68%2520KUV%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for RF68%20KUV: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: RV18%20ZFG
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV18%2520ZFG%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for RV18%20ZFG: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: HW19%20NFU
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW19%2520NFU%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for HW19%20NFU: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: KR61%20ECC
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR61%2520ECC%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for KR61%20ECC: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: NV21%20YRL
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV21%2520YRL%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for NV21%20YRL: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: EN68%20PKU
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN68%2520PKU%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for EN68%20PKU: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: YF18%20DCZ
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF18%2520DCZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for YF18%20DCZ: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: NS16%20AHS
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NS16%2520AHS%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for NS16%20AHS: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: LT13%20WRU
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT13%2520WRU%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for LT13%20WRU: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: FY65%20BZP
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY65%2520BZP%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for FY65%20BZP: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: FX15%20VFY
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX15%2520VFY%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for FX15%20VFY: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: FM03%20CCZ
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM03%2520CCZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for FM03%20CCZ: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: FA17%20TWN
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA17%2520TWN%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for FA17%20TWN: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: WF66%20WCL
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF66%2520WCL%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for WF66%20WCL: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: PJ64%20LVP
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ64%2520LVP%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for PJ64%20LVP: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: KP69%20DTN
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP69%2520DTN%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for KP69%20DTN: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: KM14%20HWD
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM14%2520HWD%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for KM14%20HWD: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: DX65%20UOP
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX65%2520UOP%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for DX65%20UOP: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: BD13%20YCM
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD13%2520YCM%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for BD13%20YCM: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: SF69%20ZBX
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF69%2520ZBX%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for SF69%20ZBX: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: SD60%20OBV
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD60%2520OBV%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for SD60%20OBV: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: LR18%20TNX
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR18%2520TNX%27 HTTP/1.1" 200 None
2026-03-29 22:08:39 [bca.uk] INFO: Scrape type for LR18%20TNX: 0
2026-03-29 22:08:39 [bca.uk] INFO: Found listing with ID: GY69%20LZL
2026-03-29 22:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY69%2520LZL%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for GY69%20LZL: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: EY68%20NKD
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY68%2520NKD%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for EY68%20NKD: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: VA19%20XRY
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA19%2520XRY%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for VA19%20XRY: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: SD14%20UCC
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD14%2520UCC%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for SD14%20UCC: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: PL68%20ZCX
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL68%2520ZCX%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for PL68%20ZCX: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: PK14%20VAX
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK14%2520VAX%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for PK14%20VAX: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: PF65%20SSV
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF65%2520SSV%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for PF65%20SSV: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: NG13%20GKJ
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG13%2520GKJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for NG13%20GKJ: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: MF64%20ZPZ
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF64%2520ZPZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for MF64%20ZPZ: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: HW69%20EOS
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW69%2520EOS%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for HW69%20EOS: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: FP70%20XEN
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP70%2520XEN%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for FP70%20XEN: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: FJ16%20YOR
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ16%2520YOR%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for FJ16%20YOR: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: FD20%20CUW
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD20%2520CUW%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for FD20%20CUW: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: DN60%20UCJ
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN60%2520UCJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for DN60%20UCJ: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: BX19%20MWY
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX19%2520MWY%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for BX19%20MWY: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: BK64%20WXM
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK64%2520WXM%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for BK64%20WXM: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: YM19%20ZGY
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM19%2520ZGY%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for YM19%20ZGY: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: SV64%20UUP
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV64%2520UUP%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for SV64%20UUP: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: RX11%20HTV
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX11%2520HTV%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for RX11%20HTV: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: RA65%20EUT
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA65%2520EUT%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for RA65%20EUT: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: OV66%20ZBZ
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV66%2520ZBZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for OV66%20ZBZ: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: NK16%20EGE
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK16%2520EGE%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for NK16%20EGE: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: MT10%20XMZ
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT10%2520XMZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for MT10%20XMZ: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: LY16%20JJK
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY16%2520JJK%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for LY16%20JJK: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: LN09%20XAL
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN09%2520XAL%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for LN09%20XAL: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: LM12%20MLU
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM12%2520MLU%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for LM12%20MLU: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: HY16%20EOC
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY16%2520EOC%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for HY16%20EOC: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: HN08%20FLX
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN08%2520FLX%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for HN08%20FLX: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: EU15%20WHR
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU15%2520WHR%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for EU15%20WHR: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: EA66%20LNX
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA66%2520LNX%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for EA66%20LNX: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: EA10%20ODR
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA10%2520ODR%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for EA10%20ODR: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: CX71%20YVZ
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX71%2520YVZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for CX71%20YVZ: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: CV62%20SNJ
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV62%2520SNJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for CV62%20SNJ: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: CE53%20GKN
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE53%2520GKN%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for CE53%20GKN: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: BK16%20VKS
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK16%2520VKS%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for BK16%20VKS: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: AJ62%20YSE
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ62%2520YSE%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for AJ62%20YSE: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: AY57%20YXB
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY57%2520YXB%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for AY57%20YXB: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: AF69%20UFS
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF69%2520UFS%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for AF69%20UFS: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: WN09%20MYP
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN09%2520MYP%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for WN09%20MYP: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: PY61%20EWD
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY61%2520EWD%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for PY61%20EWD: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: MT61%20WPK
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT61%2520WPK%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for MT61%20WPK: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: EF66%20LFH
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF66%2520LFH%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for EF66%20LFH: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: AV18%20UVO
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV18%2520UVO%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for AV18%20UVO: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: AP13%20PNX
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP13%2520PNX%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for AP13%20PNX: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: GL20%20NXU
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL20%2520NXU%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for GL20%20NXU: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: OY12%20USJ
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY12%2520USJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for OY12%20USJ: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: LX12%20WRZ
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX12%2520WRZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for LX12%20WRZ: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: DA15%20GVJ
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA15%2520GVJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for DA15%20GVJ: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: MA18%20EAW
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA18%2520EAW%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for MA18%20EAW: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: WJ07%20XMW
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ07%2520XMW%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for WJ07%20XMW: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: TGZ%201807
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27TGZ%25201807%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for TGZ%201807: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: YJ66%20AAP
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ66%2520AAP%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for YJ66%20AAP: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: BN10%20OKD
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN10%2520OKD%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for BN10%20OKD: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: HY73%20KHK
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY73%2520KHK%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for HY73%20KHK: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: WG22%20GHY
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG22%2520GHY%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for WG22%20GHY: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: EN71%20UET
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN71%2520UET%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for EN71%20UET: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: GL71%20USX
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL71%2520USX%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for GL71%20USX: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: LF72%20EGY
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF72%2520EGY%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for LF72%20EGY: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: LG23%20XZX
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG23%2520XZX%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for LG23%20XZX: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: FL21%20VDZ
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL21%2520VDZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for FL21%20VDZ: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: K321%20PXX
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27K321%2520PXX%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for K321%20PXX: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: SB69%20LYC
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB69%2520LYC%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for SB69%20LYC: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: NC23%20XLD
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC23%2520XLD%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for NC23%20XLD: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: DU17%20AZG
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU17%2520AZG%27 HTTP/1.1" 200 None
2026-03-29 22:08:40 [bca.uk] INFO: Scrape type for DU17%20AZG: 0
2026-03-29 22:08:40 [bca.uk] INFO: Found listing with ID: X5%20GTD
2026-03-29 22:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X5%2520GTD%27 HTTP/1.1" 200 None
2026-03-29 22:08:41 [bca.uk] INFO: Scrape type for X5%20GTD: 0
2026-03-29 22:08:41 [bca.uk] INFO: Found listing with ID: CV64%20BKG
2026-03-29 22:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV64%2520BKG%27 HTTP/1.1" 200 None
2026-03-29 22:08:41 [bca.uk] INFO: Scrape type for CV64%20BKG: 0
2026-03-29 22:08:41 [bca.uk] INFO: Found listing with ID: SG17%20PZK
2026-03-29 22:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG17%2520PZK%27 HTTP/1.1" 200 None
2026-03-29 22:08:41 [bca.uk] INFO: Scrape type for SG17%20PZK: 0
2026-03-29 22:08:41 [bca.uk] INFO: Found listing with ID: YS67%20ATN
2026-03-29 22:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS67%2520ATN%27 HTTP/1.1" 200 None
2026-03-29 22:08:41 [bca.uk] INFO: Scrape type for YS67%20ATN: 0
2026-03-29 22:08:41 [bca.uk] INFO: Found listing with ID: VE17%20RTZ
2026-03-29 22:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE17%2520RTZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:41 [bca.uk] INFO: Scrape type for VE17%20RTZ: 0
2026-03-29 22:08:41 [bca.uk] INFO: Found listing with ID: SN63%20FMO
2026-03-29 22:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN63%2520FMO%27 HTTP/1.1" 200 None
2026-03-29 22:08:41 [bca.uk] INFO: Scrape type for SN63%20FMO: 0
2026-03-29 22:08:41 [bca.uk] INFO: Found listing with ID: SY63%20KOV
2026-03-29 22:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY63%2520KOV%27 HTTP/1.1" 200 None
2026-03-29 22:08:41 [bca.uk] INFO: Scrape type for SY63%20KOV: 0
2026-03-29 22:08:41 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=27&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:41 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=27&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=27&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:08:43 [bca.uk] INFO: Total items found: 100
2026-03-29 22:08:43 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=28&sort=MostRecentlyAdded
2026-03-29 22:08:43 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:08:43 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=28&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: SK70%20VVP
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK70%2520VVP%27 HTTP/1.1" 200 None
2026-03-29 22:08:43 [bca.uk] INFO: Scrape type for SK70%20VVP: 0
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: SR70%20FBU
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR70%2520FBU%27 HTTP/1.1" 200 None
2026-03-29 22:08:43 [bca.uk] INFO: Scrape type for SR70%20FBU: 0
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: FD66%20JYF
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD66%2520JYF%27 HTTP/1.1" 200 None
2026-03-29 22:08:43 [bca.uk] INFO: Scrape type for FD66%20JYF: 0
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: L8%20ULV
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L8%2520ULV%27 HTTP/1.1" 200 None
2026-03-29 22:08:43 [bca.uk] INFO: Scrape type for L8%20ULV: 0
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: LL12%20SVJ
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL12%2520SVJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:43 [bca.uk] INFO: Scrape type for LL12%20SVJ: 0
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: SL12%20ADV
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL12%2520ADV%27 HTTP/1.1" 200 None
2026-03-29 22:08:43 [bca.uk] INFO: Scrape type for SL12%20ADV: 0
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: GJ67%20OET
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ67%2520OET%27 HTTP/1.1" 200 None
2026-03-29 22:08:43 [bca.uk] INFO: Scrape type for GJ67%20OET: 0
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: SL66%20WTO
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL66%2520WTO%27 HTTP/1.1" 200 None
2026-03-29 22:08:43 [bca.uk] INFO: Scrape type for SL66%20WTO: 0
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: EJ02%20EGU
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ02%2520EGU%27 HTTP/1.1" 200 None
2026-03-29 22:08:43 [bca.uk] INFO: Scrape type for EJ02%20EGU: 0
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: YC10%20PAO
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC10%2520PAO%27 HTTP/1.1" 200 None
2026-03-29 22:08:43 [bca.uk] INFO: Scrape type for YC10%20PAO: 0
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: OV22%20RZK
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV22%2520RZK%27 HTTP/1.1" 200 None
2026-03-29 22:08:43 [bca.uk] INFO: Scrape type for OV22%20RZK: 0
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: WN20%20RBX
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN20%2520RBX%27 HTTP/1.1" 200 None
2026-03-29 22:08:43 [bca.uk] INFO: Scrape type for WN20%20RBX: 0
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: OF07%20ELF
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OF07%2520ELF%27 HTTP/1.1" 200 None
2026-03-29 22:08:43 [bca.uk] INFO: Scrape type for OF07%20ELF: 0
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: EK16%20AKU
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK16%2520AKU%27 HTTP/1.1" 200 None
2026-03-29 22:08:43 [bca.uk] INFO: Scrape type for EK16%20AKU: 0
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: RA65%20VLP
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA65%2520VLP%27 HTTP/1.1" 200 None
2026-03-29 22:08:43 [bca.uk] INFO: Scrape type for RA65%20VLP: 0
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: ST14%20JVM
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST14%2520JVM%27 HTTP/1.1" 200 None
2026-03-29 22:08:43 [bca.uk] INFO: Scrape type for ST14%20JVM: 0
2026-03-29 22:08:43 [bca.uk] INFO: Found listing with ID: CT59%20HCD
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT59%2520HCD%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for CT59%20HCD: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: EG11%20AZX
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EG11%2520AZX%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for EG11%20AZX: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: OV17%20YPT
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV17%2520YPT%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for OV17%20YPT: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: BK07%20WOX
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK07%2520WOX%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for BK07%20WOX: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: SC23%20WCG
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC23%2520WCG%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for SC23%20WCG: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: WA21%20MYD
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA21%2520MYD%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for WA21%20MYD: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: WF22%20CPZ
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF22%2520CPZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for WF22%20CPZ: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: CE24%20ONH
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE24%2520ONH%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for CE24%20ONH: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: WA66%20WEK
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA66%2520WEK%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for WA66%20WEK: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: WO21%20BSX
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO21%2520BSX%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for WO21%20BSX: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: X576%20NUB
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X576%2520NUB%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for X576%20NUB: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: AE02%20ETE
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE02%2520ETE%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for AE02%20ETE: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: KM65%20UHD
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM65%2520UHD%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for KM65%20UHD: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: NY11%20YZP
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NY11%2520YZP%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for NY11%20YZP: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: EA11%20ULT
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA11%2520ULT%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for EA11%20ULT: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: OU52%20XKA
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU52%2520XKA%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for OU52%20XKA: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: PJ09%20HHE
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ09%2520HHE%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for PJ09%20HHE: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: YF21%20WVG
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF21%2520WVG%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for YF21%20WVG: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: HK25%20XAY
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK25%2520XAY%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for HK25%20XAY: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: KK24%20AEF
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK24%2520AEF%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for KK24%20AEF: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: NA70%20XYD
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA70%2520XYD%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for NA70%20XYD: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: YN64%20XMG
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN64%2520XMG%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for YN64%20XMG: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: HPKD81239
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HPKD81239%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for HPKD81239: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: CV09%20TWA
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV09%2520TWA%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for CV09%20TWA: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: FY10%20BNJ
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY10%2520BNJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for FY10%20BNJ: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: MF73%20FAO
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF73%2520FAO%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for MF73%20FAO: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: SP22%20OEE
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP22%2520OEE%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for SP22%20OEE: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: BW21%20DTN
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW21%2520DTN%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for BW21%20DTN: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: MD15%20XGB
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD15%2520XGB%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for MD15%20XGB: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: GV70%20RNA
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV70%2520RNA%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for GV70%20RNA: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: YS69%20EYY
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS69%2520EYY%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for YS69%20EYY: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: DA18%20EDK
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA18%2520EDK%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for DA18%20EDK: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: KR17%20WGP
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR17%2520WGP%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for KR17%20WGP: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: L10%20CLU
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L10%2520CLU%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for L10%20CLU: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: ML12%20ODX
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML12%2520ODX%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for ML12%20ODX: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: PN15%20EZH
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN15%2520EZH%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for PN15%20EZH: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: RX03%20AFU
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX03%2520AFU%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for RX03%20AFU: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: X188%20XCL
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X188%2520XCL%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for X188%20XCL: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: YM21%20TYH
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM21%2520TYH%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for YM21%20TYH: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: CP15%20POA
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP15%2520POA%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for CP15%20POA: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: YS69%20FCC
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS69%2520FCC%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for YS69%20FCC: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: DU22%20SVN
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU22%2520SVN%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for DU22%20SVN: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: GF18%20RFX
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF18%2520RFX%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for GF18%20RFX: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: LB68%20TVJ
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB68%2520TVJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for LB68%20TVJ: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: LG21%20HCM
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG21%2520HCM%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for LG21%20HCM: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: VK71%20GFX
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK71%2520GFX%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for VK71%20GFX: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: BD69%20XXF
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD69%2520XXF%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for BD69%20XXF: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: FG21%20MFN
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG21%2520MFN%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for FG21%20MFN: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: YG69%20LWF
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG69%2520LWF%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for YG69%20LWF: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: BD21%20GWA
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD21%2520GWA%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for BD21%20GWA: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: CP22%20GYW
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP22%2520GYW%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for CP22%20GYW: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: AD18%20GWP
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD18%2520GWP%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for AD18%20GWP: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: EU68%20NEJ
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU68%2520NEJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for EU68%20NEJ: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: DA72%20RSU
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA72%2520RSU%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for DA72%20RSU: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: GD18%20CFO
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD18%2520CFO%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for GD18%20CFO: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: MJ69%20AHZ
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ69%2520AHZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for MJ69%20AHZ: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: MJ69%20KSF
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ69%2520KSF%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for MJ69%20KSF: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: PJ20%20EKU
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ20%2520EKU%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for PJ20%20EKU: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: BP68%20KXF
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP68%2520KXF%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for BP68%20KXF: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: CE68%20OKN
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE68%2520OKN%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for CE68%20OKN: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: DA72%20OGE
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA72%2520OGE%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for DA72%20OGE: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: DU19%20VFP
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU19%2520VFP%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for DU19%20VFP: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: FX20%20RVN
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX20%2520RVN%27 HTTP/1.1" 200 None
2026-03-29 22:08:44 [bca.uk] INFO: Scrape type for FX20%20RVN: 0
2026-03-29 22:08:44 [bca.uk] INFO: Found listing with ID: SW69%20HAX
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW69%2520HAX%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for SW69%20HAX: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: EK72%20OTR
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK72%2520OTR%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for EK72%20OTR: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: LB24%20EUL
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB24%2520EUL%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for LB24%20EUL: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: NV21%20KXR
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV21%2520KXR%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for NV21%20KXR: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: Y27%20JJL
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y27%2520JJL%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for Y27%20JJL: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: AU19%20UPB
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU19%2520UPB%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for AU19%20UPB: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: KW70%20FUH
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW70%2520FUH%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for KW70%20FUH: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: SX19%20UXH
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SX19%2520UXH%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for SX19%20UXH: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: YS22%20UBT
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS22%2520UBT%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for YS22%20UBT: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: KJ19%20WBM
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520WBM%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for KJ19%20WBM: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: KV71%20AEO
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV71%2520AEO%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for KV71%20AEO: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: NV19%20UBR
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV19%2520UBR%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for NV19%20UBR: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: RV68%20LBX
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV68%2520LBX%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for RV68%20LBX: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: AO70%20ZYL
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO70%2520ZYL%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for AO70%20ZYL: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: AV72%20FBL
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV72%2520FBL%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for AV72%20FBL: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: AVI%205715
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AVI%25205715%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for AVI%205715: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: DS21%20XOB
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS21%2520XOB%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for DS21%20XOB: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: GF22%20CZO
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF22%2520CZO%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for GF22%20CZO: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: GJ23%20MRO
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ23%2520MRO%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for GJ23%20MRO: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: GV69%20PSU
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV69%2520PSU%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for GV69%20PSU: 0
2026-03-29 22:08:45 [bca.uk] INFO: Found listing with ID: GX71%20XBS
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX71%2520XBS%27 HTTP/1.1" 200 None
2026-03-29 22:08:45 [bca.uk] INFO: Scrape type for GX71%20XBS: 0
2026-03-29 22:08:45 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=28&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:45 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=28&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=28&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:08:47 [bca.uk] INFO: Total items found: 100
2026-03-29 22:08:47 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=29&sort=MostRecentlyAdded
2026-03-29 22:08:47 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:08:47 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=29&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: KJ19%20MZZ
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520MZZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for KJ19%20MZZ: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: AK69%20OPY
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK69%2520OPY%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for AK69%20OPY: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: CV18%20FNN
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV18%2520FNN%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for CV18%20FNN: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: NA69%20ZFR
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA69%2520ZFR%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for NA69%20ZFR: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: NM21%20OBX
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NM21%2520OBX%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for NM21%20OBX: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: SK70%20YOM
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK70%2520YOM%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for SK70%20YOM: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: BG19%20WNV
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG19%2520WNV%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for BG19%20WNV: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: WN19%20VBY
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN19%2520VBY%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for WN19%20VBY: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: KP22%20FWN
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP22%2520FWN%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for KP22%20FWN: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: YM70%20LGV
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM70%2520LGV%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for YM70%20LGV: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: ST72%20HCC
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST72%2520HCC%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for ST72%20HCC: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: BK70%20LBZ
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK70%2520LBZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for BK70%20LBZ: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: FE72%20GRU
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE72%2520GRU%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for FE72%20GRU: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: FG19%20LHD
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG19%2520LHD%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for FG19%20LHD: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: FL70%20SXN
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL70%2520SXN%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for FL70%20SXN: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: GX69%20EEM
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX69%2520EEM%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for GX69%20EEM: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: SD18%20HLO
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD18%2520HLO%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for SD18%20HLO: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: AE23%20RSO
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE23%2520RSO%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for AE23%20RSO: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: AO71%20KYW
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO71%2520KYW%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for AO71%20KYW: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: AX19%20VDY
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX19%2520VDY%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for AX19%20VDY: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: BG22%20JMV
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG22%2520JMV%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for BG22%20JMV: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: BJ23%20DSV
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ23%2520DSV%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for BJ23%20DSV: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: BK22%20FCG
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK22%2520FCG%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for BK22%20FCG: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: BP73%20OOG
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP73%2520OOG%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for BP73%20OOG: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: CE19%20CEK
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE19%2520CEK%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for CE19%20CEK: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: DP22%20TKE
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP22%2520TKE%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for DP22%20TKE: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: DS19%20NSN
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS19%2520NSN%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for DS19%20NSN: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: DS71%20EAY
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS71%2520EAY%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for DS71%20EAY: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: EA23%20BKN
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA23%2520BKN%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for EA23%20BKN: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: EY22%20KYZ
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY22%2520KYZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for EY22%20KYZ: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: FJ22%20YBP
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ22%2520YBP%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for FJ22%20YBP: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: GN70%20XMW
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN70%2520XMW%27 HTTP/1.1" 200 None
2026-03-29 22:08:47 [bca.uk] INFO: Scrape type for GN70%20XMW: 0
2026-03-29 22:08:47 [bca.uk] INFO: Found listing with ID: HD22%20GPZ
2026-03-29 22:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD22%2520GPZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for HD22%20GPZ: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: J4%20JYG
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J4%2520JYG%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for J4%20JYG: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: JR09%20HOG
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JR09%2520HOG%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for JR09%20HOG: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: KS69%20YCG
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520YCG%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for KS69%20YCG: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: LA71%20YYO
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA71%2520YYO%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for LA71%20YYO: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: LC22%20EAY
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC22%2520EAY%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for LC22%20EAY: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: LL22%20MGO
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL22%2520MGO%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for LL22%20MGO: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: LV22%20KXJ
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV22%2520KXJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for LV22%20KXJ: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: NC22%20CZK
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC22%2520CZK%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for NC22%20CZK: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: NX72%20PHY
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX72%2520PHY%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for NX72%20PHY: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: PX22%20ZKE
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX22%2520ZKE%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for PX22%20ZKE: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: PY67%20LKC
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY67%2520LKC%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for PY67%20LKC: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: RA15%20RYY
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA15%2520RYY%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for RA15%20RYY: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: RJ72%20VOD
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ72%2520VOD%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for RJ72%20VOD: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: SA21%20KZD
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA21%2520KZD%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for SA21%20KZD: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: SD71%20YFN
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD71%2520YFN%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for SD71%20YFN: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: SR23%20NZS
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR23%2520NZS%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for SR23%20NZS: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: ST09%20ARY
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST09%2520ARY%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for ST09%20ARY: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: ST18%20RTO
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST18%2520RTO%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for ST18%20RTO: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: SX22%20GDU
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SX22%2520GDU%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for SX22%20GDU: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: VX72%20WWK
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX72%2520WWK%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for VX72%20WWK: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: WK70%20HVS
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK70%2520HVS%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for WK70%20HVS: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: WU21%20EHW
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU21%2520EHW%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for WU21%20EHW: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: WU68%20BGK
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU68%2520BGK%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for WU68%20BGK: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: WX22%20ZVD
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX22%2520ZVD%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for WX22%20ZVD: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: WX73%20YZA
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX73%2520YZA%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for WX73%20YZA: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: YK21%20VRC
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK21%2520VRC%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for YK21%20VRC: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: YL70%20NVC
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL70%2520NVC%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for YL70%20NVC: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: YN22%20WKM
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN22%2520WKM%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for YN22%20WKM: 0
2026-03-29 22:08:48 [bca.uk] INFO: Found listing with ID: YN23%20WUP
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN23%2520WUP%27 HTTP/1.1" 200 None
2026-03-29 22:08:48 [bca.uk] INFO: Scrape type for YN23%20WUP: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: YR22%20XOF
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR22%2520XOF%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for YR22%20XOF: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: YR69%20ZVN
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR69%2520ZVN%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for YR69%20ZVN: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: AV18%20LLP
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV18%2520LLP%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for AV18%20LLP: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: RO21%20VFW
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO21%2520VFW%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for RO21%20VFW: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: SW69%20SCX
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW69%2520SCX%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for SW69%20SCX: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: CP17%20DYG
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP17%2520DYG%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for CP17%20DYG: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: EJ17%20HGU
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ17%2520HGU%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for EJ17%20HGU: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: MT17%20UTS
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT17%2520UTS%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for MT17%20UTS: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: CX65%20XUD
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX65%2520XUD%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for CX65%20XUD: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: LN68%20FBD
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN68%2520FBD%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for LN68%20FBD: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: FV21%20VKU
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV21%2520VKU%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for FV21%20VKU: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: MF22%20KJU
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF22%2520KJU%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for MF22%20KJU: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: RJ18%20ZHN
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ18%2520ZHN%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for RJ18%20ZHN: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: BT66%20ZFD
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT66%2520ZFD%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for BT66%20ZFD: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: BX20%20FKV
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX20%2520FKV%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for BX20%20FKV: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: MT14%20TZF
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT14%2520TZF%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for MT14%20TZF: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: SM70%20ZWE
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM70%2520ZWE%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for SM70%20ZWE: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: FE20%20HHJ
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE20%2520HHJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for FE20%20HHJ: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: DU20%20XWW
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU20%2520XWW%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for DU20%20XWW: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: GN70%20OTT
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN70%2520OTT%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for GN70%20OTT: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: YB19%20EOM
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB19%2520EOM%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for YB19%20EOM: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: YG21%20HVH
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG21%2520HVH%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for YG21%20HVH: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: BJ22%20OGX
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ22%2520OGX%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for BJ22%20OGX: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: RA19%20XWL
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA19%2520XWL%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for RA19%20XWL: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: SY19%20CEJ
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY19%2520CEJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for SY19%20CEJ: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: DY64%20YTD
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY64%2520YTD%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for DY64%20YTD: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: ML69%20KTJ
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML69%2520KTJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for ML69%20KTJ: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: NU21%20PFD
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU21%2520PFD%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for NU21%20PFD: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: OV69%20OAL
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV69%2520OAL%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for OV69%20OAL: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: OW17%20RHY
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW17%2520RHY%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for OW17%20RHY: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: WF68%20WGC
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF68%2520WGC%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for WF68%20WGC: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: YE67%20OPH
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE67%2520OPH%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for YE67%20OPH: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: LL18%20OTM
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL18%2520OTM%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for LL18%20OTM: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: LX16%20CNU
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX16%2520CNU%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for LX16%20CNU: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: OW17%20PUO
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW17%2520PUO%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for OW17%20PUO: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: RK66%20MLE
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK66%2520MLE%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for RK66%20MLE: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: SC19%20RJJ
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC19%2520RJJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for SC19%20RJJ: 0
2026-03-29 22:08:49 [bca.uk] INFO: Found listing with ID: FL24%20MXK
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL24%2520MXK%27 HTTP/1.1" 200 None
2026-03-29 22:08:49 [bca.uk] INFO: Scrape type for FL24%20MXK: 0
2026-03-29 22:08:49 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=29&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:49 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=29&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=29&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:08:52 [bca.uk] INFO: Total items found: 100
2026-03-29 22:08:52 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=30&sort=MostRecentlyAdded
2026-03-29 22:08:52 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:08:52 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=30&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: KP21%20EYJ
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP21%2520EYJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for KP21%20EYJ: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: R16%20RRX
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27R16%2520RRX%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for R16%20RRX: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: YH64%20HNO
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH64%2520HNO%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for YH64%20HNO: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: YC25%20ZFZ
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC25%2520ZFZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for YC25%20ZFZ: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: AF73%20EOV
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF73%2520EOV%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for AF73%20EOV: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: AF73%20FEJ
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF73%2520FEJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for AF73%20FEJ: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: BC74%20HHL
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC74%2520HHL%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for BC74%20HHL: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: BG24%20XXM
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG24%2520XXM%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for BG24%20XXM: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: BK24%20ZKV
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK24%2520ZKV%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for BK24%20ZKV: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: BL73%20ZKG
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL73%2520ZKG%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for BL73%20ZKG: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: BP73%20HWG
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP73%2520HWG%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for BP73%20HWG: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: BP73%20KDO
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP73%2520KDO%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for BP73%20KDO: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: BT23%20XZC
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT23%2520XZC%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for BT23%20XZC: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: BW74%20DWK
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW74%2520DWK%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for BW74%20DWK: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: CF74%20PHA
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF74%2520PHA%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for CF74%20PHA: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: CF74%20PJJ
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF74%2520PJJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for CF74%20PJJ: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: DL73%20LCP
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL73%2520LCP%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for DL73%20LCP: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: DL73%20LSZ
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL73%2520LSZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for DL73%20LSZ: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: DN24%20UWB
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN24%2520UWB%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for DN24%20UWB: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: DN70%20KGO
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN70%2520KGO%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for DN70%20KGO: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: DV24%20BZA
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV24%2520BZA%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for DV24%20BZA: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: DX71%20AAF
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX71%2520AAF%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for DX71%20AAF: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: DY74%20BVW
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY74%2520BVW%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for DY74%20BVW: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: FD72%20URU
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD72%2520URU%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for FD72%20URU: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: FX19%20KVO
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX19%2520KVO%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for FX19%20KVO: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: GF23%20UCB
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF23%2520UCB%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for GF23%20UCB: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: GY24%20CFU
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY24%2520CFU%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for GY24%20CFU: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: HK73%20JYE
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK73%2520JYE%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for HK73%20JYE: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: KF73%20CNX
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF73%2520CNX%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for KF73%20CNX: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: KJ19%20XCZ
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520XCZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for KJ19%20XCZ: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: KJ23%20NNB
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ23%2520NNB%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for KJ23%20NNB: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: KW24%20FNA
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW24%2520FNA%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for KW24%20FNA: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: KY19%20TNM
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY19%2520TNM%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for KY19%20TNM: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: LG20%20CFV
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG20%2520CFV%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for LG20%20CFV: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: LG24%20ZDK
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG24%2520ZDK%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for LG24%20ZDK: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: LL74%20DHM
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL74%2520DHM%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for LL74%20DHM: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: LN24%20RKU
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN24%2520RKU%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for LN24%20RKU: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: LS24%20EMK
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS24%2520EMK%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for LS24%20EMK: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: LS24%20VUX
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS24%2520VUX%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for LS24%20VUX: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: MD74%20GXE
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD74%2520GXE%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for MD74%20GXE: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: MH24%20ZDS
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH24%2520ZDS%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for MH24%20ZDS: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: ML74%20XNN
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML74%2520XNN%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for ML74%20XNN: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: MW23%20BYZ
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW23%2520BYZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for MW23%20BYZ: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: MW23%20LSZ
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW23%2520LSZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for MW23%20LSZ: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: OU72%20LYV
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU72%2520LYV%27 HTTP/1.1" 200 None
2026-03-29 22:08:52 [bca.uk] INFO: Scrape type for OU72%20LYV: 0
2026-03-29 22:08:52 [bca.uk] INFO: Found listing with ID: SA69%20XVY
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA69%2520XVY%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for SA69%20XVY: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: SC69%20XMR
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC69%2520XMR%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for SC69%20XMR: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: SD73%20CPU
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD73%2520CPU%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for SD73%20CPU: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: SG69%20WDL
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG69%2520WDL%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for SG69%20WDL: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: SG71%20YGU
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG71%2520YGU%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for SG71%20YGU: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: VK24%20NBM
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK24%2520NBM%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for VK24%20NBM: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: WD74%20ECW
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD74%2520ECW%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for WD74%20ECW: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: WN74%20JZX
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN74%2520JZX%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for WN74%20JZX: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: WN74%20OBX
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN74%2520OBX%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for WN74%20OBX: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: WR74%20XCX
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR74%2520XCX%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for WR74%20XCX: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: YF23%20UOG
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF23%2520UOG%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for YF23%20UOG: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: YJ73%20WSK
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ73%2520WSK%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for YJ73%20WSK: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: YJ73%20WUU
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ73%2520WUU%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for YJ73%20WUU: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: YM22%20GWY
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM22%2520GWY%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for YM22%20GWY: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: YY73%20UHG
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520UHG%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for YY73%20UHG: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: YY73%20UHP
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520UHP%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for YY73%20UHP: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: YY73%20XEX
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520XEX%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for YY73%20XEX: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: YY73%20XFS
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520XFS%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for YY73%20XFS: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: YY73%20XHE
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520XHE%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for YY73%20XHE: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: EK73%20WBT
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK73%2520WBT%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for EK73%20WBT: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: CV18%20ZGK
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV18%2520ZGK%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for CV18%20ZGK: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: LM63%20VTK
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM63%2520VTK%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for LM63%20VTK: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: KP69%20EZC
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP69%2520EZC%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for KP69%20EZC: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: LM58%20ZKW
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM58%2520ZKW%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for LM58%20ZKW: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: ND66%20WXW
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND66%2520WXW%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for ND66%20WXW: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: PE15%20XVX
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE15%2520XVX%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for PE15%20XVX: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: BJ68%20DAO
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ68%2520DAO%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for BJ68%20DAO: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: BN70%20UTW
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN70%2520UTW%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for BN70%20UTW: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: DF67%20WXX
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF67%2520WXX%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for DF67%20WXX: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: EO68%20OSM
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO68%2520OSM%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for EO68%20OSM: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: GM17%20BGK
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM17%2520BGK%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for GM17%20BGK: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: KO67%20BZU
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO67%2520BZU%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for KO67%20BZU: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: KS69%20AUH
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520AUH%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for KS69%20AUH: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: LO66%20AAU
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO66%2520AAU%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for LO66%20AAU: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: MF71%20ZHD
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF71%2520ZHD%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for MF71%20ZHD: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: MW70%20BVB
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW70%2520BVB%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for MW70%20BVB: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: OY17%20KRU
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520KRU%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for OY17%20KRU: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: OY17%20SPZ
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520SPZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for OY17%20SPZ: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: OY66%20YSS
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY66%2520YSS%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for OY66%20YSS: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: RO72%20MAE
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO72%2520MAE%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for RO72%20MAE: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: DS65%20OCU
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS65%2520OCU%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for DS65%20OCU: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: FE67%20JCX
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE67%2520JCX%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for FE67%20JCX: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: HT68%20ERK
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT68%2520ERK%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for HT68%20ERK: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: KU65%20DZH
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU65%2520DZH%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for KU65%20DZH: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: SB12%20AFZ
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB12%2520AFZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for SB12%20AFZ: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: SB64%20HJV
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB64%2520HJV%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for SB64%20HJV: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: CJ19%20GAA
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CJ19%2520GAA%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for CJ19%20GAA: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: SB19%20OJD
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB19%2520OJD%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for SB19%20OJD: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: EK22%20EKC
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK22%2520EKC%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for EK22%20EKC: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: GD69%20YNC
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD69%2520YNC%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for GD69%20YNC: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: GSZ%206855
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GSZ%25206855%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for GSZ%206855: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: LL69%20HKX
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL69%2520HKX%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for LL69%20HKX: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: LR72%20YRF
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR72%2520YRF%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for LR72%20YRF: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: EF72%20YJG
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF72%2520YJG%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for EF72%20YJG: 0
2026-03-29 22:08:53 [bca.uk] INFO: Found listing with ID: LY16%20SWW
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY16%2520SWW%27 HTTP/1.1" 200 None
2026-03-29 22:08:53 [bca.uk] INFO: Scrape type for LY16%20SWW: 0
2026-03-29 22:08:53 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=30&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:53 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=30&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=30&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:08:55 [bca.uk] INFO: Total items found: 100
2026-03-29 22:08:55 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=31&sort=MostRecentlyAdded
2026-03-29 22:08:55 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:08:55 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=31&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:55 [bca.uk] INFO: Found listing with ID: LT14%20MTK
2026-03-29 22:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT14%2520MTK%27 HTTP/1.1" 200 None
2026-03-29 22:08:55 [bca.uk] INFO: Scrape type for LT14%20MTK: 0
2026-03-29 22:08:55 [bca.uk] INFO: Found listing with ID: MV18%20ZXU
2026-03-29 22:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV18%2520ZXU%27 HTTP/1.1" 200 None
2026-03-29 22:08:55 [bca.uk] INFO: Scrape type for MV18%20ZXU: 0
2026-03-29 22:08:55 [bca.uk] INFO: Found listing with ID: SY24%20KFV
2026-03-29 22:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY24%2520KFV%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for SY24%20KFV: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: OE21%20WRR
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE21%2520WRR%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for OE21%20WRR: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: GD19%20SZV
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD19%2520SZV%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for GD19%20SZV: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: KV70%20XWE
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV70%2520XWE%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for KV70%20XWE: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: PK18%20LLR
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK18%2520LLR%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for PK18%20LLR: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: SA20%20CZR
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA20%2520CZR%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for SA20%20CZR: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: SR19%20ZZV
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520ZZV%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for SR19%20ZZV: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: ST69%20RVR
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST69%2520RVR%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for ST69%20RVR: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: HN73%20OYE
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN73%2520OYE%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for HN73%20OYE: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: CV22%20JHX
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV22%2520JHX%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for CV22%20JHX: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: CA20%20HMO
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA20%2520HMO%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for CA20%20HMO: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: D21%20CPN
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27D21%2520CPN%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for D21%20CPN: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: KR70%20AOW
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR70%2520AOW%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for KR70%20AOW: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: LM19%20YBF
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM19%2520YBF%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for LM19%20YBF: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: MP19%20XWS
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520XWS%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for MP19%20XWS: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: CK22%20BGY
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK22%2520BGY%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for CK22%20BGY: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: BM19%20KKC
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BM19%2520KKC%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for BM19%20KKC: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: CU19%20HWD
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU19%2520HWD%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for CU19%20HWD: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: DA19%20JWL
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA19%2520JWL%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for DA19%20JWL: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: WT19%20AXJ
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT19%2520AXJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for WT19%20AXJ: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: LM22%20HEV
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM22%2520HEV%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for LM22%20HEV: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: GX10%20TFN
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX10%2520TFN%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for GX10%20TFN: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: LR22%20POJ
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR22%2520POJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for LR22%20POJ: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: MV19%20OZD
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV19%2520OZD%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for MV19%20OZD: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: OY68%20HXZ
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY68%2520HXZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for OY68%20HXZ: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: WK18%20TYG
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK18%2520TYG%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for WK18%20TYG: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: PF21%20VOH
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF21%2520VOH%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for PF21%20VOH: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: YG70%20JFZ
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG70%2520JFZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for YG70%20JFZ: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: KX19%20ZFM
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX19%2520ZFM%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for KX19%20ZFM: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: RX73%20ZDN
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX73%2520ZDN%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for RX73%20ZDN: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: GY25%20ONT
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY25%2520ONT%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for GY25%20ONT: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: HX69%20ZKF
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX69%2520ZKF%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for HX69%20ZKF: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: DV20%20VXP
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV20%2520VXP%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for DV20%20VXP: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: EF69%20NVG
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF69%2520NVG%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for EF69%20NVG: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: GD68%20RFO
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD68%2520RFO%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for GD68%20RFO: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: HF18%20LDC
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF18%2520LDC%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for HF18%20LDC: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: HY69%20RKF
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY69%2520RKF%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for HY69%20RKF: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: RV19%20HHT
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV19%2520HHT%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for RV19%20HHT: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: BU68%20VWW
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU68%2520VWW%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for BU68%20VWW: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: BV19%20GVW
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV19%2520GVW%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for BV19%20GVW: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: DG22%20CTE
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG22%2520CTE%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for DG22%20CTE: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: ML18%20XJB
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML18%2520XJB%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for ML18%20XJB: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: MW69%20HFC
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW69%2520HFC%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for MW69%20HFC: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: SA69%20LHZ
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA69%2520LHZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for SA69%20LHZ: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: VX19%20FEH
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX19%2520FEH%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for VX19%20FEH: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: DE70%20TSU
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE70%2520TSU%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for DE70%20TSU: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: SA18%20CFY
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA18%2520CFY%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for SA18%20CFY: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: YF71%20WVH
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF71%2520WVH%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for YF71%20WVH: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: YL68%20ORJ
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL68%2520ORJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for YL68%20ORJ: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: YS18%20FWH
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS18%2520FWH%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for YS18%20FWH: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: BP69%20OJJ
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP69%2520OJJ%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for BP69%20OJJ: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: CK70%20YMM
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK70%2520YMM%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for CK70%20YMM: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: CX20%20KFW
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX20%2520KFW%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for CX20%20KFW: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: KW70%20FHN
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW70%2520FHN%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for KW70%20FHN: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: WJ22%20BOV
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ22%2520BOV%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for WJ22%20BOV: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: WN18%20XLF
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN18%2520XLF%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for WN18%20XLF: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: KN21%20ZVO
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN21%2520ZVO%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for KN21%20ZVO: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: VK69%20CTV
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK69%2520CTV%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for VK69%20CTV: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: EJ22%20VBB
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ22%2520VBB%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for EJ22%20VBB: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: GP68%20URE
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP68%2520URE%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for GP68%20URE: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: MJ16%20FXK
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ16%2520FXK%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for MJ16%20FXK: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: DY09%20AUK
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY09%2520AUK%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for DY09%20AUK: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: SD13%20NWC
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD13%2520NWC%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for SD13%20NWC: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: YK62%20XBF
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK62%2520XBF%27 HTTP/1.1" 200 None
2026-03-29 22:08:56 [bca.uk] INFO: Scrape type for YK62%20XBF: 0
2026-03-29 22:08:56 [bca.uk] INFO: Found listing with ID: YX17%20UZK
2026-03-29 22:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX17%2520UZK%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for YX17%20UZK: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: ND64%20XVK
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND64%2520XVK%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for ND64%20XVK: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: WN08%20EJO
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN08%2520EJO%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for WN08%20EJO: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: WM18%20TOV
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM18%2520TOV%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for WM18%20TOV: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: DL65%20RZM
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL65%2520RZM%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for DL65%20RZM: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: ML21%20PXH
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML21%2520PXH%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for ML21%20PXH: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: NX63%20LFL
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX63%2520LFL%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for NX63%20LFL: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: YN64%20OSM
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN64%2520OSM%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for YN64%20OSM: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: MW63%20FXS
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW63%2520FXS%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for MW63%20FXS: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: KN14%20YFH
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN14%2520YFH%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for KN14%20YFH: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: WX63%20EOP
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX63%2520EOP%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for WX63%20EOP: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: MF70%20WBE
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF70%2520WBE%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for MF70%20WBE: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: WM63%20BYZ
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM63%2520BYZ%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for WM63%20BYZ: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: KY16%20LRL
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY16%2520LRL%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for KY16%20LRL: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: EO16%20YSH
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO16%2520YSH%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for EO16%20YSH: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: FG19%20CUA
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG19%2520CUA%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for FG19%20CUA: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: MF12%20VBY
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF12%2520VBY%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for MF12%20VBY: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: GF58%20XOE
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF58%2520XOE%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for GF58%20XOE: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: WNZ%201898
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WNZ%25201898%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for WNZ%201898: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: AJ15%20UCW
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ15%2520UCW%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for AJ15%20UCW: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: GU59%20DWO
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU59%2520DWO%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for GU59%20DWO: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: BU11%20RTV
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU11%2520RTV%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for BU11%20RTV: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: SY15%20WZH
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY15%2520WZH%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for SY15%20WZH: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: EF69%20FGP
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF69%2520FGP%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for EF69%20FGP: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: KS71%20LRF
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS71%2520LRF%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for KS71%20LRF: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: MV22%20UCS
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV22%2520UCS%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for MV22%20UCS: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: VK73%20CAE
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK73%2520CAE%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for VK73%20CAE: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: NA14%20MLY
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA14%2520MLY%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for NA14%20MLY: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: DV12%20NKX
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV12%2520NKX%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for DV12%20NKX: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: YE13%20TGX
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE13%2520TGX%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for YE13%20TGX: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: KX63%20VRW
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX63%2520VRW%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for KX63%20VRW: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: WU56%20JVV
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU56%2520JVV%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for WU56%20JVV: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: MW14%20VSG
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW14%2520VSG%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for MW14%20VSG: 0
2026-03-29 22:08:57 [bca.uk] INFO: Found listing with ID: YG63%20XMA
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG63%2520XMA%27 HTTP/1.1" 200 None
2026-03-29 22:08:57 [bca.uk] INFO: Scrape type for YG63%20XMA: 0
2026-03-29 22:08:57 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=31&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:57 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=31&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:08:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=31&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:09:00 [bca.uk] INFO: Total items found: 100
2026-03-29 22:09:00 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=32&sort=MostRecentlyAdded
2026-03-29 22:09:00 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:09:00 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=32&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: WM64%20MZY
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM64%2520MZY%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for WM64%20MZY: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: PK67%20WXJ
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK67%2520WXJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for PK67%20WXJ: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: BG68%20USB
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG68%2520USB%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for BG68%20USB: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: CF22%20XZJ
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF22%2520XZJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for CF22%20XZJ: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: YF64%20HNX
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF64%2520HNX%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for YF64%20HNX: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: MK20%20NXW
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK20%2520NXW%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for MK20%20NXW: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: ND15%20ZTH
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND15%2520ZTH%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for ND15%20ZTH: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: BF65%20MXK
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF65%2520MXK%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for BF65%20MXK: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: CJ21%20DMF
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CJ21%2520DMF%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for CJ21%20DMF: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: CX17%20HLC
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX17%2520HLC%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for CX17%20HLC: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: CU67%20WRO
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU67%2520WRO%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for CU67%20WRO: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: NU20%20BYM
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU20%2520BYM%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for NU20%20BYM: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: SE23%20USB
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE23%2520USB%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for SE23%20USB: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: CX19%20CMZ
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX19%2520CMZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for CX19%20CMZ: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: SJ19%20TZN
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ19%2520TZN%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for SJ19%20TZN: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: YT69%20XRC
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT69%2520XRC%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for YT69%20XRC: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: SV63%20OHA
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV63%2520OHA%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for SV63%20OHA: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: WN11%20LZE
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN11%2520LZE%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for WN11%20LZE: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: PE15%20VEP
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE15%2520VEP%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for PE15%20VEP: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: BF68%20XZH
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF68%2520XZH%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for BF68%20XZH: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: WH19%20KYM
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WH19%2520KYM%27 HTTP/1.1" 200 None
2026-03-29 22:09:00 [bca.uk] INFO: Scrape type for WH19%20KYM: 0
2026-03-29 22:09:00 [bca.uk] INFO: Found listing with ID: BD61%20LZS
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD61%2520LZS%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for BD61%20LZS: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: GK70%20LKL
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK70%2520LKL%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for GK70%20LKL: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: MF15%20LOA
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF15%2520LOA%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for MF15%20LOA: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: SB67%20ZDO
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB67%2520ZDO%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for SB67%20ZDO: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: YB23%20NJU
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB23%2520NJU%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for YB23%20NJU: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: PF65%20MKM
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF65%2520MKM%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for PF65%20MKM: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: SY68%20MYK
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY68%2520MYK%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for SY68%20MYK: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: YB15%20YCN
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB15%2520YCN%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for YB15%20YCN: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: YP70%20OYG
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP70%2520OYG%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for YP70%20OYG: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: P12%20TBE
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P12%2520TBE%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for P12%20TBE: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: SA72%20DPN
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA72%2520DPN%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for SA72%20DPN: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: BD64%20SVN
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD64%2520SVN%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for BD64%20SVN: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: SG16%20XEM
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG16%2520XEM%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for SG16%20XEM: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: BX64%20YVD
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX64%2520YVD%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for BX64%20YVD: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: EO60%20XFZ
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO60%2520XFZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for EO60%20XFZ: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: DS65%20VAY
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS65%2520VAY%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for DS65%20VAY: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: YA72%20EKD
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA72%2520EKD%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for YA72%20EKD: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: SG17%20XAA
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG17%2520XAA%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for SG17%20XAA: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: WA16%20TJO
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA16%2520TJO%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for WA16%20TJO: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: EK13%20NDL
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK13%2520NDL%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for EK13%20NDL: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: AY66%20EOR
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY66%2520EOR%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for AY66%20EOR: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: FL70%20WDY
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL70%2520WDY%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for FL70%20WDY: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: HK71%20UCC
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK71%2520UCC%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for HK71%20UCC: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: HN67%20XHO
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN67%2520XHO%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for HN67%20XHO: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: HK22%20RGO
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK22%2520RGO%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for HK22%20RGO: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: DS67%20KWK
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS67%2520KWK%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for DS67%20KWK: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: CX15%20ULU
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX15%2520ULU%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for CX15%20ULU: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: RO14%20MMV
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO14%2520MMV%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for RO14%20MMV: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: MA13%20FHH
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA13%2520FHH%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for MA13%20FHH: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: MK17%20JHJ
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK17%2520JHJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for MK17%20JHJ: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: SG16%20EAC
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG16%2520EAC%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for SG16%20EAC: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: YS65%20LZV
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS65%2520LZV%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for YS65%20LZV: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: KO18%20CWM
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO18%2520CWM%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for KO18%20CWM: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: KP61%20JVR
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP61%2520JVR%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for KP61%20JVR: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: WK15%20WKR
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK15%2520WKR%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for WK15%20WKR: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: WX60%20CFO
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX60%2520CFO%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for WX60%20CFO: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: VK66%20PZX
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK66%2520PZX%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for VK66%20PZX: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: SJ64%20WFB
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ64%2520WFB%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for SJ64%20WFB: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: WN62%20OGT
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN62%2520OGT%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for WN62%20OGT: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: HF66%20XPD
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF66%2520XPD%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for HF66%20XPD: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: NA68%20PNX
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA68%2520PNX%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for NA68%20PNX: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: SH66%20VEY
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH66%2520VEY%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for SH66%20VEY: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: SA67%20LLK
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA67%2520LLK%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for SA67%20LLK: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: OE62%20XHT
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE62%2520XHT%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for OE62%20XHT: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: BP74%20GVC
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP74%2520GVC%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for BP74%20GVC: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: M5%20OPK
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M5%2520OPK%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for M5%20OPK: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: YB14%20PZY
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB14%2520PZY%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for YB14%20PZY: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: YT15%20HZM
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT15%2520HZM%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for YT15%20HZM: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: OX73%20BFE
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OX73%2520BFE%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for OX73%20BFE: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: EY13%20FZE
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY13%2520FZE%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for EY13%20FZE: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: BC73%20NTT
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC73%2520NTT%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for BC73%20NTT: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: VK21%20GPO
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK21%2520GPO%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for VK21%20GPO: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: PK65%20OBP
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK65%2520OBP%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for PK65%20OBP: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: AY66%20ZNA
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY66%2520ZNA%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for AY66%20ZNA: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: NA07%20HJZ
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA07%2520HJZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for NA07%20HJZ: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: RV18%20HSL
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV18%2520HSL%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for RV18%20HSL: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: YR70%20UMF
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR70%2520UMF%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for YR70%20UMF: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: FJ18%20XJY
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ18%2520XJY%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for FJ18%20XJY: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: RA15%20GLF
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA15%2520GLF%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for RA15%20GLF: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: VN62%20UNY
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN62%2520UNY%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for VN62%20UNY: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: FSZ%204071
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FSZ%25204071%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for FSZ%204071: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: DP24%20AKN
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP24%2520AKN%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for DP24%20AKN: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: MM22%20HGF
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM22%2520HGF%27 HTTP/1.1" 200 None
2026-03-29 22:09:01 [bca.uk] INFO: Scrape type for MM22%20HGF: 0
2026-03-29 22:09:01 [bca.uk] INFO: Found listing with ID: OY67%20EZZ
2026-03-29 22:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY67%2520EZZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:02 [bca.uk] INFO: Scrape type for OY67%20EZZ: 0
2026-03-29 22:09:02 [bca.uk] INFO: Found listing with ID: AO63%20VPL
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO63%2520VPL%27 HTTP/1.1" 200 None
2026-03-29 22:09:02 [bca.uk] INFO: Scrape type for AO63%20VPL: 0
2026-03-29 22:09:02 [bca.uk] INFO: Found listing with ID: SJ19%20FLS
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ19%2520FLS%27 HTTP/1.1" 200 None
2026-03-29 22:09:02 [bca.uk] INFO: Scrape type for SJ19%20FLS: 0
2026-03-29 22:09:02 [bca.uk] INFO: Found listing with ID: SM73%20DNX
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM73%2520DNX%27 HTTP/1.1" 200 None
2026-03-29 22:09:02 [bca.uk] INFO: Scrape type for SM73%20DNX: 0
2026-03-29 22:09:02 [bca.uk] INFO: Found listing with ID: EA23%20YLO
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA23%2520YLO%27 HTTP/1.1" 200 None
2026-03-29 22:09:02 [bca.uk] INFO: Scrape type for EA23%20YLO: 0
2026-03-29 22:09:02 [bca.uk] INFO: Found listing with ID: KU63%20WEA
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU63%2520WEA%27 HTTP/1.1" 200 None
2026-03-29 22:09:02 [bca.uk] INFO: Scrape type for KU63%20WEA: 0
2026-03-29 22:09:02 [bca.uk] INFO: Found listing with ID: WP69%20UHB
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP69%2520UHB%27 HTTP/1.1" 200 None
2026-03-29 22:09:02 [bca.uk] INFO: Scrape type for WP69%20UHB: 0
2026-03-29 22:09:02 [bca.uk] INFO: Found listing with ID: YS69%20ZKF
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS69%2520ZKF%27 HTTP/1.1" 200 None
2026-03-29 22:09:02 [bca.uk] INFO: Scrape type for YS69%20ZKF: 0
2026-03-29 22:09:02 [bca.uk] INFO: Found listing with ID: YM71%20FSP
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM71%2520FSP%27 HTTP/1.1" 200 None
2026-03-29 22:09:02 [bca.uk] INFO: Scrape type for YM71%20FSP: 0
2026-03-29 22:09:02 [bca.uk] INFO: Found listing with ID: YS16%20DMO
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS16%2520DMO%27 HTTP/1.1" 200 None
2026-03-29 22:09:02 [bca.uk] INFO: Scrape type for YS16%20DMO: 0
2026-03-29 22:09:02 [bca.uk] INFO: Found listing with ID: DN13%20XYJ
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN13%2520XYJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:02 [bca.uk] INFO: Scrape type for DN13%20XYJ: 0
2026-03-29 22:09:02 [bca.uk] INFO: Found listing with ID: GK24%20HMF
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK24%2520HMF%27 HTTP/1.1" 200 None
2026-03-29 22:09:02 [bca.uk] INFO: Scrape type for GK24%20HMF: 0
2026-03-29 22:09:02 [bca.uk] INFO: Found listing with ID: WN22%20TKD
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN22%2520TKD%27 HTTP/1.1" 200 None
2026-03-29 22:09:02 [bca.uk] INFO: Scrape type for WN22%20TKD: 0
2026-03-29 22:09:02 [bca.uk] INFO: Found listing with ID: LO23%20GPU
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO23%2520GPU%27 HTTP/1.1" 200 None
2026-03-29 22:09:02 [bca.uk] INFO: Scrape type for LO23%20GPU: 0
2026-03-29 22:09:02 [bca.uk] INFO: Found listing with ID: YP68%20XHL
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP68%2520XHL%27 HTTP/1.1" 200 None
2026-03-29 22:09:02 [bca.uk] INFO: Scrape type for YP68%20XHL: 0
2026-03-29 22:09:02 [bca.uk] INFO: Found listing with ID: YA23%20TZR
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA23%2520TZR%27 HTTP/1.1" 200 None
2026-03-29 22:09:02 [bca.uk] INFO: Scrape type for YA23%20TZR: 0
2026-03-29 22:09:02 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=32&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:02 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=32&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=32&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:09:03 [bca.uk] INFO: Total items found: 100
2026-03-29 22:09:03 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=33&sort=MostRecentlyAdded
2026-03-29 22:09:03 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:09:03 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=33&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:03 [bca.uk] INFO: Found listing with ID: VN18%20WGJ
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN18%2520WGJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:03 [bca.uk] INFO: Scrape type for VN18%20WGJ: 0
2026-03-29 22:09:03 [bca.uk] INFO: Found listing with ID: BN16%20YCC
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN16%2520YCC%27 HTTP/1.1" 200 None
2026-03-29 22:09:03 [bca.uk] INFO: Scrape type for BN16%20YCC: 0
2026-03-29 22:09:03 [bca.uk] INFO: Found listing with ID: EF15%20ECY
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF15%2520ECY%27 HTTP/1.1" 200 None
2026-03-29 22:09:03 [bca.uk] INFO: Scrape type for EF15%20ECY: 0
2026-03-29 22:09:03 [bca.uk] INFO: Found listing with ID: BV64%20HHP
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV64%2520HHP%27 HTTP/1.1" 200 None
2026-03-29 22:09:03 [bca.uk] INFO: Scrape type for BV64%20HHP: 0
2026-03-29 22:09:03 [bca.uk] INFO: Found listing with ID: WP22%20CZC
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP22%2520CZC%27 HTTP/1.1" 200 None
2026-03-29 22:09:03 [bca.uk] INFO: Scrape type for WP22%20CZC: 0
2026-03-29 22:09:03 [bca.uk] INFO: Found listing with ID: YH21%20NLM
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH21%2520NLM%27 HTTP/1.1" 200 None
2026-03-29 22:09:03 [bca.uk] INFO: Scrape type for YH21%20NLM: 0
2026-03-29 22:09:03 [bca.uk] INFO: Found listing with ID: CE69%20XSY
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE69%2520XSY%27 HTTP/1.1" 200 None
2026-03-29 22:09:03 [bca.uk] INFO: Scrape type for CE69%20XSY: 0
2026-03-29 22:09:03 [bca.uk] INFO: Found listing with ID: AO62%20OXD
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO62%2520OXD%27 HTTP/1.1" 200 None
2026-03-29 22:09:03 [bca.uk] INFO: Scrape type for AO62%20OXD: 0
2026-03-29 22:09:03 [bca.uk] INFO: Found listing with ID: PX56%20GKL
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX56%2520GKL%27 HTTP/1.1" 200 None
2026-03-29 22:09:03 [bca.uk] INFO: Scrape type for PX56%20GKL: 0
2026-03-29 22:09:03 [bca.uk] INFO: Found listing with ID: MD19%20WYP
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD19%2520WYP%27 HTTP/1.1" 200 None
2026-03-29 22:09:03 [bca.uk] INFO: Scrape type for MD19%20WYP: 0
2026-03-29 22:09:03 [bca.uk] INFO: Found listing with ID: KE73%20AZL
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE73%2520AZL%27 HTTP/1.1" 200 None
2026-03-29 22:09:03 [bca.uk] INFO: Scrape type for KE73%20AZL: 0
2026-03-29 22:09:03 [bca.uk] INFO: Found listing with ID: LM72%20ZKZ
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM72%2520ZKZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:03 [bca.uk] INFO: Scrape type for LM72%20ZKZ: 0
2026-03-29 22:09:03 [bca.uk] INFO: Found listing with ID: VO24%20OZH
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO24%2520OZH%27 HTTP/1.1" 200 None
2026-03-29 22:09:03 [bca.uk] INFO: Scrape type for VO24%20OZH: 0
2026-03-29 22:09:03 [bca.uk] INFO: Found listing with ID: DK14%20KWN
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK14%2520KWN%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for DK14%20KWN: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: LR23%20ZDW
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR23%2520ZDW%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for LR23%20ZDW: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: GV74%20XLD
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV74%2520XLD%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for GV74%20XLD: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: LM74%20XOF
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM74%2520XOF%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for LM74%20XOF: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: LP72%20VEW
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP72%2520VEW%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for LP72%20VEW: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: MD24%20WCJ
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD24%2520WCJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for MD24%20WCJ: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: BC74%20HAX
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC74%2520HAX%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for BC74%20HAX: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: EO23%20LML
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO23%2520LML%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for EO23%20LML: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: EU16%20VPP
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU16%2520VPP%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for EU16%20VPP: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: EO74%20OPL
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO74%2520OPL%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for EO74%20OPL: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: DA15%20KME
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA15%2520KME%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for DA15%20KME: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: DN17%20OTR
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN17%2520OTR%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for DN17%20OTR: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: LL23%20KPF
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL23%2520KPF%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for LL23%20KPF: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: Y863%20PSL
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y863%2520PSL%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for Y863%20PSL: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: FY72%20ATU
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY72%2520ATU%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for FY72%20ATU: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: SR19%20KRE
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520KRE%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for SR19%20KRE: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: AX72%20JJV
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX72%2520JJV%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for AX72%20JJV: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: AF21%20VSG
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF21%2520VSG%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for AF21%20VSG: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: DX23%20TSO
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX23%2520TSO%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for DX23%20TSO: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: KN69%20NPV
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN69%2520NPV%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for KN69%20NPV: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: YF72%20VKM
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF72%2520VKM%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for YF72%20VKM: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: DY72%20BZT
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY72%2520BZT%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for DY72%20BZT: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: P123%20PJG
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P123%2520PJG%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for P123%20PJG: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: AO22%20TKN
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO22%2520TKN%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for AO22%20TKN: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: AX72%20KAU
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX72%2520KAU%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for AX72%20KAU: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: GY21%20ECT
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY21%2520ECT%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for GY21%20ECT: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: GC23%20CTV
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GC23%2520CTV%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for GC23%20CTV: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: YF68%20ZTR
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF68%2520ZTR%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for YF68%20ZTR: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: GV24%20ECT
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV24%2520ECT%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for GV24%20ECT: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: GY23%20TYF
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY23%2520TYF%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for GY23%20TYF: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: WU18%20RYO
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU18%2520RYO%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for WU18%20RYO: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: OV71%20KBY
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV71%2520KBY%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for OV71%20KBY: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: KV72%20VJL
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV72%2520VJL%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for KV72%20VJL: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: VO17%20JDK
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO17%2520JDK%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for VO17%20JDK: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: OV21%20JZF
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV21%2520JZF%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for OV21%20JZF: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: DU20%20NZO
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU20%2520NZO%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for DU20%20NZO: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: VK72%20WFR
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK72%2520WFR%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for VK72%20WFR: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: GD20%20BRZ
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD20%2520BRZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for GD20%20BRZ: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: FM19%20TZB
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM19%2520TZB%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for FM19%20TZB: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: HJ23%20YHS
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ23%2520YHS%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for HJ23%20YHS: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: KT68%20ENX
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT68%2520ENX%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for KT68%20ENX: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: FV18%20YDD
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV18%2520YDD%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for FV18%20YDD: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: KD16%20EZL
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KD16%2520EZL%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for KD16%20EZL: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: YS63%20PYT
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS63%2520PYT%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for YS63%20PYT: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: YS08%20YXV
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS08%2520YXV%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for YS08%20YXV: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: YS08%20ZJO
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS08%2520ZJO%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for YS08%20ZJO: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: EK71%20HZV
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK71%2520HZV%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for EK71%20HZV: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: BT67%20OWK
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT67%2520OWK%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for BT67%20OWK: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: RX65%20HHD
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX65%2520HHD%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for RX65%20HHD: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: VO68%20DSX
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO68%2520DSX%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for VO68%20DSX: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: YO19%20YDJ
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YO19%2520YDJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for YO19%20YDJ: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: KR18%20BKJ
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR18%2520BKJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for KR18%20BKJ: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: WU13%20UEB
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU13%2520UEB%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for WU13%20UEB: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: YN15%20UFJ
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN15%2520UFJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for YN15%20UFJ: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: LS17%20GEO
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS17%2520GEO%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for LS17%20GEO: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: SH14%20WXM
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH14%2520WXM%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for SH14%20WXM: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: FX63%20YEF
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX63%2520YEF%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for FX63%20YEF: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: FP65%20TEO
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP65%2520TEO%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for FP65%20TEO: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: SC68%20NNM
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC68%2520NNM%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for SC68%20NNM: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: MK61%20GYH
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK61%2520GYH%27 HTTP/1.1" 200 None
2026-03-29 22:09:04 [bca.uk] INFO: Scrape type for MK61%20GYH: 0
2026-03-29 22:09:04 [bca.uk] INFO: Found listing with ID: FV08%20DGX
2026-03-29 22:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV08%2520DGX%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for FV08%20DGX: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: FG18%20GHU
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG18%2520GHU%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for FG18%20GHU: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: FG64%20LKJ
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG64%2520LKJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for FG64%20LKJ: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: WX17%20XDB
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX17%2520XDB%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for WX17%20XDB: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: YF68%20LHH
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF68%2520LHH%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for YF68%20LHH: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: YC17%20AVU
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC17%2520AVU%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for YC17%20AVU: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: LV62%20VKA
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV62%2520VKA%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for LV62%20VKA: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: MT14%20SOU
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT14%2520SOU%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for MT14%20SOU: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: NG63%20RMZ
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG63%2520RMZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for NG63%20RMZ: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: VU66%20URO
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU66%2520URO%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for VU66%20URO: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: NA64%20UVD
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA64%2520UVD%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for NA64%20UVD: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: NJ12%20XTN
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ12%2520XTN%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for NJ12%20XTN: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: VN14%20HVP
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN14%2520HVP%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for VN14%20HVP: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: NV66%20ZTE
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV66%2520ZTE%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for NV66%20ZTE: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: BF65%20FCL
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF65%2520FCL%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for BF65%20FCL: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: CE63%20PBY
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE63%2520PBY%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for CE63%20PBY: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: YY59%20CYA
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY59%2520CYA%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for YY59%20CYA: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: HV67%20RZT
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV67%2520RZT%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for HV67%20RZT: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: GJ60%20KJA
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ60%2520KJA%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for GJ60%20KJA: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: SB60%20CNO
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB60%2520CNO%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for SB60%20CNO: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: EJ66%20XPA
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ66%2520XPA%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for EJ66%20XPA: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: BK13%20TGJ
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK13%2520TGJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for BK13%20TGJ: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: NU14%20YFL
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU14%2520YFL%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for NU14%20YFL: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: SK12%20HUV
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK12%2520HUV%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for SK12%20HUV: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: NU68%20WCD
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU68%2520WCD%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for NU68%20WCD: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: NV11%20BAO
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV11%2520BAO%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for NV11%20BAO: 0
2026-03-29 22:09:05 [bca.uk] INFO: Found listing with ID: NX63%20OSO
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX63%2520OSO%27 HTTP/1.1" 200 None
2026-03-29 22:09:05 [bca.uk] INFO: Scrape type for NX63%20OSO: 0
2026-03-29 22:09:05 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=33&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:05 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=33&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=33&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:09:07 [bca.uk] INFO: Total items found: 100
2026-03-29 22:09:07 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=34&sort=MostRecentlyAdded
2026-03-29 22:09:07 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:09:07 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=34&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: NU66%20UWF
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU66%2520UWF%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for NU66%20UWF: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: OV19%20NWU
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV19%2520NWU%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for OV19%20NWU: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: DS65%20WCC
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS65%2520WCC%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for DS65%20WCC: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: ND12%20FCP
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND12%2520FCP%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for ND12%20FCP: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: VO11%20WKT
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO11%2520WKT%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for VO11%20WKT: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: SJ15%20VEV
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ15%2520VEV%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for SJ15%20VEV: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: ND13%20HSY
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND13%2520HSY%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for ND13%20HSY: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: ND15%20SFU
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND15%2520SFU%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for ND15%20SFU: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: ND53%20EJZ
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND53%2520EJZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for ND53%20EJZ: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: SL10%20HRP
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL10%2520HRP%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for SL10%20HRP: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: FE64%20FGV
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE64%2520FGV%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for FE64%20FGV: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: A13%20MVN
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27A13%2520MVN%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for A13%20MVN: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: AK17%20GUU
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK17%2520GUU%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for AK17%20GUU: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: NG15%20FSV
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG15%2520FSV%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for NG15%20FSV: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: NX64%20XJU
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX64%2520XJU%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for NX64%20XJU: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: PX17%20KLK
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX17%2520KLK%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for PX17%20KLK: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: XJZ%202720
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27XJZ%25202720%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for XJZ%202720: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: YB66%20XOJ
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB66%2520XOJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for YB66%20XOJ: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: SB63%20LBV
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB63%2520LBV%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for SB63%20LBV: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: NG09%20OHE
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG09%2520OHE%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for NG09%20OHE: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: NL14%20EJE
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL14%2520EJE%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for NL14%20EJE: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: NL64%20FPJ
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL64%2520FPJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for NL64%20FPJ: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: SN13%20ZFP
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN13%2520ZFP%27 HTTP/1.1" 200 None
2026-03-29 22:09:07 [bca.uk] INFO: Scrape type for SN13%20ZFP: 0
2026-03-29 22:09:07 [bca.uk] INFO: Found listing with ID: SD20%20GGV
2026-03-29 22:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD20%2520GGV%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for SD20%20GGV: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: DT70%20EYC
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT70%2520EYC%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for DT70%20EYC: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: NG17%20OYT
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG17%2520OYT%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for NG17%20OYT: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: RV12%20YXK
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV12%2520YXK%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for RV12%20YXK: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: SG16%20NZO
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG16%2520NZO%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for SG16%20NZO: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: SH63%20LDY
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH63%2520LDY%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for SH63%20LDY: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: NJ58%20LNC
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ58%2520LNC%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for NJ58%20LNC: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: AF70%20ZNZ
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF70%2520ZNZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for AF70%20ZNZ: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: HK66%20JFA
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK66%2520JFA%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for HK66%20JFA: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: PN64%20HCG
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN64%2520HCG%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for PN64%20HCG: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: YA17%20WGF
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA17%2520WGF%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for YA17%20WGF: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: DV65%20WKF
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV65%2520WKF%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for DV65%20WKF: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: KU66%20ZTZ
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU66%2520ZTZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for KU66%20ZTZ: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: YR66%20PXG
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR66%2520PXG%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for YR66%20PXG: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: AO65%20UZE
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO65%2520UZE%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for AO65%20UZE: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: FA15%20RVP
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA15%2520RVP%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for FA15%20RVP: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: AY18%20HNV
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY18%2520HNV%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for AY18%20HNV: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: LL66%20FWD
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL66%2520FWD%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for LL66%20FWD: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: AO10%20TKU
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO10%2520TKU%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for AO10%20TKU: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: WG17%20UXC
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG17%2520UXC%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for WG17%20UXC: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: YK59%20SRO
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK59%2520SRO%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for YK59%20SRO: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: WF67%20DFL
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF67%2520DFL%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for WF67%20DFL: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: RX72%20LTT
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX72%2520LTT%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for RX72%20LTT: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: FV10%20XXD
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV10%2520XXD%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for FV10%20XXD: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: WK61%20ZTU
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK61%2520ZTU%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for WK61%20ZTU: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: BU18%20NGO
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU18%2520NGO%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for BU18%20NGO: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: RO63%20YYB
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO63%2520YYB%27 HTTP/1.1" 200 None
2026-03-29 22:09:08 [bca.uk] INFO: Scrape type for RO63%20YYB: 0
2026-03-29 22:09:08 [bca.uk] INFO: Found listing with ID: OW15%20CWM
2026-03-29 22:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW15%2520CWM%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for OW15%20CWM: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: WD21%20HYN
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD21%2520HYN%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for WD21%20HYN: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: VN64%20GJE
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN64%2520GJE%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for VN64%20GJE: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: WA22%20OGO
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA22%2520OGO%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for WA22%20OGO: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: WF63%20PZN
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF63%2520PZN%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for WF63%20PZN: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: CF16%20VCC
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF16%2520VCC%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for CF16%20VCC: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: YF23%20UNU
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF23%2520UNU%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for YF23%20UNU: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: CE67%20DUA
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE67%2520DUA%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for CE67%20DUA: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: VA15%20PGV
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA15%2520PGV%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for VA15%20PGV: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: WF62%20FHV
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF62%2520FHV%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for WF62%20FHV: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: WP64%20OMX
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP64%2520OMX%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for WP64%20OMX: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: KT17%20GKL
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT17%2520GKL%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for KT17%20GKL: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: HP08%20CJP
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HP08%2520CJP%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for HP08%20CJP: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: SG15%20DHC
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG15%2520DHC%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for SG15%20DHC: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: FD17%20YNY
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD17%2520YNY%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for FD17%20YNY: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: WR62%20NLM
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR62%2520NLM%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for WR62%20NLM: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: NA14%20BWZ
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA14%2520BWZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for NA14%20BWZ: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: BD03%20HWG
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD03%2520HWG%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for BD03%20HWG: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: BG68%20PDX
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG68%2520PDX%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for BG68%20PDX: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: OE04%20DZX
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE04%2520DZX%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for OE04%20DZX: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: VO64%20EHR
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO64%2520EHR%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for VO64%20EHR: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: ND63%20LNP
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND63%2520LNP%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for ND63%20LNP: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: SL64%20FZK
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL64%2520FZK%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for SL64%20FZK: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: AU56%20WCK
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU56%2520WCK%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for AU56%20WCK: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: FM56%20CRV
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM56%2520CRV%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for FM56%20CRV: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: ML67%20ONM
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML67%2520ONM%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for ML67%20ONM: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: PK17%20EOC
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK17%2520EOC%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for PK17%20EOC: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: YC68%20CCO
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC68%2520CCO%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for YC68%20CCO: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: YK19%20YDN
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK19%2520YDN%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for YK19%20YDN: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: VO24%20YPP
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO24%2520YPP%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for VO24%20YPP: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: SL63%20OXM
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL63%2520OXM%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for SL63%20OXM: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: YH63%20SRO
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH63%2520SRO%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for YH63%20SRO: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: OY16%20GVN
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY16%2520GVN%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for OY16%20GVN: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: YD16%20XEJ
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD16%2520XEJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for YD16%20XEJ: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: VO24%20ONM
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO24%2520ONM%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for VO24%20ONM: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: YB17%20SGV
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB17%2520SGV%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for YB17%20SGV: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: MW54%20PAS
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW54%2520PAS%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for MW54%20PAS: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: CK18%20CFX
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520CFX%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for CK18%20CFX: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: DF64%20XZL
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF64%2520XZL%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for DF64%20XZL: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: VN24%20OFL
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN24%2520OFL%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for VN24%20OFL: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: DV18%20UGL
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV18%2520UGL%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for DV18%20UGL: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: PF68%20UBR
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF68%2520UBR%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for PF68%20UBR: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: RV10%20KSE
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV10%2520KSE%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for RV10%20KSE: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: RJ74%20TCK
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ74%2520TCK%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for RJ74%20TCK: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: ML24%20FDM
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML24%2520FDM%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for ML24%20FDM: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: MW74%20DCV
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW74%2520DCV%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for MW74%20DCV: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: GB07%20RWC
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GB07%2520RWC%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for GB07%20RWC: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: BJ15%20TGX
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ15%2520TGX%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for BJ15%20TGX: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: MD74%20GVX
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD74%2520GVX%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for MD74%20GVX: 0
2026-03-29 22:09:09 [bca.uk] INFO: Found listing with ID: MW74%20DWK
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW74%2520DWK%27 HTTP/1.1" 200 None
2026-03-29 22:09:09 [bca.uk] INFO: Scrape type for MW74%20DWK: 0
2026-03-29 22:09:09 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=34&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:09 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=34&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:09:10 [scrapy.extensions.logstats] INFO: Crawled 166 pages (at 5 pages/min), scraped 643 items (at 37 items/min)
2026-03-29 22:09:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-29 22:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=34&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:09:11 [bca.uk] INFO: Total items found: 100
2026-03-29 22:09:11 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=35&sort=MostRecentlyAdded
2026-03-29 22:09:11 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:09:11 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=35&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:11 [bca.uk] INFO: Found listing with ID: VK24%20OHL
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK24%2520OHL%27 HTTP/1.1" 200 None
2026-03-29 22:09:11 [bca.uk] INFO: Scrape type for VK24%20OHL: 0
2026-03-29 22:09:11 [bca.uk] INFO: Found listing with ID: WU66%20YYE
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU66%2520YYE%27 HTTP/1.1" 200 None
2026-03-29 22:09:11 [bca.uk] INFO: Scrape type for WU66%20YYE: 0
2026-03-29 22:09:11 [bca.uk] INFO: Found listing with ID: VE16%20WMP
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE16%2520WMP%27 HTTP/1.1" 200 None
2026-03-29 22:09:11 [bca.uk] INFO: Scrape type for VE16%20WMP: 0
2026-03-29 22:09:11 [bca.uk] INFO: Found listing with ID: NV73%20GTZ
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV73%2520GTZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:11 [bca.uk] INFO: Scrape type for NV73%20GTZ: 0
2026-03-29 22:09:11 [bca.uk] INFO: Found listing with ID: DA66%20BXD
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA66%2520BXD%27 HTTP/1.1" 200 None
2026-03-29 22:09:11 [bca.uk] INFO: Scrape type for DA66%20BXD: 0
2026-03-29 22:09:11 [bca.uk] INFO: Found listing with ID: MT59%20YVK
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT59%2520YVK%27 HTTP/1.1" 200 None
2026-03-29 22:09:11 [bca.uk] INFO: Scrape type for MT59%20YVK: 0
2026-03-29 22:09:11 [bca.uk] INFO: Found listing with ID: PN16%20UZP
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN16%2520UZP%27 HTTP/1.1" 200 None
2026-03-29 22:09:11 [bca.uk] INFO: Scrape type for PN16%20UZP: 0
2026-03-29 22:09:11 [bca.uk] INFO: Found listing with ID: VK10%20KPJ
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK10%2520KPJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:11 [bca.uk] INFO: Scrape type for VK10%20KPJ: 0
2026-03-29 22:09:11 [bca.uk] INFO: Found listing with ID: YE67%20KRX
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE67%2520KRX%27 HTTP/1.1" 200 None
2026-03-29 22:09:11 [bca.uk] INFO: Scrape type for YE67%20KRX: 0
2026-03-29 22:09:11 [bca.uk] INFO: Found listing with ID: RX66%20YGF
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX66%2520YGF%27 HTTP/1.1" 200 None
2026-03-29 22:09:11 [bca.uk] INFO: Scrape type for RX66%20YGF: 0
2026-03-29 22:09:11 [bca.uk] INFO: Found listing with ID: BX65%20XZP
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX65%2520XZP%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for BX65%20XZP: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: HY17%20KLO
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY17%2520KLO%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for HY17%20KLO: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: YH59%20GXB
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH59%2520GXB%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for YH59%20GXB: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: NX70%20KFF
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX70%2520KFF%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for NX70%20KFF: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: BD24%20OJP
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD24%2520OJP%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for BD24%20OJP: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: BV60%20VXT
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV60%2520VXT%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for BV60%20VXT: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: BX68%20WYV
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX68%2520WYV%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for BX68%20WYV: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: FP13%20WNN
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP13%2520WNN%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for FP13%20WNN: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: LS24%20EXV
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS24%2520EXV%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for LS24%20EXV: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: MK24%20ZBW
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK24%2520ZBW%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for MK24%20ZBW: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: MW74%20DWM
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW74%2520DWM%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for MW74%20DWM: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: MW74%20DWY
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW74%2520DWY%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for MW74%20DWY: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: LS62%20KHW
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS62%2520KHW%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for LS62%20KHW: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: MJ74%20PBU
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ74%2520PBU%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for MJ74%20PBU: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: MK74%20HBP
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK74%2520HBP%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for MK74%20HBP: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: VU24%20HZM
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU24%2520HZM%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for VU24%20HZM: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: BN25%20RFX
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN25%2520RFX%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for BN25%20RFX: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: MA24%20JNK
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA24%2520JNK%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for MA24%20JNK: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: MA74%20XZG
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA74%2520XZG%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for MA74%20XZG: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: DC66%20YYE
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC66%2520YYE%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for DC66%20YYE: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: KW70%20UST
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW70%2520UST%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for KW70%20UST: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: KN17%20YTF
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN17%2520YTF%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for KN17%20YTF: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: CK63%20KKN
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK63%2520KKN%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for CK63%20KKN: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: BK24%20HFU
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK24%2520HFU%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for BK24%20HFU: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: KF73%20DDU
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF73%2520DDU%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for KF73%20DDU: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: MH73%20VJA
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH73%2520VJA%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for MH73%20VJA: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: MJ73%20PXM
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ73%2520PXM%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for MJ73%20PXM: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: BD72%20HUJ
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD72%2520HUJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for BD72%20HUJ: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: PK72%20OLE
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK72%2520OLE%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for PK72%20OLE: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: DV74%20ORK
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV74%2520ORK%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for DV74%20ORK: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: SB61%20FZU
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB61%2520FZU%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for SB61%20FZU: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: BP72%20UKO
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP72%2520UKO%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for BP72%20UKO: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: CV73%20TVT
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV73%2520TVT%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for CV73%20TVT: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: GY24%20FOF
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY24%2520FOF%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for GY24%20FOF: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: LO73%20OTD
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO73%2520OTD%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for LO73%20OTD: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: BK25%20JPY
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK25%2520JPY%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for BK25%20JPY: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: BN25%20YFP
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN25%2520YFP%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for BN25%20YFP: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: ML24%20ZWD
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML24%2520ZWD%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for ML24%20ZWD: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: MP73%20JGY
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP73%2520JGY%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for MP73%20JGY: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: FE23%20WVO
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE23%2520WVO%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for FE23%20WVO: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: DL74%20WCW
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL74%2520WCW%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for DL74%20WCW: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: DL24%20KTE
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL24%2520KTE%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for DL24%20KTE: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: LC54%20OBX
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC54%2520OBX%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for LC54%20OBX: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: KP09%20NHV
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP09%2520NHV%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for KP09%20NHV: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: HD19%20BVL
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD19%2520BVL%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for HD19%20BVL: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: YR68%20LNT
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR68%2520LNT%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for YR68%20LNT: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: AO58%20XLV
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO58%2520XLV%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for AO58%20XLV: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: AY67%20XMG
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY67%2520XMG%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for AY67%20XMG: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: FP65%20XHH
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP65%2520XHH%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for FP65%20XHH: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: HF15%20WKE
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF15%2520WKE%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for HF15%20WKE: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: KS14%20BAA
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS14%2520BAA%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for KS14%20BAA: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: WK14%20MMJ
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK14%2520MMJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for WK14%20MMJ: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: WR63%20FVN
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR63%2520FVN%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for WR63%20FVN: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: WW66%20ATW
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WW66%2520ATW%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for WW66%20ATW: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: YC14%20HNO
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC14%2520HNO%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for YC14%20HNO: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: YT14%20AXC
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT14%2520AXC%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for YT14%20AXC: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: PE71%20WFO
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE71%2520WFO%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for PE71%20WFO: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: CV16%20UMD
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV16%2520UMD%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for CV16%20UMD: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: WG63%20CKL
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG63%2520CKL%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for WG63%20CKL: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: CJZ%205249
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CJZ%25205249%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for CJZ%205249: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: BK73%20UUW
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK73%2520UUW%27 HTTP/1.1" 200 None
2026-03-29 22:09:12 [bca.uk] INFO: Scrape type for BK73%20UUW: 0
2026-03-29 22:09:12 [bca.uk] INFO: Found listing with ID: HV74%20EPJ
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV74%2520EPJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for HV74%20EPJ: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: WP24%20EAF
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP24%2520EAF%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for WP24%20EAF: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: WT25%20FYY
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT25%2520FYY%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for WT25%20FYY: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: WV25%20PZF
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV25%2520PZF%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for WV25%20PZF: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: FG72%20LTY
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG72%2520LTY%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for FG72%20LTY: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: HY75%20LNV
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY75%2520LNV%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for HY75%20LNV: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: MK24%20ZJJ
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK24%2520ZJJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for MK24%20ZJJ: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: WF24%20RVO
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF24%2520RVO%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for WF24%20RVO: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: LS24%20WGD
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS24%2520WGD%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for LS24%20WGD: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: VO24%20UZR
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO24%2520UZR%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for VO24%20UZR: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: NL12%20XCO
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL12%2520XCO%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for NL12%20XCO: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: CF74%20HXJ
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF74%2520HXJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for CF74%20HXJ: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: ML24%20FWG
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML24%2520FWG%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for ML24%20FWG: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: BN74%20PFA
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN74%2520PFA%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for BN74%20PFA: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: BN74%20PFG
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN74%2520PFG%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for BN74%20PFG: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: CK20%20HYT
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK20%2520HYT%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for CK20%20HYT: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: CU67%20XXH
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU67%2520XXH%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for CU67%20XXH: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: NA68%20XGU
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA68%2520XGU%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for NA68%20XGU: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: NU21%20OGO
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU21%2520OGO%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for NU21%20OGO: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: WF21%20HLG
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF21%2520HLG%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for WF21%20HLG: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: WP18%20YCL
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP18%2520YCL%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for WP18%20YCL: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: BD16%20KZP
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD16%2520KZP%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for BD16%20KZP: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: CF24%20PVA
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF24%2520PVA%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for CF24%20PVA: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: YC18%20RMV
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC18%2520RMV%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for YC18%20RMV: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: DP23%20TKJ
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP23%2520TKJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for DP23%20TKJ: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: DP23%20TFA
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP23%2520TFA%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for DP23%20TFA: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: DP23%20UDX
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP23%2520UDX%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for DP23%20UDX: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: VO23%20XPB
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO23%2520XPB%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for VO23%20XPB: 0
2026-03-29 22:09:13 [bca.uk] INFO: Found listing with ID: DP23%20TDO
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP23%2520TDO%27 HTTP/1.1" 200 None
2026-03-29 22:09:13 [bca.uk] INFO: Scrape type for DP23%20TDO: 0
2026-03-29 22:09:13 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=35&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:13 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=35&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=35&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:09:15 [bca.uk] INFO: Total items found: 100
2026-03-29 22:09:15 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=36&sort=MostRecentlyAdded
2026-03-29 22:09:15 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:09:15 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=36&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: DP23%20TTV
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP23%2520TTV%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for DP23%20TTV: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: DP23%20TBV
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP23%2520TBV%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for DP23%20TBV: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: DP23%20TLK
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP23%2520TLK%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for DP23%20TLK: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: HX14%20DND
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX14%2520DND%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for HX14%20DND: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: AE69%20JHY
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE69%2520JHY%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for AE69%20JHY: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: BN22%20KRF
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN22%2520KRF%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for BN22%20KRF: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: CU22%20ZXR
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU22%2520ZXR%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for CU22%20ZXR: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: FD71%20JXN
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD71%2520JXN%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for FD71%20JXN: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: FH73%20MKE
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH73%2520MKE%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for FH73%20MKE: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: KE72%20LSK
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE72%2520LSK%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for KE72%20LSK: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: N28%20CVL
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27N28%2520CVL%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for N28%20CVL: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: NV19%20EUZ
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV19%2520EUZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for NV19%20EUZ: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: OV19%20VEK
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV19%2520VEK%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for OV19%20VEK: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: OV23%20GWX
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV23%2520GWX%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for OV23%20GWX: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: OY20%20RGO
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY20%2520RGO%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for OY20%20RGO: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: RJ70%20WKD
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ70%2520WKD%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for RJ70%20WKD: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: SJ21%20YDN
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ21%2520YDN%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for SJ21%20YDN: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: AF22%20UDK
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF22%2520UDK%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for AF22%20UDK: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: AW21%20DVU
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AW21%2520DVU%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for AW21%20DVU: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: BP72%20FTD
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP72%2520FTD%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for BP72%20FTD: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: BP72%20ZZO
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP72%2520ZZO%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for BP72%20ZZO: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: CV23%20KXX
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV23%2520KXX%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for CV23%20KXX: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: DE23%20JPO
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE23%2520JPO%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for DE23%20JPO: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: DG24%20FYS
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG24%2520FYS%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for DG24%20FYS: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: FJ21%20VJM
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ21%2520VJM%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for FJ21%20VJM: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: FJ71%20TZW
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ71%2520TZW%27 HTTP/1.1" 200 None
2026-03-29 22:09:15 [bca.uk] INFO: Scrape type for FJ71%20TZW: 0
2026-03-29 22:09:15 [bca.uk] INFO: Found listing with ID: FN22%20LFB
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN22%2520LFB%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for FN22%20LFB: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: GN73%20XFP
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN73%2520XFP%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for GN73%20XFP: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: GP21%20FTU
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP21%2520FTU%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for GP21%20FTU: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: GU23%20XLN
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU23%2520XLN%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for GU23%20XLN: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: GV71%20PYT
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV71%2520PYT%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for GV71%20PYT: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: HF21%20UKM
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF21%2520UKM%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for HF21%20UKM: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: HK72%20LDL
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK72%2520LDL%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for HK72%20LDL: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: KR71%20YZK
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR71%2520YZK%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for KR71%20YZK: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: LE21%20ONP
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LE21%2520ONP%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for LE21%20ONP: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: LJ21%20ANZ
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ21%2520ANZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for LJ21%20ANZ: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: LJ22%20YNM
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ22%2520YNM%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for LJ22%20YNM: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: LL73%20PTZ
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL73%2520PTZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for LL73%20PTZ: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: LM72%20OEH
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM72%2520OEH%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for LM72%20OEH: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: LN22%20XRO
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN22%2520XRO%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for LN22%20XRO: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: LN23%20XRZ
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN23%2520XRZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for LN23%20XRZ: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: LR22%20SKZ
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR22%2520SKZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for LR22%20SKZ: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: LS21%20UXD
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS21%2520UXD%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for LS21%20UXD: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: LY21%20FXP
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY21%2520FXP%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for LY21%20FXP: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: MA23%20LUR
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA23%2520LUR%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for MA23%20LUR: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: MA23%20UCM
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA23%2520UCM%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for MA23%20UCM: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: MF22%20THU
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF22%2520THU%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for MF22%20THU: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: MF22%20UNL
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF22%2520UNL%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for MF22%20UNL: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: MJ23%20GNK
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ23%2520GNK%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for MJ23%20GNK: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: MW71%20XLP
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW71%2520XLP%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for MW71%20XLP: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: NC21%20FCD
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC21%2520FCD%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for NC21%20FCD: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: NG23%20VZA
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG23%2520VZA%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for NG23%20VZA: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: NL23%20SYE
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL23%2520SYE%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for NL23%20SYE: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: NL72%20VLB
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL72%2520VLB%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for NL72%20VLB: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: OE72%20JDU
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE72%2520JDU%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for OE72%20JDU: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: OV23%20CVP
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV23%2520CVP%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for OV23%20CVP: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: OY25%20GNO
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY25%2520GNO%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for OY25%20GNO: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: PE71%20XBG
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE71%2520XBG%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for PE71%20XBG: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: RF70%20EGV
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF70%2520EGV%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for RF70%20EGV: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: RV23%20WJK
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV23%2520WJK%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for RV23%20WJK: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: SG22%20ORL
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG22%2520ORL%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for SG22%20ORL: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: SM22%20NNB
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM22%2520NNB%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for SM22%20NNB: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: VO23%20NNV
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO23%2520NNV%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for VO23%20NNV: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: WD24%20HDC
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD24%2520HDC%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for WD24%20HDC: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: WG72%20ORF
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG72%2520ORF%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for WG72%20ORF: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: WR71%20ZHH
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR71%2520ZHH%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for WR71%20ZHH: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: WX23%20GXK
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX23%2520GXK%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for WX23%20GXK: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: YK22%20TBV
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK22%2520TBV%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for YK22%20TBV: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: YK22%20TEO
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK22%2520TEO%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for YK22%20TEO: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: YK72%20UPF
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK72%2520UPF%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for YK72%20UPF: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: YP72%20NTM
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP72%2520NTM%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for YP72%20NTM: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: YR72%20HSU
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR72%2520HSU%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for YR72%20HSU: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: YT72%20CDF
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT72%2520CDF%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for YT72%20CDF: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: HX14%20FFC
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX14%2520FFC%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for HX14%20FFC: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: BX20%20OGT
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX20%2520OGT%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for BX20%20OGT: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: ML63%20NKT
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML63%2520NKT%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for ML63%20NKT: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: DC65%20VLJ
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC65%2520VLJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for DC65%20VLJ: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: WA20%20YHO
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA20%2520YHO%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for WA20%20YHO: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: Y20%20RDE
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y20%2520RDE%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for Y20%20RDE: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: YA12%20PDK
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA12%2520PDK%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for YA12%20PDK: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: YJ63%20CVO
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ63%2520CVO%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for YJ63%20CVO: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: YP60%20UFT
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP60%2520UFT%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for YP60%20UFT: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: FV64%20UGS
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV64%2520UGS%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for FV64%20UGS: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: GJ62%20OWW
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ62%2520OWW%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for GJ62%20OWW: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: HD66%20AYV
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD66%2520AYV%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for HD66%20AYV: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: HX65%20VZY
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX65%2520VZY%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for HX65%20VZY: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: KN60%20UXA
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN60%2520UXA%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for KN60%20UXA: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: LC62%20ENO
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC62%2520ENO%27 HTTP/1.1" 200 None
2026-03-29 22:09:16 [bca.uk] INFO: Scrape type for LC62%20ENO: 0
2026-03-29 22:09:16 [bca.uk] INFO: Found listing with ID: LS18%20GSV
2026-03-29 22:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS18%2520GSV%27 HTTP/1.1" 200 None
2026-03-29 22:09:17 [bca.uk] INFO: Scrape type for LS18%20GSV: 0
2026-03-29 22:09:17 [bca.uk] INFO: Found listing with ID: MV17%20GRK
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV17%2520GRK%27 HTTP/1.1" 200 None
2026-03-29 22:09:17 [bca.uk] INFO: Scrape type for MV17%20GRK: 0
2026-03-29 22:09:17 [bca.uk] INFO: Found listing with ID: BG12%20YSA
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG12%2520YSA%27 HTTP/1.1" 200 None
2026-03-29 22:09:17 [bca.uk] INFO: Scrape type for BG12%20YSA: 0
2026-03-29 22:09:17 [bca.uk] INFO: Found listing with ID: BJ59%20YSS
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ59%2520YSS%27 HTTP/1.1" 200 None
2026-03-29 22:09:17 [bca.uk] INFO: Scrape type for BJ59%20YSS: 0
2026-03-29 22:09:17 [bca.uk] INFO: Found listing with ID: BP06%20UJK
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP06%2520UJK%27 HTTP/1.1" 200 None
2026-03-29 22:09:17 [bca.uk] INFO: Scrape type for BP06%20UJK: 0
2026-03-29 22:09:17 [bca.uk] INFO: Found listing with ID: BV17%20NCY
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV17%2520NCY%27 HTTP/1.1" 200 None
2026-03-29 22:09:17 [bca.uk] INFO: Scrape type for BV17%20NCY: 0
2026-03-29 22:09:17 [bca.uk] INFO: Found listing with ID: DE18%20HKD
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE18%2520HKD%27 HTTP/1.1" 200 None
2026-03-29 22:09:17 [bca.uk] INFO: Scrape type for DE18%20HKD: 0
2026-03-29 22:09:17 [bca.uk] INFO: Found listing with ID: EA65%20ZCT
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA65%2520ZCT%27 HTTP/1.1" 200 None
2026-03-29 22:09:17 [bca.uk] INFO: Scrape type for EA65%20ZCT: 0
2026-03-29 22:09:17 [bca.uk] INFO: Found listing with ID: EX06%20UKK
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX06%2520UKK%27 HTTP/1.1" 200 None
2026-03-29 22:09:17 [bca.uk] INFO: Scrape type for EX06%20UKK: 0
2026-03-29 22:09:17 [bca.uk] INFO: Found listing with ID: DG67%20VFW
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG67%2520VFW%27 HTTP/1.1" 200 None
2026-03-29 22:09:17 [bca.uk] INFO: Scrape type for DG67%20VFW: 0
2026-03-29 22:09:17 [bca.uk] INFO: Found listing with ID: FT12%20FXJ
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT12%2520FXJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:17 [bca.uk] INFO: Scrape type for FT12%20FXJ: 0
2026-03-29 22:09:17 [bca.uk] INFO: Found listing with ID: RK63%20MWY
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK63%2520MWY%27 HTTP/1.1" 200 None
2026-03-29 22:09:17 [bca.uk] INFO: Scrape type for RK63%20MWY: 0
2026-03-29 22:09:17 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=36&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:17 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=36&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=36&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:09:20 [bca.uk] INFO: Total items found: 100
2026-03-29 22:09:20 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=37&sort=MostRecentlyAdded
2026-03-29 22:09:20 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:09:20 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=37&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: RV12%20MMU
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV12%2520MMU%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for RV12%20MMU: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: AE63%20YYL
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE63%2520YYL%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for AE63%20YYL: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: LC16%20NGZ
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC16%2520NGZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for LC16%20NGZ: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: LN59%20YGP
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN59%2520YGP%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for LN59%20YGP: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: NC54%20KGO
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC54%2520KGO%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for NC54%20KGO: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: WD64%20EXR
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD64%2520EXR%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for WD64%20EXR: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: BN60%20OLC
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN60%2520OLC%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for BN60%20OLC: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: DA59%20JYT
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA59%2520JYT%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for DA59%20JYT: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: DN65%20HSO
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN65%2520HSO%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for DN65%20HSO: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: FE60%20VKH
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE60%2520VKH%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for FE60%20VKH: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: GU14%20OGB
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU14%2520OGB%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for GU14%20OGB: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: VA16%20LRV
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA16%2520LRV%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for VA16%20LRV: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: AO12%20GNP
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO12%2520GNP%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for AO12%20GNP: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: BK64%20AOB
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK64%2520AOB%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for BK64%20AOB: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: DU67%20LVD
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU67%2520LVD%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for DU67%20LVD: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: EK56%20PGO
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK56%2520PGO%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for EK56%20PGO: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: EN59%20AMK
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN59%2520AMK%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for EN59%20AMK: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: EY08%20YGX
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY08%2520YGX%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for EY08%20YGX: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: LF61%20YNV
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF61%2520YNV%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for LF61%20YNV: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: LS06%20OUH
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS06%2520OUH%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for LS06%20OUH: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: NU66%20PYW
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU66%2520PYW%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for NU66%20PYW: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: PE58%20NTM
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE58%2520NTM%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for PE58%20NTM: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: VN68%20KUJ
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN68%2520KUJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for VN68%20KUJ: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: NL23%20SUU
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL23%2520SUU%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for NL23%20SUU: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: GK19%20YXX
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK19%2520YXX%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for GK19%20YXX: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: YP58%20TBU
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP58%2520TBU%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for YP58%20TBU: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: HG07%20WOA
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG07%2520WOA%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for HG07%20WOA: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: KC57%20UUR
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KC57%2520UUR%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for KC57%20UUR: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: KG05%20BVL
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KG05%2520BVL%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for KG05%20BVL: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: LA56%20LHG
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA56%2520LHG%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for LA56%20LHG: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: LC05%20LHB
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC05%2520LHB%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for LC05%20LHB: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: LG61%20WYL
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG61%2520WYL%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for LG61%20WYL: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: LV13%20WFN
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV13%2520WFN%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for LV13%20WFN: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: MJ61%20XRS
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ61%2520XRS%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for MJ61%20XRS: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: NA69%20XBT
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA69%2520XBT%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for NA69%20XBT: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: SD13%20SXO
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD13%2520SXO%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for SD13%20SXO: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: SG09%20FNU
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG09%2520FNU%27 HTTP/1.1" 200 None
2026-03-29 22:09:20 [bca.uk] INFO: Scrape type for SG09%20FNU: 0
2026-03-29 22:09:20 [bca.uk] INFO: Found listing with ID: SM61%20URB
2026-03-29 22:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM61%2520URB%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for SM61%20URB: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: VF07%20KYX
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF07%2520KYX%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for VF07%20KYX: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: WG63%20YYE
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG63%2520YYE%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for WG63%20YYE: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: WJ07%20XUC
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ07%2520XUC%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for WJ07%20XUC: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: DF14%20TKV
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF14%2520TKV%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for DF14%20TKV: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: DU16%20VYC
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU16%2520VYC%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for DU16%20VYC: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: EJ14%20VDR
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ14%2520VDR%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for EJ14%20VDR: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: GJ61%20FMC
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ61%2520FMC%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for GJ61%20FMC: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: GU64%20NXK
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU64%2520NXK%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for GU64%20NXK: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: HD07%20EZL
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD07%2520EZL%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for HD07%20EZL: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: VK23%20RVT
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK23%2520RVT%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for VK23%20RVT: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: FV59%20MFZ
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV59%2520MFZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for FV59%20MFZ: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: GX63%20OJP
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX63%2520OJP%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for GX63%20OJP: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: KS58%20OPT
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS58%2520OPT%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for KS58%20OPT: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: LM62%20GWZ
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM62%2520GWZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for LM62%20GWZ: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: MJ62%20EOL
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ62%2520EOL%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for MJ62%20EOL: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: NJ60%20NMX
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ60%2520NMX%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for NJ60%20NMX: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: SH18%20GZJ
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH18%2520GZJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for SH18%20GZJ: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: AC59%20DAC
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AC59%2520DAC%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for AC59%20DAC: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: FD63%20KVK
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD63%2520KVK%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for FD63%20KVK: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: FL72%20ZHH
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL72%2520ZHH%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for FL72%20ZHH: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: SW13%20EBX
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW13%2520EBX%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for SW13%20EBX: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: EK57%20YWZ
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK57%2520YWZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for EK57%20YWZ: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: PF67%20ENX
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF67%2520ENX%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for PF67%20ENX: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: WP14%20FBF
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP14%2520FBF%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for WP14%20FBF: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: WT16%20KKB
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT16%2520KKB%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for WT16%20KKB: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: YB66%20CAV
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB66%2520CAV%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for YB66%20CAV: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: YP61%20WOR
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP61%2520WOR%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for YP61%20WOR: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: YX14%20ORY
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX14%2520ORY%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for YX14%20ORY: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: SH09%20CPE
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH09%2520CPE%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for SH09%20CPE: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: SV60%20MXJ
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV60%2520MXJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for SV60%20MXJ: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: FH10%20OZN
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH10%2520OZN%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for FH10%20OZN: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: NX67%20XBD
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX67%2520XBD%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for NX67%20XBD: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: YM24%20JBU
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM24%2520JBU%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for YM24%20JBU: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: YG17%20ONF
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG17%2520ONF%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for YG17%20ONF: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: YH61%20SGV
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH61%2520SGV%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for YH61%20SGV: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: DN58%20UWL
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN58%2520UWL%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for DN58%20UWL: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: NJ09%20OGF
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ09%2520OGF%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for NJ09%20OGF: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: PK12%20TXL
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK12%2520TXL%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for PK12%20TXL: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: PX08%20GWJ
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX08%2520GWJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for PX08%20GWJ: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: RF12%20FYR
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF12%2520FYR%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for RF12%20FYR: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: WG19%20UHJ
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG19%2520UHJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for WG19%20UHJ: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: WP62%20XYU
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP62%2520XYU%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for WP62%20XYU: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: PL73%20JNF
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL73%2520JNF%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for PL73%20JNF: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: RO22%20NRL
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO22%2520NRL%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for RO22%20NRL: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: FG65%20XLO
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG65%2520XLO%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for FG65%20XLO: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: FG68%20DDA
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG68%2520DDA%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for FG68%20DDA: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: FJ14%20YWV
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ14%2520YWV%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for FJ14%20YWV: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: KN19%20TJW
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN19%2520TJW%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for KN19%20TJW: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: SP12%20XJU
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP12%2520XJU%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for SP12%20XJU: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: SW15%20NYA
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW15%2520NYA%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for SW15%20NYA: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: Y676%20PLE
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y676%2520PLE%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for Y676%20PLE: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: DG13%20DVZ
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG13%2520DVZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for DG13%20DVZ: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: DL67%20NKJ
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL67%2520NKJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for DL67%20NKJ: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: NL12%20MVO
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL12%2520MVO%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for NL12%20MVO: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: RJ22%20EBZ
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ22%2520EBZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for RJ22%20EBZ: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: KS64%20PHK
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS64%2520PHK%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for KS64%20PHK: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: EN62%20ZKT
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN62%2520ZKT%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for EN62%20ZKT: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: LS14%20SFJ
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS14%2520SFJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for LS14%20SFJ: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: LS54%20SVP
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS54%2520SVP%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for LS54%20SVP: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: LT11%20NGE
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT11%2520NGE%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for LT11%20NGE: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: LX12%20APO
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX12%2520APO%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for LX12%20APO: 0
2026-03-29 22:09:21 [bca.uk] INFO: Found listing with ID: M60%20MSU
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M60%2520MSU%27 HTTP/1.1" 200 None
2026-03-29 22:09:21 [bca.uk] INFO: Scrape type for M60%20MSU: 0
2026-03-29 22:09:21 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=37&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:21 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=37&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=37&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:09:23 [bca.uk] INFO: Total items found: 100
2026-03-29 22:09:23 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=38&sort=MostRecentlyAdded
2026-03-29 22:09:23 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:09:23 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=38&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: MJ10%20HPE
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ10%2520HPE%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for MJ10%20HPE: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: MK14%20VLE
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK14%2520VLE%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for MK14%20VLE: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: NL61%20FOD
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL61%2520FOD%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for NL61%20FOD: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: RJ17%20SVK
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ17%2520SVK%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for RJ17%20SVK: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: SP13%20VCL
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP13%2520VCL%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for SP13%20VCL: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: VE16%20FUD
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE16%2520FUD%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for VE16%20FUD: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: BD16%20ZNJ
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD16%2520ZNJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for BD16%20ZNJ: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: BN63%20JDF
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN63%2520JDF%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for BN63%20JDF: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: DU12%20AXD
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU12%2520AXD%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for DU12%20AXD: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: EA19%20FCD
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA19%2520FCD%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for EA19%20FCD: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: GU62%20WMM
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU62%2520WMM%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for GU62%20WMM: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: GY14%20KTD
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY14%2520KTD%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for GY14%20KTD: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: KF05%20WVN
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF05%2520WVN%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for KF05%20WVN: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: LN11%20SXC
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN11%2520SXC%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for LN11%20SXC: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: WK14%20WOD
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK14%2520WOD%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for WK14%20WOD: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: DL64%20MPX
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL64%2520MPX%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for DL64%20MPX: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: SF16%20SMW
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF16%2520SMW%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for SF16%20SMW: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: EX14%20FSZ
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX14%2520FSZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for EX14%20FSZ: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: FE65%20UJU
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE65%2520UJU%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for FE65%20UJU: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: HK15%20VKT
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK15%2520VKT%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for HK15%20VKT: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: KV57%20GEK
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV57%2520GEK%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for KV57%20GEK: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: KY65%20TBU
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY65%2520TBU%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for KY65%20TBU: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: N13%20GWM
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27N13%2520GWM%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for N13%20GWM: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: PL14%20HJK
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL14%2520HJK%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for PL14%20HJK: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: VE65%20YLT
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE65%2520YLT%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for VE65%20YLT: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: WG62%20WDW
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG62%2520WDW%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for WG62%20WDW: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: WU05%20WWZ
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU05%2520WWZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for WU05%20WWZ: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: AV17%20OEJ
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV17%2520OEJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for AV17%20OEJ: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: CA62%20PRV
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA62%2520PRV%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for CA62%20PRV: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: CK18%20EYV
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520EYV%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for CK18%20EYV: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: CU65%20MXK
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU65%2520MXK%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for CU65%20MXK: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: CV58%20YNE
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV58%2520YNE%27 HTTP/1.1" 200 None
2026-03-29 22:09:23 [bca.uk] INFO: Scrape type for CV58%20YNE: 0
2026-03-29 22:09:23 [bca.uk] INFO: Found listing with ID: CV64%20HRP
2026-03-29 22:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV64%2520HRP%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for CV64%20HRP: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: DG64%20SWO
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG64%2520SWO%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for DG64%20SWO: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: DN14%20GKA
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN14%2520GKA%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for DN14%20GKA: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: DN62%20GZL
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN62%2520GZL%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for DN62%20GZL: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: DN67%20DUH
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN67%2520DUH%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for DN67%20DUH: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: EN15%20YTY
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN15%2520YTY%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for EN15%20YTY: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: SJ07%20LJK
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ07%2520LJK%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for SJ07%20LJK: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: WG11%20KFJ
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG11%2520KFJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for WG11%20KFJ: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: WK59%20VGD
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK59%2520VGD%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for WK59%20VGD: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: WK61%20THG
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK61%2520THG%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for WK61%20THG: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: WV64%20PJX
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV64%2520PJX%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for WV64%20PJX: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: YE10%20LCX
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE10%2520LCX%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for YE10%20LCX: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: BR53%20NNR
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BR53%2520NNR%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for BR53%20NNR: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: DK10%20USC
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK10%2520USC%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for DK10%20USC: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: GY60%20KSU
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY60%2520KSU%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for GY60%20KSU: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: LR61%20CGG
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR61%2520CGG%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for LR61%20CGG: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: MA17%20EEJ
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA17%2520EEJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for MA17%20EEJ: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: NA10%20FLB
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA10%2520FLB%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for NA10%20FLB: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: RJ13%20ABV
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ13%2520ABV%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for RJ13%20ABV: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: KN71%20FCZ
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN71%2520FCZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for KN71%20FCZ: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: KN71%20FFC
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN71%2520FFC%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for KN71%20FFC: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: KN71%20FHS
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN71%2520FHS%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for KN71%20FHS: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: DV13%20YRE
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV13%2520YRE%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for DV13%20YRE: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: GF59%20YWE
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF59%2520YWE%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for GF59%20YWE: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: ND15%20CVZ
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND15%2520CVZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for ND15%20CVZ: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: DA03%20RYT
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA03%2520RYT%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for DA03%20RYT: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: SM57%20UMV
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM57%2520UMV%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for SM57%20UMV: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: VA12%20NWM
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA12%2520NWM%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for VA12%20NWM: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: VE61%20YSX
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE61%2520YSX%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for VE61%20YSX: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: WF11%20YRA
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF11%2520YRA%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for WF11%20YRA: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: WP12%20KFK
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP12%2520KFK%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for WP12%20KFK: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: WU58%20MYB
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU58%2520MYB%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for WU58%20MYB: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: KP61%20YTC
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP61%2520YTC%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for KP61%20YTC: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: KR58%20KAE
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR58%2520KAE%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for KR58%20KAE: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: KV57%20OHT
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV57%2520OHT%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for KV57%20OHT: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: KY12%20OTH
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY12%2520OTH%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for KY12%20OTH: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: LC08%20BYV
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC08%2520BYV%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for LC08%20BYV: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: LC69%20YNW
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC69%2520YNW%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for LC69%20YNW: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: LD62%20FVN
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD62%2520FVN%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for LD62%20FVN: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: MC65%20YPK
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC65%2520YPK%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for MC65%20YPK: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: MV59%20ZYR
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV59%2520ZYR%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for MV59%20ZYR: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: RJ61%20VZV
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ61%2520VZV%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for RJ61%20VZV: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: RO09%20DFE
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO09%2520DFE%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for RO09%20DFE: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: DV67%20ZNZ
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV67%2520ZNZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for DV67%20ZNZ: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: EA09%20NJX
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA09%2520NJX%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for EA09%20NJX: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: EY13%20EWC
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY13%2520EWC%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for EY13%20EWC: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: GF13%20ZSN
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF13%2520ZSN%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for GF13%20ZSN: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: GK62%20SWZ
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK62%2520SWZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for GK62%20SWZ: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: GV68%20SRZ
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV68%2520SRZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for GV68%20SRZ: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: HG58%20ENY
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG58%2520ENY%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for HG58%20ENY: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: KN65%20XDZ
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN65%2520XDZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for KN65%20XDZ: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: KO18%20FFN
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO18%2520FFN%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for KO18%20FFN: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: KP11%20KHM
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP11%2520KHM%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for KP11%20KHM: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: FY11%20XAM
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY11%2520XAM%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for FY11%20XAM: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: PN13%20LJJ
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN13%2520LJJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for PN13%20LJJ: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: SM11%20WBL
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM11%2520WBL%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for SM11%20WBL: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: YP62%20EVF
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP62%2520EVF%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for YP62%20EVF: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: YR66%20CZW
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR66%2520CZW%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for YR66%20CZW: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: DU11%20KVT
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU11%2520KVT%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for DU11%20KVT: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: KY64%20PXG
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY64%2520PXG%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for KY64%20PXG: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: LN66%20SHZ
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN66%2520SHZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for LN66%20SHZ: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: MA13%20NFL
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA13%2520NFL%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for MA13%20NFL: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: NJ60%20SXP
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ60%2520SXP%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for NJ60%20SXP: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: SH10%20BVC
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH10%2520BVC%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for SH10%20BVC: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: SJ14%20NOF
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ14%2520NOF%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for SJ14%20NOF: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: SJ65%20XUT
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ65%2520XUT%27 HTTP/1.1" 200 None
2026-03-29 22:09:24 [bca.uk] INFO: Scrape type for SJ65%20XUT: 0
2026-03-29 22:09:24 [bca.uk] INFO: Found listing with ID: KJ18%20SXG
2026-03-29 22:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ18%2520SXG%27 HTTP/1.1" 200 None
2026-03-29 22:09:25 [bca.uk] INFO: Scrape type for KJ18%20SXG: 0
2026-03-29 22:09:25 [bca.uk] INFO: Found listing with ID: LJ64%20UMR
2026-03-29 22:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ64%2520UMR%27 HTTP/1.1" 200 None
2026-03-29 22:09:25 [bca.uk] INFO: Scrape type for LJ64%20UMR: 0
2026-03-29 22:09:25 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=38&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:25 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=38&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=38&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:09:56 [bca.uk] INFO: Total items found: 100
2026-03-29 22:09:56 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=39&sort=MostRecentlyAdded
2026-03-29 22:09:56 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:09:56 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=39&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: LV13%20EXZ
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV13%2520EXZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for LV13%20EXZ: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: NA15%20UTV
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA15%2520UTV%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for NA15%20UTV: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: OU64%20WOH
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU64%2520WOH%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for OU64%20WOH: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: EK13%20RKJ
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK13%2520RKJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for EK13%20RKJ: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: EO60%20LVJ
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO60%2520LVJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for EO60%20LVJ: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: ET15%20LNC
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET15%2520LNC%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for ET15%20LNC: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: PN09%20VVK
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN09%2520VVK%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for PN09%20VVK: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: YJ69%20DTA
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ69%2520DTA%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for YJ69%20DTA: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: AJ73%20DVM
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ73%2520DVM%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for AJ73%20DVM: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: SF68%20RVN
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF68%2520RVN%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for SF68%20RVN: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: SG22%20VOH
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG22%2520VOH%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for SG22%20VOH: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: SG22%20VPC
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG22%2520VPC%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for SG22%20VPC: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: FE18%20XLP
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE18%2520XLP%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for FE18%20XLP: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: SA21%20LUT
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA21%2520LUT%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for SA21%20LUT: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: SB15%20HFS
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB15%2520HFS%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for SB15%20HFS: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: SB64%20ARZ
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB64%2520ARZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for SB64%20ARZ: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: SB71%20XEU
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB71%2520XEU%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for SB71%20XEU: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: SC23%20RKV
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC23%2520RKV%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for SC23%20RKV: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: SG17%20YRD
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG17%2520YRD%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for SG17%20YRD: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: SH16%20TWD
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH16%2520TWD%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for SH16%20TWD: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: SJ72%20JEO
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ72%2520JEO%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for SJ72%20JEO: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: SN22%20OPG
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN22%2520OPG%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for SN22%20OPG: 0
2026-03-29 22:09:56 [bca.uk] INFO: Found listing with ID: SP72%20PWY
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP72%2520PWY%27 HTTP/1.1" 200 None
2026-03-29 22:09:56 [bca.uk] INFO: Scrape type for SP72%20PWY: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: VK21%20WLP
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK21%2520WLP%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for VK21%20WLP: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: YF19%20FJL
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF19%2520FJL%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for YF19%20FJL: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: YL17%20EWF
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL17%2520EWF%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for YL17%20EWF: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: AJ13%20LKF
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ13%2520LKF%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for AJ13%20LKF: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: LB14%20KBJ
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB14%2520KBJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for LB14%20KBJ: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: AF23%20ELH
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF23%2520ELH%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for AF23%20ELH: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: AJ72%20GVR
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ72%2520GVR%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for AJ72%20GVR: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: AV73%20UYJ
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV73%2520UYJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for AV73%20UYJ: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: BG72%20DUH
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG72%2520DUH%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for BG72%20DUH: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: CJ71%20KAA
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CJ71%2520KAA%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for CJ71%20KAA: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: FV24%20VKM
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV24%2520VKM%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for FV24%20VKM: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: FV71%20XER
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV71%2520XER%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for FV71%20XER: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: GN23%20XUZ
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN23%2520XUZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for GN23%20XUZ: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: KN23%20ZSZ
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN23%2520ZSZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for KN23%20ZSZ: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: KP72%20XUH
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP72%2520XUH%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for KP72%20XUH: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: LL72%20GLZ
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL72%2520GLZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for LL72%20GLZ: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: LO23%20MLK
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO23%2520MLK%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for LO23%20MLK: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: LR22%20HKP
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR22%2520HKP%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for LR22%20HKP: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: MA23%20LXR
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA23%2520LXR%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for MA23%20LXR: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: MA23%20OOJ
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA23%2520OOJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for MA23%20OOJ: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: MW72%20XOK
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW72%2520XOK%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for MW72%20XOK: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: NG72%20DVV
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG72%2520DVV%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for NG72%20DVV: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: OY22%20XCS
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY22%2520XCS%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for OY22%20XCS: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: RY24%20YBA
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY24%2520YBA%27 HTTP/1.1" 200 None
2026-03-29 22:09:57 [bca.uk] INFO: Scrape type for RY24%20YBA: 0
2026-03-29 22:09:57 [bca.uk] INFO: Found listing with ID: SJ23%20YZX
2026-03-29 22:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ23%2520YZX%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for SJ23%20YZX: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: WU23%20ESO
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU23%2520ESO%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for WU23%20ESO: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: WX67%20WPZ
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX67%2520WPZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for WX67%20WPZ: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: AP71%20GFY
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP71%2520GFY%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for AP71%20GFY: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: RJ68%20ECE
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ68%2520ECE%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for RJ68%20ECE: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: WR21%20YPP
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR21%2520YPP%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for WR21%20YPP: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: SN68%20GKV
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN68%2520GKV%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for SN68%20GKV: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: BG70%20NZK
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG70%2520NZK%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for BG70%20NZK: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: FG70%20HJC
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG70%2520HJC%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for FG70%20HJC: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: LY74%20OPG
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY74%2520OPG%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for LY74%20OPG: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: VO70%20KWG
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO70%2520KWG%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for VO70%20KWG: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: WG71%20LHX
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG71%2520LHX%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for WG71%20LHX: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: YD73%20JXJ
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD73%2520JXJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for YD73%20JXJ: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: CP23%20PXJ
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP23%2520PXJ%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for CP23%20PXJ: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: DP72%20HJG
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP72%2520HJG%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for DP72%20HJG: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: LV72%20OEZ
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV72%2520OEZ%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for LV72%20OEZ: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: RJ22%20XKS
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ22%2520XKS%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for RJ22%20XKS: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: RN19%20HSK
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RN19%2520HSK%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for RN19%20HSK: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: VE25%20AFN
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE25%2520AFN%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for VE25%20AFN: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: VN25%20RXF
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN25%2520RXF%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for VN25%20RXF: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: VN25%20ZZD
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN25%2520ZZD%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for VN25%20ZZD: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: VN25%20ZZV
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN25%2520ZZV%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for VN25%20ZZV: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: YC25%20WVA
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC25%2520WVA%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for YC25%20WVA: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: AX72%20KBF
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX72%2520KBF%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for AX72%20KBF: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: BT72%20GFG
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT72%2520GFG%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for BT72%20GFG: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: DL73%20KXW
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL73%2520KXW%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for DL73%20KXW: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: DV24%20BYX
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV24%2520BYX%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for DV24%20BYX: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: DV24%20CFM
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV24%2520CFM%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for DV24%20CFM: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: DV24%20JSU
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV24%2520JSU%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for DV24%20JSU: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: GM23%20LHE
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM23%2520LHE%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for GM23%20LHE: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: GM23%20LHG
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM23%2520LHG%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for GM23%20LHG: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: GV74%20XKX
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV74%2520XKX%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for GV74%20XKX: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: GY24%20TWL
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY24%2520TWL%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for GY24%20TWL: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: KE23%20CUC
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE23%2520CUC%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for KE23%20CUC: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: KE73%20YZH
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE73%2520YZH%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for KE73%20YZH: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: KF73%20AUY
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF73%2520AUY%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for KF73%20AUY: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: KF73%20CXE
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF73%2520CXE%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for KF73%20CXE: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: KJ23%20NMA
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ23%2520NMA%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for KJ23%20NMA: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: KK23%20BVW
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK23%2520BVW%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for KK23%20BVW: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: LL74%20DYY
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL74%2520DYY%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for LL74%20DYY: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: LN24%20PYB
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN24%2520PYB%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for LN24%20PYB: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: LN24%20RHA
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN24%2520RHA%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for LN24%20RHA: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: LN24%20RNF
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN24%2520RNF%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for LN24%20RNF: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: LN24%20RVF
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN24%2520RVF%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for LN24%20RVF: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: LO74%20XZE
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO74%2520XZE%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for LO74%20XZE: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: LP73%20DKN
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP73%2520DKN%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for LP73%20DKN: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: LT22%20VLG
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT22%2520VLG%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for LT22%20VLG: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: MA24%20FLV
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA24%2520FLV%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for MA24%20FLV: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: MA24%20FSV
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA24%2520FSV%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for MA24%20FSV: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: ME73%20NHC
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ME73%2520NHC%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for ME73%20NHC: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: MJ74%20HDD
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ74%2520HDD%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for MJ74%20HDD: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: MW74%20DFF
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW74%2520DFF%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for MW74%20DFF: 0
2026-03-29 22:09:58 [bca.uk] INFO: Found listing with ID: MW74%20DLO
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW74%2520DLO%27 HTTP/1.1" 200 None
2026-03-29 22:09:58 [bca.uk] INFO: Scrape type for MW74%20DLO: 0
2026-03-29 22:09:58 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=39&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:58 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=39&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:09:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=39&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:10:00 [bca.uk] INFO: Total items found: 100
2026-03-29 22:10:00 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=40&sort=MostRecentlyAdded
2026-03-29 22:10:00 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:10:00 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=40&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: MW74%20NRL
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW74%2520NRL%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for MW74%20NRL: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: RX73%20KSU
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX73%2520KSU%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for RX73%20KSU: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: WM72%20RXO
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM72%2520RXO%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for WM72%20RXO: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: WP74%20CWK
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP74%2520CWK%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for WP74%20CWK: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: WV74%20OCH
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV74%2520OCH%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for WV74%20OCH: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: YF23%20UOA
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF23%2520UOA%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for YF23%20UOA: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: YY73%20XEC
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520XEC%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for YY73%20XEC: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: YY73%20XHZ
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520XHZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for YY73%20XHZ: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: YY73%20XJD
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520XJD%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for YY73%20XJD: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: CP18%20SYV
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP18%2520SYV%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for CP18%20SYV: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: KX68%20NDF
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX68%2520NDF%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for KX68%20NDF: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: OY18%20CXR
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY18%2520CXR%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for OY18%20CXR: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: PX67%20WMY
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX67%2520WMY%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for PX67%20WMY: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: SV14%20XST
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV14%2520XST%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for SV14%20XST: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: SW69%20PGF
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW69%2520PGF%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for SW69%20PGF: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: EO17%20NNT
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO17%2520NNT%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for EO17%20NNT: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: GB67%20HRV
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GB67%2520HRV%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for GB67%20HRV: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: KV68%20XLU
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV68%2520XLU%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for KV68%20XLU: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: LC22%20KRD
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC22%2520KRD%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for LC22%20KRD: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: LC72%20DHL
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC72%2520DHL%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for LC72%20DHL: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: LL70%20FHT
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL70%2520FHT%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for LL70%20FHT: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: LV24%20JUC
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV24%2520JUC%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for LV24%20JUC: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: OE68%20UGJ
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE68%2520UGJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for OE68%20UGJ: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: SE70%20BUP
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE70%2520BUP%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for SE70%20BUP: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: YC17%20ZWS
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC17%2520ZWS%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for YC17%20ZWS: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: BD71%20ZCE
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD71%2520ZCE%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for BD71%20ZCE: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: KN69%20EOF
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN69%2520EOF%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for KN69%20EOF: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: BV68%20BNK
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV68%2520BNK%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for BV68%20BNK: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: DU25%20CDO
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU25%2520CDO%27 HTTP/1.1" 200 None
2026-03-29 22:10:00 [bca.uk] INFO: Scrape type for DU25%20CDO: 0
2026-03-29 22:10:00 [bca.uk] INFO: Found listing with ID: CA14%20HKM
2026-03-29 22:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA14%2520HKM%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for CA14%20HKM: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: EA71%20ATN
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA71%2520ATN%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for EA71%20ATN: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: EA73%20HHR
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA73%2520HHR%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for EA73%20HHR: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: EN68%20RVC
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN68%2520RVC%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for EN68%20RVC: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: EX23%20AYH
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX23%2520AYH%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for EX23%20AYH: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: EY72%20LOD
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY72%2520LOD%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for EY72%20LOD: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: HG69%20EAF
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG69%2520EAF%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for HG69%20EAF: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: KF24%20OBP
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF24%2520OBP%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for KF24%20OBP: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: LS22%20FOV
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS22%2520FOV%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for LS22%20FOV: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: LX22%20NPA
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX22%2520NPA%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for LX22%20NPA: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: WP72%20LTT
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP72%2520LTT%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for WP72%20LTT: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: BG74%20HTT
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG74%2520HTT%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for BG74%20HTT: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: AF22%20VPJ
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF22%2520VPJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for AF22%20VPJ: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: LD21%20WJN
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD21%2520WJN%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for LD21%20WJN: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: BL72%20XBS
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL72%2520XBS%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for BL72%20XBS: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: BV22%20KKH
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV22%2520KKH%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for BV22%20KKH: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: CN22%20XKK
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN22%2520XKK%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for CN22%20XKK: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: DY22%20HSD
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY22%2520HSD%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for DY22%20HSD: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: JL22%20JRL
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JL22%2520JRL%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for JL22%20JRL: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: OE23%20NVT
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE23%2520NVT%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for OE23%20NVT: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: OW72%20ESG
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW72%2520ESG%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for OW72%20ESG: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: PY23%20MYL
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY23%2520MYL%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for PY23%20MYL: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: SL72%20LLG
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL72%2520LLG%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for SL72%20LLG: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: WN69%20OMC
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN69%2520OMC%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for WN69%20OMC: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: WP71%20XJM
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP71%2520XJM%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for WP71%20XJM: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: WR72%20NFL
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR72%2520NFL%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for WR72%20NFL: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: WV23%20VRE
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV23%2520VRE%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for WV23%20VRE: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: WV71%20SYU
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV71%2520SYU%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for WV71%20SYU: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: YR22%20XOS
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR22%2520XOS%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for YR22%20XOS: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: CE73%20GNO
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE73%2520GNO%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for CE73%20GNO: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: HJ72%20LSK
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ72%2520LSK%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for HJ72%20LSK: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: HJ73%20NVZ
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ73%2520NVZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for HJ73%20NVZ: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: KN22%20FCJ
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN22%2520FCJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for KN22%20FCJ: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: VE69%20TZS
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE69%2520TZS%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for VE69%20TZS: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: WR72%20NFF
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR72%2520NFF%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for WR72%20NFF: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: YL22%20LFZ
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL22%2520LFZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for YL22%20LFZ: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: LV75%20ODE
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV75%2520ODE%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for LV75%20ODE: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: SN71%20LRF
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN71%2520LRF%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for SN71%20LRF: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: SO21%20GWZ
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO21%2520GWZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for SO21%20GWZ: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: YA71%20PSU
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA71%2520PSU%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for YA71%20PSU: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: BP72%20FJN
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP72%2520FJN%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for BP72%20FJN: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: BT72%20MWN
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT72%2520MWN%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for BT72%20MWN: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: WA19%20NEN
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA19%2520NEN%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for WA19%20NEN: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: YH14%20LRL
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH14%2520LRL%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for YH14%20LRL: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: BU22%20TFA
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU22%2520TFA%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for BU22%20TFA: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: GV72%20KDZ
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV72%2520KDZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for GV72%20KDZ: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: HV22%20ZSJ
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV22%2520ZSJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for HV22%20ZSJ: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: HV72%20WUX
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV72%2520WUX%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for HV72%20WUX: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: LR21%20YCX
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR21%2520YCX%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for LR21%20YCX: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: OV23%20CWD
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV23%2520CWD%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for OV23%20CWD: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: RA73%20DWD
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA73%2520DWD%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for RA73%20DWD: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: YG22%20UMR
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG22%2520UMR%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for YG22%20UMR: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: YM74%20WVO
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM74%2520WVO%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for YM74%20WVO: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: ME21%20CKL
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ME21%2520CKL%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for ME21%20CKL: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: RE22%20NXV
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE22%2520NXV%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for RE22%20NXV: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: KR71%20ZNS
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR71%2520ZNS%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for KR71%20ZNS: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: YF66%20KXE
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF66%2520KXE%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for YF66%20KXE: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: BN20%20EGF
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN20%2520EGF%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for BN20%20EGF: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: PK15%20OTH
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK15%2520OTH%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for PK15%20OTH: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: PJ10%20BZK
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ10%2520BZK%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for PJ10%20BZK: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: RF18%20AEK
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF18%2520AEK%27 HTTP/1.1" 200 None
2026-03-29 22:10:01 [bca.uk] INFO: Scrape type for RF18%20AEK: 0
2026-03-29 22:10:01 [bca.uk] INFO: Found listing with ID: SN61%20GDO
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN61%2520GDO%27 HTTP/1.1" 200 None
2026-03-29 22:10:02 [bca.uk] INFO: Scrape type for SN61%20GDO: 0
2026-03-29 22:10:02 [bca.uk] INFO: Found listing with ID: WP72%20FXD
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP72%2520FXD%27 HTTP/1.1" 200 None
2026-03-29 22:10:02 [bca.uk] INFO: Scrape type for WP72%20FXD: 0
2026-03-29 22:10:02 [bca.uk] INFO: Found listing with ID: WA11%20CDO
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA11%2520CDO%27 HTTP/1.1" 200 None
2026-03-29 22:10:02 [bca.uk] INFO: Scrape type for WA11%20CDO: 0
2026-03-29 22:10:02 [bca.uk] INFO: Found listing with ID: ET21%20SCO
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET21%2520SCO%27 HTTP/1.1" 200 None
2026-03-29 22:10:02 [bca.uk] INFO: Scrape type for ET21%20SCO: 0
2026-03-29 22:10:02 [bca.uk] INFO: Found listing with ID: LO21%20XVZ
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO21%2520XVZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:02 [bca.uk] INFO: Scrape type for LO21%20XVZ: 0
2026-03-29 22:10:02 [bca.uk] INFO: Found listing with ID: BJ68%20NTY
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ68%2520NTY%27 HTTP/1.1" 200 None
2026-03-29 22:10:02 [bca.uk] INFO: Scrape type for BJ68%20NTY: 0
2026-03-29 22:10:02 [bca.uk] INFO: Found listing with ID: BV23%20GXM
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV23%2520GXM%27 HTTP/1.1" 200 None
2026-03-29 22:10:02 [bca.uk] INFO: Scrape type for BV23%20GXM: 0
2026-03-29 22:10:02 [bca.uk] INFO: Found listing with ID: FX22%20TVJ
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX22%2520TVJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:02 [bca.uk] INFO: Scrape type for FX22%20TVJ: 0
2026-03-29 22:10:02 [bca.uk] INFO: Found listing with ID: LC68%20DRX
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC68%2520DRX%27 HTTP/1.1" 200 None
2026-03-29 22:10:02 [bca.uk] INFO: Scrape type for LC68%20DRX: 0
2026-03-29 22:10:02 [bca.uk] INFO: Found listing with ID: RK70%20GYB
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK70%2520GYB%27 HTTP/1.1" 200 None
2026-03-29 22:10:02 [bca.uk] INFO: Scrape type for RK70%20GYB: 0
2026-03-29 22:10:02 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=40&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:02 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=40&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=40&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:10:04 [bca.uk] INFO: Total items found: 100
2026-03-29 22:10:04 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=41&sort=MostRecentlyAdded
2026-03-29 22:10:04 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:10:04 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=41&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: RV22%20XFF
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV22%2520XFF%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for RV22%20XFF: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: MK68%20BWN
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK68%2520BWN%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for MK68%20BWN: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: OY18%20OXG
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY18%2520OXG%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for OY18%20OXG: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: PK22%20WPW
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK22%2520WPW%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for PK22%20WPW: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: YT22%20AHN
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT22%2520AHN%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for YT22%20AHN: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: KT18%20NNJ
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT18%2520NNJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for KT18%20NNJ: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: BC22%20HLN
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC22%2520HLN%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for BC22%20HLN: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: C12%20OLL
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27C12%2520OLL%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for C12%20OLL: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: DY68%20VKP
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY68%2520VKP%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for DY68%20VKP: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: NA22%20COJ
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA22%2520COJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for NA22%20COJ: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: NX69%20MFO
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX69%2520MFO%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for NX69%20MFO: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: SG71%20XJD
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG71%2520XJD%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for SG71%20XJD: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: SW22%20JBO
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW22%2520JBO%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for SW22%20JBO: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: KS20%20GNF
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS20%2520GNF%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for KS20%20GNF: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: KV68%20FFL
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV68%2520FFL%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for KV68%20FFL: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: MA22%20UZX
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA22%2520UZX%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for MA22%20UZX: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: OV69%20ZYX
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV69%2520ZYX%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for OV69%20ZYX: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: YF72%20SCZ
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF72%2520SCZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for YF72%20SCZ: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: LM22%20ZTO
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM22%2520ZTO%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for LM22%20ZTO: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: KS21%20FGU
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS21%2520FGU%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for KS21%20FGU: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: LF68%20HUV
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF68%2520HUV%27 HTTP/1.1" 200 None
2026-03-29 22:10:04 [bca.uk] INFO: Scrape type for LF68%20HUV: 0
2026-03-29 22:10:04 [bca.uk] INFO: Found listing with ID: KW18%20DWX
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW18%2520DWX%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for KW18%20DWX: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: LR19%20NCU
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR19%2520NCU%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for LR19%20NCU: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: WF70%20FSN
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF70%2520FSN%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for WF70%20FSN: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: DK20%20WOA
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK20%2520WOA%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for DK20%20WOA: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: ET19%20WKG
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET19%2520WKG%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for ET19%20WKG: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: FY69%20XBU
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY69%2520XBU%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for FY69%20XBU: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: DN71%20VHK
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN71%2520VHK%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for DN71%20VHK: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: HK19%20RSV
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK19%2520RSV%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for HK19%20RSV: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: GK19%20NSO
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK19%2520NSO%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for GK19%20NSO: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: WD70%20HZX
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD70%2520HZX%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for WD70%20HZX: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: FL68%20LDZ
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL68%2520LDZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for FL68%20LDZ: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: EK71%20XHH
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK71%2520XHH%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for EK71%20XHH: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: LK71%20MTX
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK71%2520MTX%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for LK71%20MTX: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: EF16%20YTX
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF16%2520YTX%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for EF16%20YTX: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: BF71%20NFL
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF71%2520NFL%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for BF71%20NFL: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: CJ19%20WVD
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CJ19%2520WVD%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for CJ19%20WVD: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: KM25%20GXC
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM25%2520GXC%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for KM25%20GXC: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: YC18%20JNL
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC18%2520JNL%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for YC18%20JNL: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: DO19%20LPJ
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DO19%2520LPJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for DO19%20LPJ: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: BN16%20KWU
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN16%2520KWU%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for BN16%20KWU: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: EY19%20WCL
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY19%2520WCL%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for EY19%20WCL: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: NL64%20UCU
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL64%2520UCU%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for NL64%20UCU: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: FB19%20XFJ
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FB19%2520XFJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for FB19%20XFJ: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: DK24%20YOC
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK24%2520YOC%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for DK24%20YOC: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: EJ63%20XXE
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ63%2520XXE%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for EJ63%20XXE: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: KF19%20XKV
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF19%2520XKV%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for KF19%20XKV: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: YW18%20ETK
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YW18%2520ETK%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for YW18%20ETK: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: BP63%20NVY
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP63%2520NVY%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for BP63%20NVY: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: FG19%20YWD
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG19%2520YWD%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for FG19%20YWD: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: LF19%20FON
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF19%2520FON%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for LF19%20FON: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: LL70%20FOU
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL70%2520FOU%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for LL70%20FOU: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: YD69%20XES
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD69%2520XES%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for YD69%20XES: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: D10%20LKE
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27D10%2520LKE%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for D10%20LKE: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: DGZ%206301
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DGZ%25206301%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for DGZ%206301: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: GX69%20UTS
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX69%2520UTS%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for GX69%20UTS: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: KY67%20GGX
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY67%2520GGX%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for KY67%20GGX: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: LT68%20DYO
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT68%2520DYO%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for LT68%20DYO: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: PK16%20SFV
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK16%2520SFV%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for PK16%20SFV: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: YL70%20FHK
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL70%2520FHK%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for YL70%20FHK: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: GJ64%20VAM
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ64%2520VAM%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for GJ64%20VAM: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: GY20%20BYH
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY20%2520BYH%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for GY20%20BYH: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: OY67%20YSO
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY67%2520YSO%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for OY67%20YSO: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: RE70%20NBM
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE70%2520NBM%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for RE70%20NBM: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: NX18%20FWO
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX18%2520FWO%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for NX18%20FWO: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: NU17%20KLJ
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU17%2520KLJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for NU17%20KLJ: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: DK11%20TWU
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK11%2520TWU%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for DK11%20TWU: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: YC12%20XPH
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC12%2520XPH%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for YC12%20XPH: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: DA71%20OZO
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA71%2520OZO%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for DA71%20OZO: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: LM21%20ATZ
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM21%2520ATZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for LM21%20ATZ: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: LV09%20KGA
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV09%2520KGA%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for LV09%20KGA: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: MP19%20BYW
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520BYW%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for MP19%20BYW: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: MK12%20UZT
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK12%2520UZT%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for MK12%20UZT: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: NC21%20XCP
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC21%2520XCP%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for NC21%20XCP: 0
2026-03-29 22:10:05 [bca.uk] INFO: Found listing with ID: NG71%20LSV
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG71%2520LSV%27 HTTP/1.1" 200 None
2026-03-29 22:10:05 [bca.uk] INFO: Scrape type for NG71%20LSV: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: NL67%20WRR
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL67%2520WRR%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for NL67%20WRR: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: SV18%20YJF
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV18%2520YJF%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for SV18%20YJF: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: WN08%20CUA
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN08%2520CUA%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for WN08%20CUA: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: YS65%20LXE
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS65%2520LXE%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for YS65%20LXE: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: AF71%20XKX
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF71%2520XKX%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for AF71%20XKX: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: GJ17%20EKE
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ17%2520EKE%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for GJ17%20EKE: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: GJ67%20KLX
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ67%2520KLX%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for GJ67%20KLX: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: LA18%20AET
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA18%2520AET%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for LA18%20AET: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: LV59%20FNP
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV59%2520FNP%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for LV59%20FNP: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: DL13%20RHV
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL13%2520RHV%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for DL13%20RHV: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: DN68%20GZS
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN68%2520GZS%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for DN68%20GZS: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: DP68%20HHK
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP68%2520HHK%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for DP68%20HHK: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: GF14%20ONR
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF14%2520ONR%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for GF14%20ONR: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: LP14%20USW
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP14%2520USW%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for LP14%20USW: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: LR18%20BTV
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR18%2520BTV%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for LR18%20BTV: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: MK61%20URX
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK61%2520URX%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for MK61%20URX: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: VN69%20NTA
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN69%2520NTA%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for VN69%20NTA: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: WN69%20UXG
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN69%2520UXG%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for WN69%20UXG: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: X367%20CLB
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X367%2520CLB%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for X367%20CLB: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: YS18%20UXW
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS18%2520UXW%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for YS18%20UXW: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: YT13%20XDJ
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT13%2520XDJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for YT13%20XDJ: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: CX59%20PFA
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX59%2520PFA%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for CX59%20PFA: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: WA68%20CZR
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA68%2520CZR%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for WA68%20CZR: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: SK13%20EOT
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK13%2520EOT%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for SK13%20EOT: 0
2026-03-29 22:10:06 [bca.uk] INFO: Found listing with ID: LA18%20YHN
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA18%2520YHN%27 HTTP/1.1" 200 None
2026-03-29 22:10:06 [bca.uk] INFO: Scrape type for LA18%20YHN: 0
2026-03-29 22:10:06 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=41&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:06 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=41&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=41&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:10:08 [bca.uk] INFO: Total items found: 100
2026-03-29 22:10:08 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=42&sort=MostRecentlyAdded
2026-03-29 22:10:08 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:10:08 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=42&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: YY61%20AUF
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY61%2520AUF%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for YY61%20AUF: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: NK11%20HXL
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK11%2520HXL%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for NK11%20HXL: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: NA53%20FUP
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA53%2520FUP%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for NA53%20FUP: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: WF18%20OXJ
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF18%2520OXJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for WF18%20OXJ: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: WJ22%20JVP
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ22%2520JVP%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for WJ22%20JVP: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: WK12%20UZF
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK12%2520UZF%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for WK12%20UZF: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: WK72%20LWL
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK72%2520LWL%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for WK72%20LWL: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: Y886%20UBK
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y886%2520UBK%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for Y886%20UBK: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: HY19%20NVK
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY19%2520NVK%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for HY19%20NVK: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: KN71%20ZFC
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN71%2520ZFC%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for KN71%20ZFC: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: KR20%20WEC
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR20%2520WEC%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for KR20%20WEC: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: MK69%20KRX
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK69%2520KRX%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for MK69%20KRX: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: RO10%20RBV
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO10%2520RBV%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for RO10%20RBV: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: RX66%20ZCZ
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX66%2520ZCZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for RX66%20ZCZ: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: SA68%20YKR
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA68%2520YKR%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for SA68%20YKR: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: SK67%20KUB
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK67%2520KUB%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for SK67%20KUB: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: SN66%20PGE
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN66%2520PGE%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for SN66%20PGE: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: VO20%20ZZM
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO20%2520ZZM%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for VO20%20ZZM: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: WD17%20LOJ
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD17%2520LOJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for WD17%20LOJ: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: AY70%20UXZ
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY70%2520UXZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for AY70%20UXZ: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: CA22%20ORW
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA22%2520ORW%27 HTTP/1.1" 200 None
2026-03-29 22:10:08 [bca.uk] INFO: Scrape type for CA22%20ORW: 0
2026-03-29 22:10:08 [bca.uk] INFO: Found listing with ID: CP22%20DPV
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP22%2520DPV%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for CP22%20DPV: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: CV69%20KLS
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV69%2520KLS%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for CV69%20KLS: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: DL64%20PUA
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL64%2520PUA%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for DL64%20PUA: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: EO10%20ZHY
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO10%2520ZHY%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for EO10%20ZHY: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: HX17%20TCV
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX17%2520TCV%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for HX17%20TCV: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: GF09%20WVJ
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF09%2520WVJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for GF09%20WVJ: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: MV12%20NVP
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV12%2520NVP%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for MV12%20NVP: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: Y467%20UKE
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y467%2520UKE%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for Y467%20UKE: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: RIL%206309
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RIL%25206309%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for RIL%206309: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: KM23%20LCL
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM23%2520LCL%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for KM23%20LCL: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: KS73%20SSO
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS73%2520SSO%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for KS73%20SSO: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: MW24%20YOG
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW24%2520YOG%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for MW24%20YOG: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: NC71%20AYS
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC71%2520AYS%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for NC71%20AYS: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: FT13%20HXR
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT13%2520HXR%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for FT13%20HXR: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: KS23%20HYZ
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS23%2520HYZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for KS23%20HYZ: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: KW23%20CMZ
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW23%2520CMZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for KW23%20CMZ: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: KW73%20YLM
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW73%2520YLM%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for KW73%20YLM: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: KW73%20YVM
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW73%2520YVM%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for KW73%20YVM: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: OY17%20VGJ
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520VGJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for OY17%20VGJ: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: FG21%20ZHO
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG21%2520ZHO%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for FG21%20ZHO: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: YN68%20HMH
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN68%2520HMH%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for YN68%20HMH: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: GD73%20KHH
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD73%2520KHH%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for GD73%20KHH: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: GL73%20XFX
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL73%2520XFX%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for GL73%20XFX: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: CX13%20HLM
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX13%2520HLM%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for CX13%20HLM: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: KW73%20TVV
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW73%2520TVV%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for KW73%20TVV: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: KW73%20YUH
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW73%2520YUH%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for KW73%20YUH: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: MW73%20GFU
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW73%2520GFU%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for MW73%20GFU: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: BP65%20KMU
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP65%2520KMU%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for BP65%20KMU: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: KW23%20CUO
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW23%2520CUO%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for KW23%20CUO: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: GJ73%20VUE
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ73%2520VUE%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for GJ73%20VUE: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: GF15%20WDN
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF15%2520WDN%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for GF15%20WDN: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: MV63%20YNE
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV63%2520YNE%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for MV63%20YNE: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: YH73%20KXU
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH73%2520KXU%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for YH73%20KXU: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: HV18%20VJN
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV18%2520VJN%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for HV18%20VJN: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: YE22%20DYJ
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE22%2520DYJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for YE22%20DYJ: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: GU10%20OWY
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU10%2520OWY%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for GU10%20OWY: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: VX14%20FDO
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX14%2520FDO%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for VX14%20FDO: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: YY56%20EDK
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY56%2520EDK%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for YY56%20EDK: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: WR66%20CUK
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR66%2520CUK%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for WR66%20CUK: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: YL57%20BXX
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL57%2520BXX%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for YL57%20BXX: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: SP12%20ZFL
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP12%2520ZFL%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for SP12%20ZFL: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: GJ73%20VLX
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ73%2520VLX%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for GJ73%20VLX: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: KW73%20YUN
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW73%2520YUN%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for KW73%20YUN: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: L44%20KDN
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L44%2520KDN%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for L44%20KDN: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: FP61%20YTJ
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP61%2520YTJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for FP61%20YTJ: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: MC19%20FDG
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC19%2520FDG%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for MC19%20FDG: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: RL05%20YPN
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RL05%2520YPN%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for RL05%20YPN: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: FP67%20ORG
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP67%2520ORG%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for FP67%20ORG: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: OE08%20ZZO
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE08%2520ZZO%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for OE08%20ZZO: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: YG65%20YRR
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG65%2520YRR%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for YG65%20YRR: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: EK67%20XXS
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK67%2520XXS%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for EK67%20XXS: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: GJ68%20AFV
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ68%2520AFV%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for GJ68%20AFV: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: GM69%20BGK
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM69%2520BGK%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for GM69%20BGK: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: HY13%20XUR
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY13%2520XUR%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for HY13%20XUR: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: MJ17%20DZY
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ17%2520DZY%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for MJ17%20DZY: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: OE66%20NBM
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE66%2520NBM%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for OE66%20NBM: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: OE71%20BYH
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE71%2520BYH%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for OE71%20BYH: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: RO22%20GYW
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO22%2520GYW%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for RO22%20GYW: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: WJ62%20LRX
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ62%2520LRX%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for WJ62%20LRX: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: WJ70%20VKB
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ70%2520VKB%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for WJ70%20VKB: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: WN66%20UHK
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN66%2520UHK%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for WN66%20UHK: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: DL70%20HFP
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL70%2520HFP%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for DL70%20HFP: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: GJ64%20YHL
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ64%2520YHL%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for GJ64%20YHL: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: KP65%20LLC
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP65%2520LLC%27 HTTP/1.1" 200 None
2026-03-29 22:10:09 [bca.uk] INFO: Scrape type for KP65%20LLC: 0
2026-03-29 22:10:09 [bca.uk] INFO: Found listing with ID: DV21%20LWE
2026-03-29 22:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV21%2520LWE%27 HTTP/1.1" 200 None
2026-03-29 22:10:10 [bca.uk] INFO: Scrape type for DV21%20LWE: 0
2026-03-29 22:10:10 [bca.uk] INFO: Found listing with ID: EY08%20CFJ
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY08%2520CFJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:10 [bca.uk] INFO: Scrape type for EY08%20CFJ: 0
2026-03-29 22:10:10 [bca.uk] INFO: Found listing with ID: FN17%20YVC
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN17%2520YVC%27 HTTP/1.1" 200 None
2026-03-29 22:10:10 [bca.uk] INFO: Scrape type for FN17%20YVC: 0
2026-03-29 22:10:10 [bca.uk] INFO: Found listing with ID: HJ64%20UZB
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ64%2520UZB%27 HTTP/1.1" 200 None
2026-03-29 22:10:10 [bca.uk] INFO: Scrape type for HJ64%20UZB: 0
2026-03-29 22:10:10 [bca.uk] INFO: Found listing with ID: MH16%20BXV
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH16%2520BXV%27 HTTP/1.1" 200 None
2026-03-29 22:10:10 [bca.uk] INFO: Scrape type for MH16%20BXV: 0
2026-03-29 22:10:10 [bca.uk] INFO: Found listing with ID: MJ17%20VKW
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ17%2520VKW%27 HTTP/1.1" 200 None
2026-03-29 22:10:10 [bca.uk] INFO: Scrape type for MJ17%20VKW: 0
2026-03-29 22:10:10 [bca.uk] INFO: Found listing with ID: SC16%20NGN
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC16%2520NGN%27 HTTP/1.1" 200 None
2026-03-29 22:10:10 [bca.uk] INFO: Scrape type for SC16%20NGN: 0
2026-03-29 22:10:10 [bca.uk] INFO: Found listing with ID: WN13%20MHL
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN13%2520MHL%27 HTTP/1.1" 200 None
2026-03-29 22:10:10 [bca.uk] INFO: Scrape type for WN13%20MHL: 0
2026-03-29 22:10:10 [bca.uk] INFO: Found listing with ID: SC61%20BYP
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC61%2520BYP%27 HTTP/1.1" 200 None
2026-03-29 22:10:10 [bca.uk] INFO: Scrape type for SC61%20BYP: 0
2026-03-29 22:10:10 [bca.uk] INFO: Found listing with ID: RO09%20UJK
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO09%2520UJK%27 HTTP/1.1" 200 None
2026-03-29 22:10:10 [bca.uk] INFO: Scrape type for RO09%20UJK: 0
2026-03-29 22:10:10 [bca.uk] INFO: Found listing with ID: KV66%20XDL
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV66%2520XDL%27 HTTP/1.1" 200 None
2026-03-29 22:10:10 [bca.uk] INFO: Scrape type for KV66%20XDL: 0
2026-03-29 22:10:10 [bca.uk] INFO: Found listing with ID: HV58%20LRN
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV58%2520LRN%27 HTTP/1.1" 200 None
2026-03-29 22:10:10 [bca.uk] INFO: Scrape type for HV58%20LRN: 0
2026-03-29 22:10:10 [bca.uk] INFO: Found listing with ID: GN63%20FFY
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN63%2520FFY%27 HTTP/1.1" 200 None
2026-03-29 22:10:10 [bca.uk] INFO: Scrape type for GN63%20FFY: 0
2026-03-29 22:10:10 [bca.uk] INFO: Found listing with ID: SD68%20NLT
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD68%2520NLT%27 HTTP/1.1" 200 None
2026-03-29 22:10:10 [bca.uk] INFO: Scrape type for SD68%20NLT: 0
2026-03-29 22:10:10 [bca.uk] INFO: Found listing with ID: RX65%20VOJ
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX65%2520VOJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:10 [bca.uk] INFO: Scrape type for RX65%20VOJ: 0
2026-03-29 22:10:10 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=42&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:10 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=42&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:10 [scrapy.extensions.logstats] INFO: Crawled 174 pages (at 8 pages/min), scraped 643 items (at 0 items/min)
2026-03-29 22:10:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 203MiB
2026-03-29 22:10:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=42&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:10:12 [bca.uk] INFO: Total items found: 100
2026-03-29 22:10:12 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=43&sort=MostRecentlyAdded
2026-03-29 22:10:12 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:10:12 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=43&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: AF66%20BUH
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF66%2520BUH%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for AF66%20BUH: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: BL64%20YTM
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL64%2520YTM%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for BL64%20YTM: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: EN16%20KRD
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN16%2520KRD%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for EN16%20KRD: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: OU73%20MMX
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU73%2520MMX%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for OU73%20MMX: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: GF12%20OAY
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF12%2520OAY%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for GF12%20OAY: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: DV15%20HHN
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV15%2520HHN%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for DV15%20HHN: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: VE13%20GBF
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE13%2520GBF%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for VE13%20GBF: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: RF56%20WZG
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF56%2520WZG%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for RF56%20WZG: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: HV65%20GSU
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV65%2520GSU%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for HV65%20GSU: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: LD66%20BVN
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD66%2520BVN%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for LD66%20BVN: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: BJ62%20USG
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ62%2520USG%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for BJ62%20USG: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: AU69%20VFL
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU69%2520VFL%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for AU69%20VFL: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: PY10%20FWJ
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY10%2520FWJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for PY10%20FWJ: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: SB66%20OSX
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB66%2520OSX%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for SB66%20OSX: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: WF17%20ZXA
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF17%2520ZXA%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for WF17%20ZXA: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: SE15%20SOU
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE15%2520SOU%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for SE15%20SOU: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: KM09%20ZGS
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM09%2520ZGS%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for KM09%20ZGS: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: DL10%20PKC
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL10%2520PKC%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for DL10%20PKC: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: WU07%20KYA
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU07%2520KYA%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for WU07%20KYA: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: RE66%20UYD
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE66%2520UYD%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for RE66%20UYD: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: MF15%20WSJ
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF15%2520WSJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for MF15%20WSJ: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: WP71%20XJC
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP71%2520XJC%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for WP71%20XJC: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: WV71%20SZP
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV71%2520SZP%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for WV71%20SZP: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: PO21%20EVJ
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO21%2520EVJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for PO21%20EVJ: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: WP23%20OHB
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP23%2520OHB%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for WP23%20OHB: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: WP23%20OGE
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP23%2520OGE%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for WP23%20OGE: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: WP23%20OFH
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP23%2520OFH%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for WP23%20OFH: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: WP23%20OFE
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP23%2520OFE%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for WP23%20OFE: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: WP23%20OEB
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP23%2520OEB%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for WP23%20OEB: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: WP23%20OEA
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP23%2520OEA%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for WP23%20OEA: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: WN73%20JGY
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN73%2520JGY%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for WN73%20JGY: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: SW15%20UNG
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW15%2520UNG%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for SW15%20UNG: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: SA17%20ALD
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA17%2520ALD%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for SA17%20ALD: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: WN73%20JGV
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN73%2520JGV%27 HTTP/1.1" 200 None
2026-03-29 22:10:12 [bca.uk] INFO: Scrape type for WN73%20JGV: 0
2026-03-29 22:10:12 [bca.uk] INFO: Found listing with ID: BF18%20VZP
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF18%2520VZP%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for BF18%20VZP: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: CU17%20XFM
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU17%2520XFM%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for CU17%20XFM: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: FJ14%20GBU
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ14%2520GBU%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for FJ14%20GBU: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: AV14%20PVL
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV14%2520PVL%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for AV14%20PVL: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: WP71%20UOH
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP71%2520UOH%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for WP71%20UOH: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: BJ09%20TYV
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ09%2520TYV%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for BJ09%20TYV: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: WV71%20TBZ
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV71%2520TBZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for WV71%20TBZ: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: WV71%20SYG
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV71%2520SYG%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for WV71%20SYG: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: HX14%20FAO
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX14%2520FAO%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for HX14%20FAO: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: MV23%20PVK
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV23%2520PVK%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for MV23%20PVK: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: WP71%20XHY
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP71%2520XHY%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for WP71%20XHY: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: MD72%20EUB
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD72%2520EUB%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for MD72%20EUB: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: WU24%20DYD
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU24%2520DYD%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for WU24%20DYD: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: LA72%20VNB
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA72%2520VNB%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for LA72%20VNB: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: DS20%20OCF
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS20%2520OCF%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for DS20%20OCF: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: LG23%20VVJ
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG23%2520VVJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for LG23%20VVJ: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: GJ23%20JSY
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ23%2520JSY%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for GJ23%20JSY: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: KX10%20FFW
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX10%2520FFW%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for KX10%20FFW: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: GJ22%20GXX
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ22%2520GXX%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for GJ22%20GXX: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: BL72%20KOD
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL72%2520KOD%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for BL72%20KOD: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: OV10%20HBL
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV10%2520HBL%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for OV10%20HBL: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: R12%20OKJ
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27R12%2520OKJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for R12%20OKJ: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: KN62%20FGD
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN62%2520FGD%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for KN62%20FGD: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: PK20%20WMF
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK20%2520WMF%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for PK20%20WMF: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: PK20%20UYN
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK20%2520UYN%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for PK20%20UYN: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: MC19%20ZWJ
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC19%2520ZWJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for MC19%20ZWJ: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: MA20%20XAR
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA20%2520XAR%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for MA20%20XAR: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: HV70%20WHA
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV70%2520WHA%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for HV70%20WHA: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: VA66%20MGX
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA66%2520MGX%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for VA66%20MGX: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: GC17%20NDE
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GC17%2520NDE%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for GC17%20NDE: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: HX14%20DJO
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX14%2520DJO%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for HX14%20DJO: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: LB69%20YVW
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB69%2520YVW%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for LB69%20YVW: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: EX18%20BYP
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX18%2520BYP%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for EX18%20BYP: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: EX17%20VXH
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX17%2520VXH%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for EX17%20VXH: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: SY68%20GYA
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY68%2520GYA%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for SY68%20GYA: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: SN24%20KPW
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN24%2520KPW%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for SN24%20KPW: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: BJ71%20HLM
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ71%2520HLM%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for BJ71%20HLM: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: SB20%20AMO
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB20%2520AMO%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for SB20%20AMO: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: FX11%20JKN
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX11%2520JKN%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for FX11%20JKN: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: KW21%20AOB
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW21%2520AOB%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for KW21%20AOB: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: YX71%20DDY
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX71%2520DDY%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for YX71%20DDY: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: NA72%20YVV
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA72%2520YVV%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for NA72%20YVV: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: GV72%20DWG
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV72%2520DWG%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for GV72%20DWG: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: YR72%20WEP
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR72%2520WEP%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for YR72%20WEP: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: DS72%20VYJ
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS72%2520VYJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for DS72%20VYJ: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: YE73%20OLO
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE73%2520OLO%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for YE73%20OLO: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: HX18%20DMU
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX18%2520DMU%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for HX18%20DMU: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: AJ72%20HYM
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ72%2520HYM%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for AJ72%20HYM: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: VE70%20JDZ
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE70%2520JDZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for VE70%20JDZ: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: YJ63%20FDY
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ63%2520FDY%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for YJ63%20FDY: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: LF69%20YUJ
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF69%2520YUJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for LF69%20YUJ: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: LY23%20BKE
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY23%2520BKE%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for LY23%20BKE: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: KK19%20ZFA
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK19%2520ZFA%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for KK19%20ZFA: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: WD19%20YCX
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD19%2520YCX%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for WD19%20YCX: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: ML70%20KCG
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML70%2520KCG%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for ML70%20KCG: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: RX15%20OZO
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX15%2520OZO%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for RX15%20OZO: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: AYZ%208960
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AYZ%25208960%27 HTTP/1.1" 200 None
2026-03-29 22:10:13 [bca.uk] INFO: Scrape type for AYZ%208960: 0
2026-03-29 22:10:13 [bca.uk] INFO: Found listing with ID: LD20%20LRK
2026-03-29 22:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD20%2520LRK%27 HTTP/1.1" 200 None
2026-03-29 22:10:14 [bca.uk] INFO: Scrape type for LD20%20LRK: 0
2026-03-29 22:10:14 [bca.uk] INFO: Found listing with ID: FY66%20EDL
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY66%2520EDL%27 HTTP/1.1" 200 None
2026-03-29 22:10:14 [bca.uk] INFO: Scrape type for FY66%20EDL: 0
2026-03-29 22:10:14 [bca.uk] INFO: Found listing with ID: YY20%20JXA
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY20%2520JXA%27 HTTP/1.1" 200 None
2026-03-29 22:10:14 [bca.uk] INFO: Scrape type for YY20%20JXA: 0
2026-03-29 22:10:14 [bca.uk] INFO: Found listing with ID: ND73%20CZS
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND73%2520CZS%27 HTTP/1.1" 200 None
2026-03-29 22:10:14 [bca.uk] INFO: Scrape type for ND73%20CZS: 0
2026-03-29 22:10:14 [bca.uk] INFO: Found listing with ID: AK16%20OJR
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK16%2520OJR%27 HTTP/1.1" 200 None
2026-03-29 22:10:14 [bca.uk] INFO: Scrape type for AK16%20OJR: 0
2026-03-29 22:10:14 [bca.uk] INFO: Found listing with ID: YA22%20JGU
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA22%2520JGU%27 HTTP/1.1" 200 None
2026-03-29 22:10:14 [bca.uk] INFO: Scrape type for YA22%20JGU: 0
2026-03-29 22:10:14 [bca.uk] INFO: Found listing with ID: NA20%20GWP
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA20%2520GWP%27 HTTP/1.1" 200 None
2026-03-29 22:10:14 [bca.uk] INFO: Scrape type for NA20%20GWP: 0
2026-03-29 22:10:14 [bca.uk] INFO: Found listing with ID: FT24%20UAS
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT24%2520UAS%27 HTTP/1.1" 200 None
2026-03-29 22:10:14 [bca.uk] INFO: Scrape type for FT24%20UAS: 0
2026-03-29 22:10:14 [bca.uk] INFO: Found listing with ID: SD23%20DJF
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD23%2520DJF%27 HTTP/1.1" 200 None
2026-03-29 22:10:14 [bca.uk] INFO: Scrape type for SD23%20DJF: 0
2026-03-29 22:10:14 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=43&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:14 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=43&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=43&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:10:16 [bca.uk] INFO: Total items found: 100
2026-03-29 22:10:16 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=44&sort=MostRecentlyAdded
2026-03-29 22:10:16 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:10:16 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=44&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:16 [bca.uk] INFO: Found listing with ID: WA20%20UVV
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA20%2520UVV%27 HTTP/1.1" 200 None
2026-03-29 22:10:16 [bca.uk] INFO: Scrape type for WA20%20UVV: 0
2026-03-29 22:10:16 [bca.uk] INFO: Found listing with ID: FL13%20MYV
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL13%2520MYV%27 HTTP/1.1" 200 None
2026-03-29 22:10:16 [bca.uk] INFO: Scrape type for FL13%20MYV: 0
2026-03-29 22:10:16 [bca.uk] INFO: Found listing with ID: NA70%20XJL
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA70%2520XJL%27 HTTP/1.1" 200 None
2026-03-29 22:10:16 [bca.uk] INFO: Scrape type for NA70%20XJL: 0
2026-03-29 22:10:16 [bca.uk] INFO: Found listing with ID: LC63%20NGO
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC63%2520NGO%27 HTTP/1.1" 200 None
2026-03-29 22:10:16 [bca.uk] INFO: Scrape type for LC63%20NGO: 0
2026-03-29 22:10:16 [bca.uk] INFO: Found listing with ID: EY69%20ZUC
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY69%2520ZUC%27 HTTP/1.1" 200 None
2026-03-29 22:10:16 [bca.uk] INFO: Scrape type for EY69%20ZUC: 0
2026-03-29 22:10:16 [bca.uk] INFO: Found listing with ID: DG64%20PYX
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG64%2520PYX%27 HTTP/1.1" 200 None
2026-03-29 22:10:16 [bca.uk] INFO: Scrape type for DG64%20PYX: 0
2026-03-29 22:10:16 [bca.uk] INFO: Found listing with ID: YR22%20SJV
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR22%2520SJV%27 HTTP/1.1" 200 None
2026-03-29 22:10:16 [bca.uk] INFO: Scrape type for YR22%20SJV: 0
2026-03-29 22:10:16 [bca.uk] INFO: Found listing with ID: LD69%20LCN
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD69%2520LCN%27 HTTP/1.1" 200 None
2026-03-29 22:10:16 [bca.uk] INFO: Scrape type for LD69%20LCN: 0
2026-03-29 22:10:16 [bca.uk] INFO: Found listing with ID: LB69%20VNE
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB69%2520VNE%27 HTTP/1.1" 200 None
2026-03-29 22:10:16 [bca.uk] INFO: Scrape type for LB69%20VNE: 0
2026-03-29 22:10:16 [bca.uk] INFO: Found listing with ID: WN22%20TOU
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN22%2520TOU%27 HTTP/1.1" 200 None
2026-03-29 22:10:16 [bca.uk] INFO: Scrape type for WN22%20TOU: 0
2026-03-29 22:10:16 [bca.uk] INFO: Found listing with ID: LG23%20XKN
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG23%2520XKN%27 HTTP/1.1" 200 None
2026-03-29 22:10:16 [bca.uk] INFO: Scrape type for LG23%20XKN: 0
2026-03-29 22:10:16 [bca.uk] INFO: Found listing with ID: MD72%20VNH
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD72%2520VNH%27 HTTP/1.1" 200 None
2026-03-29 22:10:16 [bca.uk] INFO: Scrape type for MD72%20VNH: 0
2026-03-29 22:10:16 [bca.uk] INFO: Found listing with ID: MW72%20BPV
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW72%2520BPV%27 HTTP/1.1" 200 None
2026-03-29 22:10:16 [bca.uk] INFO: Scrape type for MW72%20BPV: 0
2026-03-29 22:10:16 [bca.uk] INFO: Found listing with ID: VX72%20KPY
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX72%2520KPY%27 HTTP/1.1" 200 None
2026-03-29 22:10:16 [bca.uk] INFO: Scrape type for VX72%20KPY: 0
2026-03-29 22:10:16 [bca.uk] INFO: Found listing with ID: BT68%20UJL
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT68%2520UJL%27 HTTP/1.1" 200 None
2026-03-29 22:10:16 [bca.uk] INFO: Scrape type for BT68%20UJL: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: MK17%20KXH
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK17%2520KXH%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for MK17%20KXH: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: RV20%20VFR
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV20%2520VFR%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for RV20%20VFR: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: YD63%20CXX
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD63%2520CXX%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for YD63%20CXX: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: AF23%20UMX
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF23%2520UMX%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for AF23%20UMX: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: MW23%20SZN
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW23%2520SZN%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for MW23%20SZN: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: BM18%20LLA
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BM18%2520LLA%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for BM18%20LLA: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: BT68%20WMD
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT68%2520WMD%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for BT68%20WMD: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: MW15%20YYO
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW15%2520YYO%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for MW15%20YYO: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: RJ71%20ZXS
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ71%2520ZXS%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for RJ71%20ZXS: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: WN22%20TNJ
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN22%2520TNJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for WN22%20TNJ: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: YT67%20ZKA
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT67%2520ZKA%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for YT67%20ZKA: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: EK75%20AKZ
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK75%2520AKZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for EK75%20AKZ: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: FX23%20RSU
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX23%2520RSU%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for FX23%20RSU: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: LG23%20KGF
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG23%2520KGF%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for LG23%20KGF: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: LL71%20XOC
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL71%2520XOC%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for LL71%20XOC: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: RO22%20FWA
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO22%2520FWA%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for RO22%20FWA: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: AV75%20CWG
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV75%2520CWG%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for AV75%20CWG: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: CA72%20WDT
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA72%2520WDT%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for CA72%20WDT: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: DE22%20WFB
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE22%2520WFB%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for DE22%20WFB: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: DG69%20YDO
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG69%2520YDO%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for DG69%20YDO: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: RO22%20JUJ
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO22%2520JUJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for RO22%20JUJ: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: WU23%20EOV
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU23%2520EOV%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for WU23%20EOV: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: CA72%20UMR
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA72%2520UMR%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for CA72%20UMR: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: FV73%20KHC
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV73%2520KHC%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for FV73%20KHC: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: OE71%20WWU
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE71%2520WWU%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for OE71%20WWU: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: RF72%20OYM
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF72%2520OYM%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for RF72%20OYM: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: CX68%20MYP
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX68%2520MYP%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for CX68%20MYP: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: EY20%20BYH
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY20%2520BYH%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for EY20%20BYH: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: VO70%20NUJ
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO70%2520NUJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for VO70%20NUJ: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: DY24%20HVL
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY24%2520HVL%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for DY24%20HVL: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: YX19%20YEU
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX19%2520YEU%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for YX19%20YEU: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: OE21%20GFO
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE21%2520GFO%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for OE21%20GFO: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: AO20%20OTU
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO20%2520OTU%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for AO20%20OTU: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: YX19%20LTO
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX19%2520LTO%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for YX19%20LTO: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: LC70%20NRU
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC70%2520NRU%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for LC70%20NRU: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: BJ64%20SLU
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ64%2520SLU%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for BJ64%20SLU: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: WK13%20PZN
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK13%2520PZN%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for WK13%20PZN: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: NU69%20XZC
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU69%2520XZC%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for NU69%20XZC: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: YB65%20DWE
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB65%2520DWE%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for YB65%20DWE: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: V800%20ERC
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V800%2520ERC%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for V800%20ERC: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: KO18%20OYF
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO18%2520OYF%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for KO18%20OYF: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: SL16%20UER
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL16%2520UER%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for SL16%20UER: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: AU07%20RSU
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU07%2520RSU%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for AU07%20RSU: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: BL24%20LTY
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL24%2520LTY%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for BL24%20LTY: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: BT03%20TWA
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT03%2520TWA%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for BT03%20TWA: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: KW68%20ZLO
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW68%2520ZLO%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for KW68%20ZLO: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: LP18%20MZY
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP18%2520MZY%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for LP18%20MZY: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: NU17%20YHK
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU17%2520YHK%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for NU17%20YHK: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: MJ73%20VUN
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ73%2520VUN%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for MJ73%20VUN: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: LR22%20YMO
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR22%2520YMO%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for LR22%20YMO: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: ML73%20DJJ
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML73%2520DJJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for ML73%20DJJ: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: KJ69%20KWP
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ69%2520KWP%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for KJ69%20KWP: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: EK68%20PYU
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK68%2520PYU%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for EK68%20PYU: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: NX16%20FFG
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX16%2520FFG%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for NX16%20FFG: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: EX18%20ZBL
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX18%2520ZBL%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for EX18%20ZBL: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: LM62%20XBE
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM62%2520XBE%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for LM62%20XBE: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: EU73%20UJR
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU73%2520UJR%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for EU73%20UJR: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: BD68%20CDO
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD68%2520CDO%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for BD68%20CDO: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: CN68%20UAD
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN68%2520UAD%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for CN68%20UAD: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: LD22%20UVE
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD22%2520UVE%27 HTTP/1.1" 200 None
2026-03-29 22:10:17 [bca.uk] INFO: Scrape type for LD22%20UVE: 0
2026-03-29 22:10:17 [bca.uk] INFO: Found listing with ID: LD68%20VBM
2026-03-29 22:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD68%2520VBM%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for LD68%20VBM: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: OE71%20KNX
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE71%2520KNX%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for OE71%20KNX: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: FH22%20ZCO
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH22%2520ZCO%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for FH22%20ZCO: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: FX23%20RZA
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX23%2520RZA%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for FX23%20RZA: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: YH22%20XOY
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH22%2520XOY%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for YH22%20XOY: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: YN22%20WFX
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN22%2520WFX%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for YN22%20WFX: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: DP22%20TKK
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP22%2520TKK%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for DP22%20TKK: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: DX22%20RJJ
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX22%2520RJJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for DX22%20RJJ: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: LA21%20FVD
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA21%2520FVD%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for LA21%20FVD: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: YB19%20VDE
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB19%2520VDE%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for YB19%20VDE: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: MV19%20VMW
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV19%2520VMW%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for MV19%20VMW: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: SB72%20EXV
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB72%2520EXV%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for SB72%20EXV: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: SN22%20VMA
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN22%2520VMA%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for SN22%20VMA: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: SO72%20UWU
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO72%2520UWU%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for SO72%20UWU: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: SR22%20HBL
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR22%2520HBL%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for SR22%20HBL: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: YL68%20PNO
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL68%2520PNO%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for YL68%20PNO: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: KR73%20LWW
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR73%2520LWW%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for KR73%20LWW: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: URZ%205028
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27URZ%25205028%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for URZ%205028: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: YG22%20KDJ
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG22%2520KDJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for YG22%20KDJ: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: PJ22%20EAX
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ22%2520EAX%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for PJ22%20EAX: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: PL22%20ZXS
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL22%2520ZXS%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for PL22%20ZXS: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: EY22%20OLV
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY22%2520OLV%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for EY22%20OLV: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: GC21%20BWV
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GC21%2520BWV%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for GC21%20BWV: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: KS70%20HZE
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS70%2520HZE%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for KS70%20HZE: 0
2026-03-29 22:10:18 [bca.uk] INFO: Found listing with ID: KS71%20XJX
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS71%2520XJX%27 HTTP/1.1" 200 None
2026-03-29 22:10:18 [bca.uk] INFO: Scrape type for KS71%20XJX: 0
2026-03-29 22:10:18 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=44&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:18 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=44&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=44&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:10:20 [bca.uk] INFO: Total items found: 100
2026-03-29 22:10:20 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=45&sort=MostRecentlyAdded
2026-03-29 22:10:20 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:10:20 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=45&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: LO72%20NXR
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO72%2520NXR%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for LO72%20NXR: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: LT22%20AOR
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT22%2520AOR%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for LT22%20AOR: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: YK20%20OEJ
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK20%2520OEJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for YK20%20OEJ: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: LR71%20MKG
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR71%2520MKG%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for LR71%20MKG: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: OV22%20CWZ
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV22%2520CWZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for OV22%20CWZ: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: VK22%20BUJ
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK22%2520BUJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for VK22%20BUJ: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: VO22%20ESN
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO22%2520ESN%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for VO22%20ESN: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: WN22%20DWX
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN22%2520DWX%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for WN22%20DWX: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: SM19%20ZKN
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM19%2520ZKN%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for SM19%20ZKN: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: JRV%20508X
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JRV%2520508X%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for JRV%20508X: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: CE56%20GZH
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE56%2520GZH%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for CE56%20GZH: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: VN70%20DWM
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN70%2520DWM%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for VN70%20DWM: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: YV19%20VOO
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YV19%2520VOO%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for YV19%20VOO: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: GJ69%20KUH
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ69%2520KUH%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for GJ69%20KUH: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: BU22%20HBA
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU22%2520HBA%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for BU22%20HBA: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: HY72%20UGH
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY72%2520UGH%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for HY72%20UGH: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: LB71%20VMR
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB71%2520VMR%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for LB71%20VMR: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: MM71%20TYA
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM71%2520TYA%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for MM71%20TYA: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: HG19%20XES
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG19%2520XES%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for HG19%20XES: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: BP72%20CGY
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP72%2520CGY%27 HTTP/1.1" 200 None
2026-03-29 22:10:20 [bca.uk] INFO: Scrape type for BP72%20CGY: 0
2026-03-29 22:10:20 [bca.uk] INFO: Found listing with ID: SJ21%20XTH
2026-03-29 22:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ21%2520XTH%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for SJ21%20XTH: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: YS75%20TCO
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS75%2520TCO%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for YS75%20TCO: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: AD68%20EFA
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD68%2520EFA%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for AD68%20EFA: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: YO73%20JVR
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YO73%2520JVR%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for YO73%20JVR: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: HK75%20CPY
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK75%2520CPY%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for HK75%20CPY: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: BN20%20ZMU
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN20%2520ZMU%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for BN20%20ZMU: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: VU22%20OPO
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU22%2520OPO%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for VU22%20OPO: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: BP72%20RHA
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP72%2520RHA%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for BP72%20RHA: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: BK21%20LFV
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK21%2520LFV%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for BK21%20LFV: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: VN72%20EUZ
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN72%2520EUZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for VN72%20EUZ: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: LN69%20YHM
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN69%2520YHM%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for LN69%20YHM: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: LJ72%20YEF
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ72%2520YEF%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for LJ72%20YEF: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: LG69%20WXZ
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG69%2520WXZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for LG69%20WXZ: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: MW20%20BWD
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW20%2520BWD%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for MW20%20BWD: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: PIJ%202496
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PIJ%25202496%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for PIJ%202496: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: HG22%20NFU
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG22%2520NFU%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for HG22%20NFU: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: PN22%20USV
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN22%2520USV%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for PN22%20USV: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: YK19%20RGE
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK19%2520RGE%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for YK19%20RGE: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: LC72%20RVE
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC72%2520RVE%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for LC72%20RVE: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: LT21%20WOA
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT21%2520WOA%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for LT21%20WOA: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: LT21%20WSW
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT21%2520WSW%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for LT21%20WSW: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: YA72%20FHB
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA72%2520FHB%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for YA72%20FHB: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: YK21%20ZXN
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK21%2520ZXN%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for YK21%20ZXN: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: DL70%20XFN
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL70%2520XFN%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for DL70%20XFN: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: DL71%20YBH
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL71%2520YBH%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for DL71%20YBH: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: LC72%20MKP
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC72%2520MKP%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for LC72%20MKP: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: BG73%20WGW
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG73%2520WGW%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for BG73%20WGW: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: DN20%20SXZ
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN20%2520SXZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for DN20%20SXZ: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: DW24%20HFP
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DW24%2520HFP%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for DW24%20HFP: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: BC70%20VUN
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC70%2520VUN%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for BC70%20VUN: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: HJ73%20OWX
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ73%2520OWX%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for HJ73%20OWX: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: EK18%20GYV
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK18%2520GYV%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for EK18%20GYV: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: KM68%20OAY
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM68%2520OAY%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for KM68%20OAY: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: LV20%20GXY
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV20%2520GXY%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for LV20%20GXY: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: LL17%20AXH
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL17%2520AXH%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for LL17%20AXH: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: T11%20PBG
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T11%2520PBG%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for T11%20PBG: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: GN20%20WLF
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN20%2520WLF%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for GN20%20WLF: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: KP70%20LKM
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP70%2520LKM%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for KP70%20LKM: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: KW73%20LYF
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW73%2520LYF%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for KW73%20LYF: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: BV20%20EFS
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV20%2520EFS%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for BV20%20EFS: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: GL71%20EOG
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL71%2520EOG%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for GL71%20EOG: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: KR71%20YJH
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR71%2520YJH%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for KR71%20YJH: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: RK71%20MPU
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK71%2520MPU%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for RK71%20MPU: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: YS19%20JMO
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS19%2520JMO%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for YS19%20JMO: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: BK71%20VZJ
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK71%2520VZJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for BK71%20VZJ: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: LT23%20OLX
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT23%2520OLX%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for LT23%20OLX: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: SY72%20JRO
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY72%2520JRO%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for SY72%20JRO: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: YG69%20EFA
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG69%2520EFA%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for YG69%20EFA: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: AF70%20OVM
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF70%2520OVM%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for AF70%20OVM: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: GD69%20XPA
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD69%2520XPA%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for GD69%20XPA: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: GL71%20PFZ
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL71%2520PFZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for GL71%20PFZ: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: LN18%20EZT
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN18%2520EZT%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for LN18%20EZT: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: MJ69%20HJC
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ69%2520HJC%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for MJ69%20HJC: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: MJ70%20LHA
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ70%2520LHA%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for MJ70%20LHA: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: HV22%20OTN
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV22%2520OTN%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for HV22%20OTN: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: DL21%20GXB
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL21%2520GXB%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for DL21%20GXB: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: OE16%20VDP
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE16%2520VDP%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for OE16%20VDP: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: KO23%20ULA
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO23%2520ULA%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for KO23%20ULA: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: AR19%20OTG
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AR19%2520OTG%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for AR19%20OTG: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: EO69%20MVA
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO69%2520MVA%27 HTTP/1.1" 200 None
2026-03-29 22:10:21 [bca.uk] INFO: Scrape type for EO69%20MVA: 0
2026-03-29 22:10:21 [bca.uk] INFO: Found listing with ID: SM72%20HUO
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM72%2520HUO%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for SM72%20HUO: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: KT18%20FFE
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT18%2520FFE%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for KT18%20FFE: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: FH70%20TTZ
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH70%2520TTZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for FH70%20TTZ: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: FP69%20KWM
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP69%2520KWM%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for FP69%20KWM: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: KE65%20YRY
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE65%2520YRY%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for KE65%20YRY: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: NU20%20LZS
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU20%2520LZS%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for NU20%20LZS: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: BB05%20OJB
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BB05%2520OJB%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for BB05%20OJB: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: FP69%20OJT
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP69%2520OJT%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for FP69%20OJT: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: GX70%20VAE
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX70%2520VAE%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for GX70%20VAE: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: SW69%20EFM
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW69%2520EFM%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for SW69%20EFM: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: VO69%20JNJ
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO69%2520JNJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for VO69%20JNJ: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: AJ19%20JYG
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ19%2520JYG%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for AJ19%20JYG: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: BP67%20TPF
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP67%2520TPF%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for BP67%20TPF: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: HG19%20RSU
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG19%2520RSU%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for HG19%20RSU: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: KX20%20HXR
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX20%2520HXR%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for KX20%20HXR: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: NG21%20WPZ
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG21%2520WPZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for NG21%20WPZ: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: SE19%20GMF
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE19%2520GMF%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for SE19%20GMF: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: DT19%20CYZ
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT19%2520CYZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for DT19%20CYZ: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: WR70%20CUU
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR70%2520CUU%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for WR70%20CUU: 0
2026-03-29 22:10:22 [bca.uk] INFO: Found listing with ID: JK03%20RWK
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JK03%2520RWK%27 HTTP/1.1" 200 None
2026-03-29 22:10:22 [bca.uk] INFO: Scrape type for JK03%20RWK: 0
2026-03-29 22:10:22 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=45&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:22 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=45&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=45&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:10:24 [bca.uk] INFO: Total items found: 100
2026-03-29 22:10:24 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=46&sort=MostRecentlyAdded
2026-03-29 22:10:24 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:10:24 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=46&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: SW25%20DKD
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW25%2520DKD%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for SW25%20DKD: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: SY21%20TTU
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY21%2520TTU%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for SY21%20TTU: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: PK70%20LYY
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK70%2520LYY%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for PK70%20LYY: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: SF19%20LPH
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF19%2520LPH%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for SF19%20LPH: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: SK22%20ZRT
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK22%2520ZRT%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for SK22%20ZRT: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: SY18%20ONF
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY18%2520ONF%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for SY18%20ONF: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: RK66%20BWN
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK66%2520BWN%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for RK66%20BWN: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: AE69%20PCU
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE69%2520PCU%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for AE69%20PCU: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: DA72%20FKE
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA72%2520FKE%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for DA72%20FKE: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: DF18%20LXT
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF18%2520LXT%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for DF18%20LXT: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: EG68%20NZZ
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EG68%2520NZZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for EG68%20NZZ: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: MA20%20EVV
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA20%2520EVV%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for MA20%20EVV: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: PL69%20EVM
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL69%2520EVM%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for PL69%20EVM: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: YH68%20MJZ
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH68%2520MJZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for YH68%20MJZ: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: FP67%20CCY
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP67%2520CCY%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for FP67%20CCY: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: DN21%20WVE
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN21%2520WVE%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for DN21%20WVE: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: FL69%20SVT
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL69%2520SVT%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for FL69%20SVT: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: KN70%20XSP
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN70%2520XSP%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for KN70%20XSP: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: PA19%20HPZ
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PA19%2520HPZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for PA19%20HPZ: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: SB70%20MYH
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB70%2520MYH%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for SB70%20MYH: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: YY68%20LXG
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY68%2520LXG%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for YY68%20LXG: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: NX71%20OYL
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX71%2520OYL%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for NX71%20OYL: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: SA68%20WTE
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA68%2520WTE%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for SA68%20WTE: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: SE68%20NBZ
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE68%2520NBZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for SE68%20NBZ: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: SH70%20EHW
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH70%2520EHW%27 HTTP/1.1" 200 None
2026-03-29 22:10:24 [bca.uk] INFO: Scrape type for SH70%20EHW: 0
2026-03-29 22:10:24 [bca.uk] INFO: Found listing with ID: SR21%20XPP
2026-03-29 22:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR21%2520XPP%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for SR21%20XPP: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: YF74%20LVB
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF74%2520LVB%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for YF74%20LVB: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: BU69%20USL
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU69%2520USL%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for BU69%20USL: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: WN18%20CZG
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN18%2520CZG%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for WN18%20CZG: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: YC19%20PKO
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC19%2520PKO%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for YC19%20PKO: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: SJ71%20RXG
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ71%2520RXG%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for SJ71%20RXG: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: SD71%20NFK
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD71%2520NFK%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for SD71%20NFK: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: DV68%20ZSK
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV68%2520ZSK%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for DV68%20ZSK: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: CK67%20NNA
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK67%2520NNA%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for CK67%20NNA: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: SN70%20ZTY
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN70%2520ZTY%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for SN70%20ZTY: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: DE69%20ZGU
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE69%2520ZGU%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for DE69%20ZGU: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: GU18%20EUV
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU18%2520EUV%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for GU18%20EUV: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: LS73%20EAO
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS73%2520EAO%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for LS73%20EAO: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: AE71%20SMU
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE71%2520SMU%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for AE71%20SMU: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: EO70%20HZL
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO70%2520HZL%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for EO70%20HZL: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: WD66%20XTT
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD66%2520XTT%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for WD66%20XTT: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: LK71%20VUA
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK71%2520VUA%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for LK71%20VUA: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: LN19%20NLG
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN19%2520NLG%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for LN19%20NLG: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: HJ20%20XKC
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ20%2520XKC%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for HJ20%20XKC: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: F8%20MMG
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27F8%2520MMG%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for F8%20MMG: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: HT69%20PXU
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT69%2520PXU%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for HT69%20PXU: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: SY68%20WZB
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY68%2520WZB%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for SY68%20WZB: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: YY16%20WBW
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY16%2520WBW%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for YY16%20WBW: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: EK20%20ODX
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK20%2520ODX%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for EK20%20ODX: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: SK70%20KHD
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK70%2520KHD%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for SK70%20KHD: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: YE21%20SDX
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE21%2520SDX%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for YE21%20SDX: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: RO73%20GVE
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO73%2520GVE%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for RO73%20GVE: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: RK17%20KGX
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK17%2520KGX%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for RK17%20KGX: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: LO72%20AOJ
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO72%2520AOJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for LO72%20AOJ: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: LO69%20GRK
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO69%2520GRK%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for LO69%20GRK: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: LO72%20AOH
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO72%2520AOH%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for LO72%20AOH: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: PL19%20XVZ
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL19%2520XVZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for PL19%20XVZ: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: WV70%20PYX
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV70%2520PYX%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for WV70%20PYX: 0
2026-03-29 22:10:25 [bca.uk] INFO: Found listing with ID: CF71%20BGX
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF71%2520BGX%27 HTTP/1.1" 200 None
2026-03-29 22:10:25 [bca.uk] INFO: Scrape type for CF71%20BGX: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: DL21%20HYJ
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL21%2520HYJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for DL21%20HYJ: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: KV20%20YPO
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV20%2520YPO%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for KV20%20YPO: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: LO72%20AHD
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO72%2520AHD%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for LO72%20AHD: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: KW13%20UPM
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW13%2520UPM%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for KW13%20UPM: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: FL69%20EJK
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL69%2520EJK%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for FL69%20EJK: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: LO72%20AFV
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO72%2520AFV%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for LO72%20AFV: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: WT18%20HDJ
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT18%2520HDJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for WT18%20HDJ: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: WT19%20OWA
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT19%2520OWA%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for WT19%20OWA: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: CE21%20AXA
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE21%2520AXA%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for CE21%20AXA: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: CF71%20OKH
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF71%2520OKH%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for CF71%20OKH: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: DA70%20WNW
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA70%2520WNW%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for DA70%20WNW: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: FJ70%20TXB
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ70%2520TXB%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for FJ70%20TXB: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: L28%20PYN
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L28%2520PYN%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for L28%20PYN: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: LC24%20EZZ
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC24%2520EZZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for LC24%20EZZ: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: MT70%20CTO
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT70%2520CTO%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for MT70%20CTO: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: VN72%20OZG
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN72%2520OZG%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for VN72%20OZG: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: WD73%20ZTB
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD73%2520ZTB%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for WD73%20ZTB: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: LO72%20ABZ
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO72%2520ABZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for LO72%20ABZ: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: DX16%20LCA
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX16%2520LCA%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for DX16%20LCA: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: LO72%20ABV
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO72%2520ABV%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for LO72%20ABV: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: WP15%20HMO
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP15%2520HMO%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for WP15%20HMO: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: BK68%20XBV
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK68%2520XBV%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for BK68%20XBV: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: LM22%20FWV
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM22%2520FWV%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for LM22%20FWV: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: SA71%20VVL
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA71%2520VVL%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for SA71%20VVL: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: FA19%20NPP
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA19%2520NPP%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for FA19%20NPP: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: FL74%20KHT
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL74%2520KHT%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for FL74%20KHT: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: CV20%20TUW
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV20%2520TUW%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for CV20%20TUW: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: FA18%20CHZ
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA18%2520CHZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for FA18%20CHZ: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: DF69%20XCS
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF69%2520XCS%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for DF69%20XCS: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: WV69%20TXP
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV69%2520TXP%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for WV69%20TXP: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: VT19%20YHF
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VT19%2520YHF%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for VT19%20YHF: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: YW71%20JFE
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YW71%2520JFE%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for YW71%20JFE: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: DL21%20RBO
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL21%2520RBO%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for DL21%20RBO: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: FV67%20RXH
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV67%2520RXH%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for FV67%20RXH: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: LE19%20TZN
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LE19%2520TZN%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for LE19%20TZN: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: SE19%20UWZ
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE19%2520UWZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for SE19%20UWZ: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: WV70%20FFN
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV70%2520FFN%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for WV70%20FFN: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: DM19%20WMW
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DM19%2520WMW%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for DM19%20WMW: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: FG19%20NUY
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG19%2520NUY%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for FG19%20NUY: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: KM19%20OHB
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM19%2520OHB%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for KM19%20OHB: 0
2026-03-29 22:10:26 [bca.uk] INFO: Found listing with ID: WJ19%20MTY
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ19%2520MTY%27 HTTP/1.1" 200 None
2026-03-29 22:10:26 [bca.uk] INFO: Scrape type for WJ19%20MTY: 0
2026-03-29 22:10:26 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=46&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:26 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=46&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=46&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:10:28 [bca.uk] INFO: Total items found: 100
2026-03-29 22:10:28 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=47&sort=MostRecentlyAdded
2026-03-29 22:10:28 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:10:28 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=47&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:28 [bca.uk] INFO: Found listing with ID: YA18%20HFU
2026-03-29 22:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA18%2520HFU%27 HTTP/1.1" 200 None
2026-03-29 22:10:28 [bca.uk] INFO: Scrape type for YA18%20HFU: 0
2026-03-29 22:10:28 [bca.uk] INFO: Found listing with ID: YGZ%205087
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YGZ%25205087%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for YGZ%205087: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: YH23%20ZRN
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH23%2520ZRN%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for YH23%20ZRN: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: SK13%20HPC
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK13%2520HPC%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for SK13%20HPC: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: EG16%20EMF
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EG16%2520EMF%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for EG16%20EMF: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: YC21%20FHH
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC21%2520FHH%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for YC21%20FHH: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: HG69%20VOK
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG69%2520VOK%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for HG69%20VOK: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: HK69%20NWJ
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK69%2520NWJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for HK69%20NWJ: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: HV20%20UWZ
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV20%2520UWZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for HV20%20UWZ: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: LB18%20KWG
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB18%2520KWG%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for LB18%20KWG: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: LP71%20OMJ
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP71%2520OMJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for LP71%20OMJ: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: MT24%20TZY
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT24%2520TZY%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for MT24%20TZY: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: ND21%20BVM
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND21%2520BVM%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for ND21%20BVM: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: SK71%20ODG
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK71%2520ODG%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for SK71%20ODG: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: WV69%20NBG
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV69%2520NBG%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for WV69%20NBG: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: AU68%20KFP
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU68%2520KFP%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for AU68%20KFP: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: LD72%20SFU
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD72%2520SFU%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for LD72%20SFU: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: LF21%20WNO
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF21%2520WNO%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for LF21%20WNO: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: LG20%20OVA
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG20%2520OVA%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for LG20%20OVA: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: NV69%20MYB
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV69%2520MYB%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for NV69%20MYB: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: PG19%20LXN
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PG19%2520LXN%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for PG19%20LXN: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: RK69%20AJU
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK69%2520AJU%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for RK69%20AJU: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: RK70%20OPA
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK70%2520OPA%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for RK70%20OPA: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: RO70%20GLK
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO70%2520GLK%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for RO70%20GLK: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: AP19%20NRL
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP19%2520NRL%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for AP19%20NRL: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: BF21%20VMW
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF21%2520VMW%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for BF21%20VMW: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: DN20%20OCL
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN20%2520OCL%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for DN20%20OCL: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: HY21%20CVT
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY21%2520CVT%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for HY21%20CVT: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: KF68%20KPJ
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF68%2520KPJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for KF68%20KPJ: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: LB69%20WFT
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB69%2520WFT%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for LB69%20WFT: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: GU67%20HJK
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU67%2520HJK%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for GU67%20HJK: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: GU18%20OPC
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU18%2520OPC%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for GU18%20OPC: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: KE71%20MGV
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE71%2520MGV%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for KE71%20MGV: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: L200%20PBX
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L200%2520PBX%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for L200%20PBX: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: SB18%20DFO
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB18%2520DFO%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for SB18%20DFO: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: TRZ%202701
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27TRZ%25202701%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for TRZ%202701: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: WF70%20WRR
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF70%2520WRR%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for WF70%20WRR: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: WG19%20ZGY
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG19%2520ZGY%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for WG19%20ZGY: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: YX72%20SBU
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX72%2520SBU%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for YX72%20SBU: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: CE70%20EUU
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE70%2520EUU%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for CE70%20EUU: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: DY68%20HPK
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY68%2520HPK%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for DY68%20HPK: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: GP21%20APV
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP21%2520APV%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for GP21%20APV: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: KD19%20JYE
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KD19%2520JYE%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for KD19%20JYE: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: CK23%20RHZ
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK23%2520RHZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for CK23%20RHZ: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: LS21%20MTX
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS21%2520MTX%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for LS21%20MTX: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: MM18%20ZFN
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM18%2520ZFN%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for MM18%20ZFN: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: YL69%20YXG
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL69%2520YXG%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for YL69%20YXG: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: EK69%20VSO
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK69%2520VSO%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for EK69%20VSO: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: EY21%20MWV
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY21%2520MWV%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for EY21%20MWV: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: FY70%20KXT
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY70%2520KXT%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for FY70%20KXT: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: HJ70%20UXS
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ70%2520UXS%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for HJ70%20UXS: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: KM19%20FZW
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM19%2520FZW%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for KM19%20FZW: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: PF55%20KKH
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF55%2520KKH%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for PF55%20KKH: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: DC21%20GDZ
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC21%2520GDZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for DC21%20GDZ: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: CF15%20OAU
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF15%2520OAU%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for CF15%20OAU: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: BV18%20ZPW
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV18%2520ZPW%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for BV18%20ZPW: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: GX18%20DXW
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX18%2520DXW%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for GX18%20DXW: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: HY70%20VYZ
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY70%2520VYZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for HY70%20VYZ: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: LC22%20KXH
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC22%2520KXH%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for LC22%20KXH: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: LP23%20ZKR
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP23%2520ZKR%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for LP23%20ZKR: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: LX71%20SHV
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX71%2520SHV%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for LX71%20SHV: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: NJ21%20LZE
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ21%2520LZE%27 HTTP/1.1" 200 None
2026-03-29 22:10:29 [bca.uk] INFO: Scrape type for NJ21%20LZE: 0
2026-03-29 22:10:29 [bca.uk] INFO: Found listing with ID: VO68%20KWS
2026-03-29 22:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO68%2520KWS%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for VO68%20KWS: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: KR24%20WTF
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR24%2520WTF%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for KR24%20WTF: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: RN21%20LXG
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RN21%2520LXG%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for RN21%20LXG: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: VE72%20XGF
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE72%2520XGF%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for VE72%20XGF: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: AV70%20OMP
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV70%2520OMP%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for AV70%20OMP: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: CT19%20ZJK
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT19%2520ZJK%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for CT19%20ZJK: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: GJ75%20FCP
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ75%2520FCP%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for GJ75%20FCP: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: KJ19%20KZC
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520KZC%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for KJ19%20KZC: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: LG68%20TJY
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG68%2520TJY%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for LG68%20TJY: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: LM25%20VBV
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM25%2520VBV%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for LM25%20VBV: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: LT24%20OUA
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT24%2520OUA%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for LT24%20OUA: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: MH72%20DLK
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH72%2520DLK%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for MH72%20DLK: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: W666%20JDP
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27W666%2520JDP%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for W666%20JDP: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: LL70%20XZD
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL70%2520XZD%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for LL70%20XZD: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: DU21%20OZR
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU21%2520OZR%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for DU21%20OZR: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: LD72%20OUG
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD72%2520OUG%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for LD72%20OUG: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: VK70%20ZLN
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK70%2520ZLN%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for VK70%20ZLN: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: CF22%20MDN
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF22%2520MDN%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for CF22%20MDN: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: KM23%20ANU
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM23%2520ANU%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for KM23%20ANU: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: BD68%20LOH
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD68%2520LOH%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for BD68%20LOH: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: YE73%20TVP
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE73%2520TVP%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for YE73%20TVP: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: BK21%20LDU
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK21%2520LDU%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for BK21%20LDU: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: EX22%20SWK
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX22%2520SWK%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for EX22%20SWK: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: LM21%20CPZ
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM21%2520CPZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for LM21%20CPZ: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: VGZ%209261
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VGZ%25209261%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for VGZ%209261: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: HT22%20JYF
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT22%2520JYF%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for HT22%20JYF: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: ND72%20KBO
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND72%2520KBO%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for ND72%20KBO: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: VU23%20MWA
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU23%2520MWA%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for VU23%20MWA: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: BK69%20LNC
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK69%2520LNC%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for BK69%20LNC: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: BN71%20RNU
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN71%2520RNU%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for BN71%20RNU: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: LG72%20RHE
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG72%2520RHE%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for LG72%20RHE: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: MT70%20KMU
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT70%2520KMU%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for MT70%20KMU: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: NA69%20VOU
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA69%2520VOU%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for NA69%20VOU: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: CA23%20JKN
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA23%2520JKN%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for CA23%20JKN: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: FN23%20ZNC
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN23%2520ZNC%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for FN23%20ZNC: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: GL67%20URB
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL67%2520URB%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for GL67%20URB: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: YS69%20PCO
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS69%2520PCO%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for YS69%20PCO: 0
2026-03-29 22:10:30 [bca.uk] INFO: Found listing with ID: SW19%20JVU
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW19%2520JVU%27 HTTP/1.1" 200 None
2026-03-29 22:10:30 [bca.uk] INFO: Scrape type for SW19%20JVU: 0
2026-03-29 22:10:30 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=47&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:30 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=47&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=47&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:10:32 [bca.uk] INFO: Total items found: 100
2026-03-29 22:10:32 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=48&sort=MostRecentlyAdded
2026-03-29 22:10:32 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:10:32 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=48&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: WD21%20BYK
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD21%2520BYK%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for WD21%20BYK: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: WF71%20UAG
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF71%2520UAG%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for WF71%20UAG: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: YS73%20KTA
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS73%2520KTA%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for YS73%20KTA: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: VO24%20TYZ
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO24%2520TYZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for VO24%20TYZ: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: WA68%20ZNW
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA68%2520ZNW%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for WA68%20ZNW: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: U12C45069
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27U12C45069%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for U12C45069: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: LM71%20YXE
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM71%2520YXE%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for LM71%20YXE: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: OU66%20UBE
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU66%2520UBE%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for OU66%20UBE: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: DF19%20HWC
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF19%2520HWC%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for DF19%20HWC: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: AX66%20NKD
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX66%2520NKD%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for AX66%20NKD: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: FX71%20XAR
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX71%2520XAR%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for FX71%20XAR: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: LX71%20OYA
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX71%2520OYA%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for LX71%20OYA: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: AF15%20VVP
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF15%2520VVP%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for AF15%20VVP: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: BD13%20BXW
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD13%2520BXW%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for BD13%20BXW: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: CK11%20KOX
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK11%2520KOX%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for CK11%20KOX: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: DU70%20DPE
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU70%2520DPE%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for DU70%20DPE: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: LB21%20KYK
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB21%2520KYK%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for LB21%20KYK: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: SK21%20YOR
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK21%2520YOR%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for SK21%20YOR: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: DU22%20NTD
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU22%2520NTD%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for DU22%20NTD: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: YT72%20TZV
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT72%2520TZV%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for YT72%20TZV: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: HV20%20UJE
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV20%2520UJE%27 HTTP/1.1" 200 None
2026-03-29 22:10:32 [bca.uk] INFO: Scrape type for HV20%20UJE: 0
2026-03-29 22:10:32 [bca.uk] INFO: Found listing with ID: KO69%20MKP
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO69%2520MKP%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for KO69%20MKP: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: SC56%20MPC
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC56%2520MPC%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for SC56%20MPC: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: HK23%20LLG
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK23%2520LLG%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for HK23%20LLG: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: PF24%20JLO
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF24%2520JLO%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for PF24%20JLO: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: VK66%20UFV
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK66%2520UFV%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for VK66%20UFV: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: AJ24%20TVP
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ24%2520TVP%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for AJ24%20TVP: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: PF14%20WGO
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF14%2520WGO%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for PF14%20WGO: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: SG16%20XHH
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG16%2520XHH%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for SG16%20XHH: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: OV23%20EXE
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV23%2520EXE%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for OV23%20EXE: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: YH73%20SOC
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH73%2520SOC%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for YH73%20SOC: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: PY59%20AXP
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY59%2520AXP%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for PY59%20AXP: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: YC68%20CEV
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC68%2520CEV%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for YC68%20CEV: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: AO18%20WCW
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO18%2520WCW%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for AO18%20WCW: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: LD72%20BGK
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD72%2520BGK%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for LD72%20BGK: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: LP72%20SXS
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP72%2520SXS%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for LP72%20SXS: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: FL22%20LFA
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL22%2520LFA%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for FL22%20LFA: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: SA23%20DYO
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA23%2520DYO%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for SA23%20DYO: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: KE72%20VYC
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE72%2520VYC%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for KE72%20VYC: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: LV71%20GKO
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV71%2520GKO%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for LV71%20GKO: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: VO74%20TZV
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO74%2520TZV%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for VO74%20TZV: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: VK21%20NVJ
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK21%2520NVJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for VK21%20NVJ: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: OE23%20EDP
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE23%2520EDP%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for OE23%20EDP: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: LB22%20KLJ
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB22%2520KLJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for LB22%20KLJ: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: DF21%20YTE
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF21%2520YTE%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for DF21%20YTE: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: YR18%20YAO
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR18%2520YAO%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for YR18%20YAO: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: BF69%20YLP
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF69%2520YLP%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for BF69%20YLP: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: OV05%20WSL
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV05%2520WSL%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for OV05%20WSL: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: EJ59%20OFN
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ59%2520OFN%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for EJ59%20OFN: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: EX61%20UPR
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX61%2520UPR%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for EX61%20UPR: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: YS69%20ETJ
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS69%2520ETJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for YS69%20ETJ: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: YE73%20TKV
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE73%2520TKV%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for YE73%20TKV: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: MK69%20ZVG
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK69%2520ZVG%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for MK69%20ZVG: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: HW20%20WMO
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW20%2520WMO%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for HW20%20WMO: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: CU70%20GVE
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU70%2520GVE%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for CU70%20GVE: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: PF73%20UGK
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF73%2520UGK%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for PF73%20UGK: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: VE21%20BCO
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE21%2520BCO%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for VE21%20BCO: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: LR22%20JWY
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR22%2520JWY%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for LR22%20JWY: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: AX72%20NGU
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX72%2520NGU%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for AX72%20NGU: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: KP12%20EHW
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP12%2520EHW%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for KP12%20EHW: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: HN21%20KPP
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN21%2520KPP%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for HN21%20KPP: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: YH14%20VYL
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH14%2520VYL%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for YH14%20VYL: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: YR18%20JVF
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR18%2520JVF%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for YR18%20JVF: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: KY18%20PZM
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY18%2520PZM%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for KY18%20PZM: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: KS69%20MFA
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520MFA%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for KS69%20MFA: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: FE63%20ZPY
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE63%2520ZPY%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for FE63%20ZPY: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: CA19%20DFF
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA19%2520DFF%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for CA19%20DFF: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: RE11%20OMV
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE11%2520OMV%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for RE11%20OMV: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: PE69%20MDF
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE69%2520MDF%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for PE69%20MDF: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: YD16%20DDP
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD16%2520DDP%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for YD16%20DDP: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: MW63%20MZE
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW63%2520MZE%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for MW63%20MZE: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: LT72%20SNN
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT72%2520SNN%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for LT72%20SNN: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: YT67%20RVL
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT67%2520RVL%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for YT67%20RVL: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: YH71%20ENM
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH71%2520ENM%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for YH71%20ENM: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: VE72%20ZVG
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE72%2520ZVG%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for VE72%20ZVG: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: MX68%20WWF
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX68%2520WWF%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for MX68%20WWF: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: MX67%20NUV
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX67%2520NUV%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for MX67%20NUV: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: GJ68%20CXU
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ68%2520CXU%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for GJ68%20CXU: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: FE69%20EVJ
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE69%2520EVJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for FE69%20EVJ: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: GM66%20AEG
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM66%2520AEG%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for GM66%20AEG: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: FE69%20EUP
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE69%2520EUP%27 HTTP/1.1" 200 None
2026-03-29 22:10:33 [bca.uk] INFO: Scrape type for FE69%20EUP: 0
2026-03-29 22:10:33 [bca.uk] INFO: Found listing with ID: FA19%20NXH
2026-03-29 22:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA19%2520NXH%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for FA19%20NXH: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: BV16%20OFL
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV16%2520OFL%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for BV16%20OFL: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: BX70%20LBV
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX70%2520LBV%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for BX70%20LBV: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: ND18%20HSE
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND18%2520HSE%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for ND18%20HSE: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: FN17%20TKU
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN17%2520TKU%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for FN17%20TKU: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: BV13%20YGP
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV13%2520YGP%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for BV13%20YGP: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: LB71%20BRF
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB71%2520BRF%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for LB71%20BRF: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: WF69%20WPD
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF69%2520WPD%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for WF69%20WPD: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: HS24%20LHH
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HS24%2520LHH%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for HS24%20LHH: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: WG13%20JVU
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG13%2520JVU%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for WG13%20JVU: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: CN62%20RDX
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN62%2520RDX%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for CN62%20RDX: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: YL67%20FPO
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL67%2520FPO%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for YL67%20FPO: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: FE69%20ETA
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE69%2520ETA%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for FE69%20ETA: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: DX64%20EUF
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX64%2520EUF%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for DX64%20EUF: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: HG21%20UXV
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG21%2520UXV%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for HG21%20UXV: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: DN71%20BTZ
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN71%2520BTZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for DN71%20BTZ: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: BJ65%20HZL
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ65%2520HZL%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for BJ65%20HZL: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: CX16%20ULO
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX16%2520ULO%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for CX16%20ULO: 0
2026-03-29 22:10:34 [bca.uk] INFO: Found listing with ID: LG17%20XYD
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG17%2520XYD%27 HTTP/1.1" 200 None
2026-03-29 22:10:34 [bca.uk] INFO: Scrape type for LG17%20XYD: 0
2026-03-29 22:10:34 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=48&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:34 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=48&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=48&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:10:35 [bca.uk] INFO: Total items found: 100
2026-03-29 22:10:35 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=49&sort=MostRecentlyAdded
2026-03-29 22:10:35 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:10:35 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=49&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:36 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=49&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:36 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=49&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:36 [bca.uk] INFO: Found listing with ID: CU16%20NHH
2026-03-29 22:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU16%2520NHH%27 HTTP/1.1" 200 None
2026-03-29 22:10:36 [bca.uk] INFO: Scrape type for CU16%20NHH: 0
2026-03-29 22:10:36 [bca.uk] INFO: Found listing with ID: KV11%20MZZ
2026-03-29 22:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV11%2520MZZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:36 [bca.uk] INFO: Scrape type for KV11%20MZZ: 0
2026-03-29 22:10:36 [bca.uk] INFO: Found listing with ID: KT14%20BXM
2026-03-29 22:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT14%2520BXM%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for KT14%20BXM: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: KP12%20CLJ
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP12%2520CLJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for KP12%20CLJ: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: FG74%20HFR
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG74%2520HFR%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for FG74%20HFR: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: PK17%20FZY
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK17%2520FZY%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for PK17%20FZY: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: NU18%20AUO
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU18%2520AUO%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for NU18%20AUO: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: FG74%20HFN
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG74%2520HFN%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for FG74%20HFN: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: FG74%20HFE
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG74%2520HFE%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for FG74%20HFE: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: FG74%20HFM
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG74%2520HFM%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for FG74%20HFM: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: MF62%20PCV
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF62%2520PCV%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for MF62%20PCV: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: FG74%20HDY
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG74%2520HDY%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for FG74%20HDY: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: MD67%20WJL
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD67%2520WJL%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for MD67%20WJL: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: EO18%20NVY
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO18%2520NVY%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for EO18%20NVY: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: FG74%20HDO
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG74%2520HDO%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for FG74%20HDO: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: YG17%20LLH
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG17%2520LLH%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for YG17%20LLH: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: WJ15%20WPT
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ15%2520WPT%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for WJ15%20WPT: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: WF61%20BKJ
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF61%2520BKJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for WF61%20BKJ: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: WV71%20VZT
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV71%2520VZT%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for WV71%20VZT: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: BD22%20PWJ
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD22%2520PWJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for BD22%20PWJ: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: DT24%20XGC
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT24%2520XGC%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for DT24%20XGC: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: FM21%20GZT
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM21%2520GZT%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for FM21%20GZT: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: KS21%20VMV
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS21%2520VMV%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for KS21%20VMV: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: WN23%20YZY
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN23%2520YZY%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for WN23%20YZY: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: WN23%20ZBD
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN23%2520ZBD%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for WN23%20ZBD: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: WN23%20ZCV
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN23%2520ZCV%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for WN23%20ZCV: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: WN23%20ZDA
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN23%2520ZDA%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for WN23%20ZDA: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: WN72%20UVL
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN72%2520UVL%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for WN72%20UVL: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: WN72%20UYX
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN72%2520UYX%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for WN72%20UYX: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: VO68%20KOW
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO68%2520KOW%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for VO68%20KOW: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: YT23%20PHN
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT23%2520PHN%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for YT23%20PHN: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: LR67%20OCB
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR67%2520OCB%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for LR67%20OCB: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: LL15%20CCY
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL15%2520CCY%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for LL15%20CCY: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: KR20%20YWN
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR20%2520YWN%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for KR20%20YWN: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: SB18%20DDU
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB18%2520DDU%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for SB18%20DDU: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: BD22%20EMJ
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD22%2520EMJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for BD22%20EMJ: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: DS24%20NKU
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS24%2520NKU%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for DS24%20NKU: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: FG20%20FKJ
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG20%2520FKJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for FG20%20FKJ: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: OY69%20YUJ
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY69%2520YUJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for OY69%20YUJ: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: RJ23%20GUC
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ23%2520GUC%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for RJ23%20GUC: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: RY73%20CGK
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY73%2520CGK%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for RY73%20CGK: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: SA25%20RDZ
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA25%2520RDZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for SA25%20RDZ: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: SM24%20MXR
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM24%2520MXR%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for SM24%20MXR: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: WM73%20AXU
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM73%2520AXU%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for WM73%20AXU: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: WV23%20ODF
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV23%2520ODF%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for WV23%20ODF: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: YA70%20GSY
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA70%2520GSY%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for YA70%20GSY: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: DY24%20HDZ
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY24%2520HDZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for DY24%20HDZ: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: HK71%20FLR
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK71%2520FLR%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for HK71%20FLR: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: HN24%20KKT
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN24%2520KKT%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for HN24%20KKT: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: HV24%20RMX
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV24%2520RMX%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for HV24%20RMX: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: KM25%20OCP
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM25%2520OCP%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for KM25%20OCP: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: LL73%20FWG
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL73%2520FWG%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for LL73%20FWG: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: LN73%20EXV
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN73%2520EXV%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for LN73%20EXV: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: RE73%20KHZ
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE73%2520KHZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for RE73%20KHZ: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: RF73%20LWK
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF73%2520LWK%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for RF73%20LWK: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: DY23%20LBE
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY23%2520LBE%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for DY23%20LBE: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: KO69%20PJV
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO69%2520PJV%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for KO69%20PJV: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: KO16%20GDV
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO16%2520GDV%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for KO16%20GDV: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: RJ23%20GUX
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ23%2520GUX%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for RJ23%20GUX: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: KN70%20PZC
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN70%2520PZC%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for KN70%20PZC: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: NU23%20GUO
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU23%2520GUO%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for NU23%20GUO: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: BC16%20UGG
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC16%2520UGG%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for BC16%20UGG: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: RE73%20KLP
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE73%2520KLP%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for RE73%20KLP: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: AO67%20ZWF
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO67%2520ZWF%27 HTTP/1.1" 200 None
2026-03-29 22:10:37 [bca.uk] INFO: Scrape type for AO67%20ZWF: 0
2026-03-29 22:10:37 [bca.uk] INFO: Found listing with ID: YP72%20BDO
2026-03-29 22:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP72%2520BDO%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for YP72%20BDO: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: NJ23%20MVD
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ23%2520MVD%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for NJ23%20MVD: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: FT16%20CWO
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT16%2520CWO%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for FT16%20CWO: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: DV25%20OFO
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV25%2520OFO%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for DV25%20OFO: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: EA67%20ZVE
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA67%2520ZVE%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for EA67%20ZVE: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: MA24%20ZDU
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA24%2520ZDU%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for MA24%20ZDU: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: BD60%20GTF
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD60%2520GTF%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for BD60%20GTF: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: SW71%20BNE
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW71%2520BNE%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for SW71%20BNE: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: AP19%20OSZ
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP19%2520OSZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for AP19%20OSZ: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: LS72%20YXR
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS72%2520YXR%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for LS72%20YXR: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: OE74%20HDJ
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE74%2520HDJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for OE74%20HDJ: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: OE75%20YYG
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE75%2520YYG%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for OE75%20YYG: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: YO24%20MPZ
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YO24%2520MPZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for YO24%20MPZ: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: AP16%20YMV
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP16%2520YMV%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for AP16%20YMV: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: YT59%20ZZG
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT59%2520ZZG%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for YT59%20ZZG: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: LP73%20KTK
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP73%2520KTK%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for LP73%20KTK: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: YG20%20WDN
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG20%2520WDN%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for YG20%20WDN: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: LO72%20AHV
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO72%2520AHV%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for LO72%20AHV: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: LO72%20AHU
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO72%2520AHU%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for LO72%20AHU: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: FE22%20ZKO
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE22%2520ZKO%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for FE22%20ZKO: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: FE22%20XPR
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE22%2520XPR%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for FE22%20XPR: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: DC73%20LGO
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC73%2520LGO%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for DC73%20LGO: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: SK22%20TZA
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK22%2520TZA%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for SK22%20TZA: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: AY69%20OWU
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY69%2520OWU%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for AY69%20OWU: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: BD22%20KNF
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD22%2520KNF%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for BD22%20KNF: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: BL70%20NBK
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL70%2520NBK%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for BL70%20NBK: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: BW74%20HHZ
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW74%2520HHZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for BW74%20HHZ: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: FM70%20JUT
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM70%2520JUT%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for FM70%20JUT: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: FX73%20PZE
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX73%2520PZE%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for FX73%20PZE: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: KM71%20FYH
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM71%2520FYH%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for KM71%20FYH: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: KO68%20AOC
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO68%2520AOC%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for KO68%20AOC: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: KR67%20RPO
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR67%2520RPO%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for KR67%20RPO: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: MW70%20XZE
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW70%2520XZE%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for MW70%20XZE: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: OY25%20GPU
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY25%2520GPU%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for OY25%20GPU: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: WN23%20MKK
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN23%2520MKK%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for WN23%20MKK: 0
2026-03-29 22:10:38 [bca.uk] INFO: Found listing with ID: YF22%20JKZ
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF22%2520JKZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:38 [bca.uk] INFO: Scrape type for YF22%20JKZ: 0
2026-03-29 22:10:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 22:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=49&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 22:10:40 [bca.uk] INFO: Total items found: 100
2026-03-29 22:10:40 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=50&sort=MostRecentlyAdded
2026-03-29 22:10:40 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 22:10:40 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=50&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: KV71%20WGU
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV71%2520WGU%27 HTTP/1.1" 200 None
2026-03-29 22:10:40 [bca.uk] INFO: Scrape type for KV71%20WGU: 0
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: BF63%20HKP
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF63%2520HKP%27 HTTP/1.1" 200 None
2026-03-29 22:10:40 [bca.uk] INFO: Scrape type for BF63%20HKP: 0
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: ML64%20XYF
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML64%2520XYF%27 HTTP/1.1" 200 None
2026-03-29 22:10:40 [bca.uk] INFO: Scrape type for ML64%20XYF: 0
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: DC18%20OGR
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC18%2520OGR%27 HTTP/1.1" 200 None
2026-03-29 22:10:40 [bca.uk] INFO: Scrape type for DC18%20OGR: 0
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: DU18%20WNA
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU18%2520WNA%27 HTTP/1.1" 200 None
2026-03-29 22:10:40 [bca.uk] INFO: Scrape type for DU18%20WNA: 0
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: HT72%20GXD
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT72%2520GXD%27 HTTP/1.1" 200 None
2026-03-29 22:10:40 [bca.uk] INFO: Scrape type for HT72%20GXD: 0
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: RO22%20EKA
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO22%2520EKA%27 HTTP/1.1" 200 None
2026-03-29 22:10:40 [bca.uk] INFO: Scrape type for RO22%20EKA: 0
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: WD71%20CRX
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD71%2520CRX%27 HTTP/1.1" 200 None
2026-03-29 22:10:40 [bca.uk] INFO: Scrape type for WD71%20CRX: 0
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: HJ24%20VXV
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ24%2520VXV%27 HTTP/1.1" 200 None
2026-03-29 22:10:40 [bca.uk] INFO: Scrape type for HJ24%20VXV: 0
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: NJ21%20VNA
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ21%2520VNA%27 HTTP/1.1" 200 None
2026-03-29 22:10:40 [bca.uk] INFO: Scrape type for NJ21%20VNA: 0
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: NU22%20ETK
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU22%2520ETK%27 HTTP/1.1" 200 None
2026-03-29 22:10:40 [bca.uk] INFO: Scrape type for NU22%20ETK: 0
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: FD21%20CFN
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD21%2520CFN%27 HTTP/1.1" 200 None
2026-03-29 22:10:40 [bca.uk] INFO: Scrape type for FD21%20CFN: 0
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: YP74%20VLM
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP74%2520VLM%27 HTTP/1.1" 200 None
2026-03-29 22:10:40 [bca.uk] INFO: Scrape type for YP74%20VLM: 0
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: EO22%20KKF
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO22%2520KKF%27 HTTP/1.1" 200 None
2026-03-29 22:10:40 [bca.uk] INFO: Scrape type for EO22%20KKF: 0
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: NU22%20LLD
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU22%2520LLD%27 HTTP/1.1" 200 None
2026-03-29 22:10:40 [bca.uk] INFO: Scrape type for NU22%20LLD: 0
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: LV73%20OVR
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV73%2520OVR%27 HTTP/1.1" 200 None
2026-03-29 22:10:40 [bca.uk] INFO: Scrape type for LV73%20OVR: 0
2026-03-29 22:10:40 [bca.uk] INFO: Found listing with ID: AJ22%20UYK
2026-03-29 22:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ22%2520UYK%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for AJ22%20UYK: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: BL72%20FYW
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL72%2520FYW%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for BL72%20FYW: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: LL71%20KKE
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL71%2520KKE%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for LL71%20KKE: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: YG75%20LKE
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG75%2520LKE%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for YG75%20LKE: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: YM72%20CHG
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM72%2520CHG%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for YM72%20CHG: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: YM72%20CHN
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM72%2520CHN%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for YM72%20CHN: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: AR09%20BAB
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AR09%2520BAB%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for AR09%20BAB: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: CP66%20GDO
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP66%2520GDO%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for CP66%20GDO: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: DA71%20NZX
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA71%2520NZX%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for DA71%20NZX: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: EA69%20EWJ
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA69%2520EWJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for EA69%20EWJ: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: KK19%20JFA
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK19%2520JFA%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for KK19%20JFA: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: S555%20NRS
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S555%2520NRS%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for S555%20NRS: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: SK71%20XRC
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK71%2520XRC%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for SK71%20XRC: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: SL68%20AYB
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL68%2520AYB%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for SL68%20AYB: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: V50%20TAT
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V50%2520TAT%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for V50%20TAT: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: VE68%20XBJ
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE68%2520XBJ%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for VE68%20XBJ: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: WD17%20NJK
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD17%2520NJK%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for WD17%20NJK: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: WO21%20FXZ
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO21%2520FXZ%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for WO21%20FXZ: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: WS19%20OKT
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WS19%2520OKT%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for WS19%20OKT: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: YF20%20RRU
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF20%2520RRU%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for YF20%20RRU: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: YF67%20HYP
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF67%2520HYP%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for YF67%20HYP: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: YG20%20MLK
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG20%2520MLK%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for YG20%20MLK: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: CX20%20LXR
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX20%2520LXR%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for CX20%20LXR: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: GL21%20KZD
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL21%2520KZD%27 HTTP/1.1" 200 None
2026-03-29 22:10:41 [bca.uk] INFO: Scrape type for GL21%20KZD: 0
2026-03-29 22:10:41 [bca.uk] INFO: Found listing with ID: KN72%20NCO
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 22:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "